Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster. Ceph's main goals are to be completely distributed without a single point of failure, scalable to the exabyte level, and freely-available.

179 questions
2
votes
2 answers

How do I mount rbd devices with the fuse driver?

This is a follow-up question from: How do I mount an rbd device from fstab Which I asked some time back. How do I mount rbd devices with the fuse driver? (I can't use the kernel driver from docker without opening up lots of privileges) As far as I…
hookenz
  • 14,472
  • 23
  • 88
  • 143
2
votes
0 answers

Conditions for "mds cluster is degraded"

I see into Ceph and after running command $ ceph status I meet text "mds cluster is degraded". I try to seek it at official Ceph docs, but nothing find. If I understand correctly, MDS needed for mounting and presenting ceph's data as regular FS. Can…
2
votes
1 answer

DELL FS12-SC PERC 6/i replacement with JBOD support?

I have 3 DELL FS12-SC servers with a bunch of 3TB drives (issue number 1, the perc 6/i doesn't appear to support 3TB drives). I'm setting up a ceph cluster and need to run the drives in JBOD mode. The perc 6/i doesn't support that either. The best…
Brian Lovett
  • 197
  • 2
  • 11
2
votes
4 answers

Scale-out distributed storage with snapshots

I'm aware there are many similar questions around, several with great answers. I still haven't quite found what I'm looking for though: a distributed, scale-out FS that supports snapshots. Gluster with finished snapshot support would be great, but…
user206444
2
votes
1 answer

How do I mount an rbd device from fstab

According to this link: http://docs.ceph.com/docs/master/start/quick-rbd/ I can mount an rbd, which works perfectly. The question I have is how do I do this from fstab? The end goal being to mount it to /var/lib/mysql I've only found examples for…
hookenz
  • 14,472
  • 23
  • 88
  • 143
2
votes
1 answer

What kind of "volume/storage management" has the largest support/feature set these days?

(DISCLAIMER: This is "time bound" as probably every other question, I just point it out now instead of implicating it) part of reviewing a few basic decisions for our infrastructure is once again the topic of volume/storage management. I'm mainly…
serverhorror
  • 6,478
  • 2
  • 25
  • 42
2
votes
1 answer

copy kvm image from ceph to other storage

A while ago I created a ceph storage cluster and connected it to proxmox2 according to the method described in http://pve.proxmox.com/wiki/Storage:_Ceph. We have some kvm images running on the ceph storage that where originaly just for testing…
Vincent
  • 291
  • 1
  • 4
  • 10
2
votes
2 answers

Ceph does not detect disks

I am using cephadm. I had a test cluster up and running. I re-installed the OS and during installation nuked the drives by deleting the LVM volume groups and partitions. Now lsblk shows the devices to be present but ceph orch device ls returns…
Tintin
  • 121
  • 2
2
votes
0 answers

CEPH/ RGW encryption with mutliple tenants

I'm currently planning a small OpenStack deployment and I want to use Ceph for object storage (via Rados Gateway) and block storage. Ceph supports multitenancy. It also supports encryption using key management services like vault or barbican. Since…
2
votes
1 answer

bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (1) Operation not permitted

When I have upgrade the from Octopus 15.2.10 to Pacific 16.2.0, the mon nodes starts successfully using the manual upgrade process (by installing the packages with no orch) however when I have upgrade the OSDs, the ceph-osd service does not…
user393397
  • 37
  • 4
2
votes
2 answers

Orchestrator is not available with fresh Rook instance

I'm trying to set up a rook Ceph cluster on my kubernetes cluster. Topography: 3 kubernetes nodes (all are master/worker pods) Each node has /dev/vdX on it for ceph Each node is intended to work as part of the ceph cluster I deployed Rook operator…
cclloyd
  • 593
  • 2
  • 14
  • 29
1
vote
0 answers

Ceph Clock Skew

I want to know where I can configure the limit of skew time for my ceph monitors. Also,how does CEPH throw this clock skew error? Specifically from which file and where can I find the file so that I can edit? I am already running NTP and…
1
vote
0 answers

CEPH netfilter connection tracking issues

We have a CEPH cluster (Ubuntu 18.04, Luminous) for Openstack images and volumes. As I was taking it into production I found many performance issues, slow OSDs, and throughput down to a trickle; this turned out to be due to the iptables rules. As is…
Dennis
  • 11
  • 1
1
vote
2 answers

GlusterFS or Ceph RBD for storing Virtual Machine image

I am using glusterfs 5.3 for storing images of virtual machines in Cloudstack/KVM environment, majority of VMs are DB Servers (Sql Server & MariaDB). But I am facing performance issue on VMs specifically on database servers. I get lots of Time out…
Prateek
  • 11
  • 2
1
vote
0 answers

ceph-deploy osd create --data /dev/vdb fails

From my ceph (mimic release) administrative node I ran ceph-deploy osd create --data /dev/vdb ceph0 against a bare metal ceph node and it worked without error. Now I run the same command against a virtual ceph node (with an unpartitioned qcow2…
mr.zog
  • 923
  • 3
  • 20
  • 39