Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
2
votes
2 answers

State in Kubernetes

A Kubernetes cluster should not contain stateful services like databases because of scalability, recovery and operation of the storage. Would be the use of ceph be an alternative to this problem?
moinster
  • 133
  • 6
2
votes
1 answer

CEPH HEALTH_WARN Degraded data redundancy: pgs undersized after reweighting

We have a CEPH setup with 3 servers and 15 OSDs. Two weeks ago We got "2 OSDs nearly full" warning. We have reweighted the OSD by using below command and restarted both OSDs ceph osd reweight-by-utilization After restarting we are getting below…
adminz
  • 215
  • 1
  • 2
  • 13
2
votes
0 answers

How to add a SPDK-backend OSD in Ceph (Octopus version)?

I have an NVMe SSD and want to use it as an OSD backend, but I can't create an OSD when I want to enable SPDK(it could work as a block-device). I did the following things: Building Ceph with SPDK enabled I edit the CMakeLists.txt to make sure SPDK…
uncleDuo
  • 31
  • 3
2
votes
1 answer

create rook-ceph cluster on minikube

I am on ubuntu 20.04 and trying to create a rook-ceph cluster. I have kvm2 installed to try it. This is what I am doing but I don't see the node accessing storage. minikube start --vm-driver=kvm2 minikube mount /dev/vda1 /data/ceph and I followed…
mgs
  • 43
  • 7
2
votes
1 answer

MountVolume.SetUp failed for volume "rook-ceph-crash-collector-keyring" : secret "rook-ceph-crash-collector-keyring" not found

I am trying to configure ceph on kubernetes cluster using rook, I have run the following commands: kubectl apply -f common.yaml kubectl apply -f operator.yaml kubectl apply -f cluster.yaml I have three worker nodes with atached volumes and on…
tarek salem
  • 540
  • 1
  • 6
  • 20
2
votes
2 answers

Rook and ceph on kubernetes

I am new to Kubernetes. I am in need of integrating rook and ceph, adding NFS as block storage. Does anyone have any working examples? I followed…
Siddharth
  • 192
  • 3
  • 20
2
votes
1 answer

Exception when creating a role on Ceph Object Gateway using Java AWS SDK

I am trying to follow the Ceph documentation's examples to test its STS functionality using the Java AWS SDK (v 2.5.16). It is failing rather early on in the process when calling the IamClient's createRole method. The exception thrown…
Christoph
  • 233
  • 1
  • 6
2
votes
2 answers

Ceph storage OSD disk upgrade (replace with larger drive)

I have three servers each with 1 x SSD drive (Ceph base OS) and 6 x 300Gb SAS drives, at the moment I'm only using 4 drives on each server as the OSD's in my Ceph storage array and everything is fine. My question is that now I have built this and…
Scott McKeown
  • 141
  • 1
  • 8
2
votes
1 answer

How can a failed Kubernetes Ceph node be deleted automatically?

On an environment with more than one node and using Ceph block volumes in RWO mode, if a node fails (is unreachable and will not come back soon) and the pod is rescheduled to another node, the pod can't start if it has a Ceph block PVC. The reason…
2
votes
2 answers

Searching a cluster filesystem (file storage) that is up-to-date and runs on both FreeBSD and Linux well

I have a FreeBSD 12.1-RELEASE server and a CentOS 7 server. Both run on amd64. I would like to set up a cluster file system, that runs on both platforms well. It should have CentOS 7 packages and FreeBSD packages. The solutions should be open-source…
Ronny Forberger
  • 393
  • 1
  • 8
  • 23
2
votes
2 answers

rook-ceph-osd-prepare pod stuck for hours

I am new to ceph and using rook to install ceph in k8s cluster. I see that pod rook-ceph-osd-prepare is in Running status forever and stuck on below line: 2020-06-15 20:09:02.260379 D | exec: Running command: ceph auth get-or-create-key…
raj_arni
  • 959
  • 2
  • 15
  • 29
2
votes
1 answer

Why can't find osd pod in kubernetes after deploying rook-ceph?

Tried to install rook-ceph on kubernetes as this guide: https://rook.io/docs/rook/v1.3/ceph-quickstart.html git clone --single-branch --branch release-1.3 https://github.com/rook/rook.git cd rook/cluster/examples/kubernetes/ceph kubectl create -f…
Jingqiang Zhang
  • 1,039
  • 2
  • 13
  • 24
2
votes
1 answer

How to remove multple ceph nodes slowly

In a 20 node cluster with 10 OSDs per node, how would you remove nodes 1-5. If I reweight the OSDs on node1 then data will move to node2-node20. Then do the same for node2 through node5. Is there a way to put the OSDs in node2-node5 in a read-only…
2
votes
2 answers

How to set IO limit on RBD image (ceph qos settings)

From the ceph doc : librbd supports limiting per image IO, controlled by the following settings. Running the commands from the doc prints unknown options qos .... I haven't found anything on the web so far. Can anyone help me please?
aiqency
  • 1,015
  • 1
  • 8
  • 22
2
votes
0 answers

”ceph health” Can not be used. Module 'restful' has failed dependency: No module named 'pecan'

[root@stor1 ~]# ceph health HEALTH_WARN Module 'restful' has failed dependency: No module named 'pecan' but I have “pecan” [root@stor1 ~]# pip3 list --format=columns | grep pecan pecan 1.3.3 I tried: 1. install this module for all…
Crystal
  • 101
  • 1
  • 1
  • 5