Stack Overflow
Stack Overflow

Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
4
votes
3 answers

CEPH, running a Cluster over the Internet

Are there any concerns in regards to security when running a CEPH Cluster on the Internet? I could not find directly something which makes it no usuable for this use case. I dont need low I/O response times, I am fine with it. Thanks Guys.
Neoon
  • 169
  • 2
  • 12
4
votes
0 answers

How to abandon Ceph PGs that are stuck in "incomplete"?

We have been working on restoring our Ceph cluster after losing a large number of OSDs. We have all PGs active now except for 80 PGs that are stuck in the "incomplete" state. These PGs are referencing OSD.8 which we removed 2 weeks ago due to…
DanJ
  • 1,654
  • 1
  • 16
  • 23
4
votes
1 answer

Can someone explain the strange leftover OSD devices in the Ceph CRUSH map -- renamed from osd.N to deviceN?

A while back we removed two damaged OSDs from our Ceph cluster, osd.0 and osd.8. They are now gone from most Ceph commands, but are still showing up in the CRUSH map with weird device names: # devices device 0 device0 <----- device 1 osd.1 device…
DanJ
  • 1,654
  • 1
  • 16
  • 23
3
votes
2 answers

Showing OSD 0 after installing rook-ceph in kubernetes cluster

I have set up 3 node kubernetes using 3 VPS and installed rook/ceph. when I run kubectl exec -it rook-ceph-tools-78cdfd976c-6fdct -n rook-ceph bash ceph status I get the below result osd: 0 osds: 0 up, 0 in I tried ceph device ls and the result…
jeril
  • 1,109
  • 2
  • 17
  • 35
3
votes
1 answer

Increase ceph recovery

I've been trying to improve our ceph recovery speed and every option I've come across in ceph documentation and on various forums seems to have no effect. I've tried setting a combination of options found online at this point with no change in…
user2074364
  • 31
  • 3
3
votes
3 answers

Ceph PGs not deep scrubbed in time keep increasing

I've noticed this about 4 days ago and dont know what to do right now. The problem is as follows: I have a 6 node 3 monitor ceph cluster with 84 osds, 72x7200rpm spin disks and 12xnvme ssds for journaling. Every value for scrub configurations are…
Nyquillus
  • 179
  • 1
  • 5
  • 23
3
votes
1 answer

CephFS Unable to attach or mount volumes: unmounted volumes=[image-store]

I'm having trouble getting my Kube-registry up and running on cephfs. I'm using rook to set this cluster up. As you can see, I'm having trouble attaching the volume. Any idea what would be causing this issue? any help is…
Xcer
  • 87
  • 2
  • 7
3
votes
0 answers

ceph rook deployment issue found at mount pvc

I am warren . try to setup ceph by rook in my k8s environment . i followed the offical document https://rook.io/docs/rook/v1.4/ceph-quickstart.html. almaost everythings looks well during the ceph setup. I also verified it by ceph…
qqmail
  • 31
  • 1
3
votes
2 answers

Rookio Ceph cluster : mon c is low on available space message

I have setup RookIO 1.4 cluster in Kubernetes 1.18. with 3 nodes allocated 1TB storage on each of them. after creating cluster. when I run the ceph status cluster status shows as HEALTH_WARN with mon c is low on available space. There is no data…
sfgroups
  • 18,151
  • 28
  • 132
  • 204
3
votes
2 answers

how to cut out connection for aws sdk s3 after predefined time?

I'm using aws-sdk module in my node app, specifically the S3 library, to write to a ceph cluster. The application upload fixed size files periodically. The ceph perform sharding sometimes, which cause the http upload request to stall for 500…
natdev
  • 507
  • 1
  • 8
  • 19
3
votes
3 answers

1 pg undersized health warn in rook ceph on single node cluster(minikube)

I'm deploying rook-ceph into a minikube cluster. Everything seems to be working. I added 3 unformatted disk to the vm and its connected. The problem that im having is when I run ceph status, I get a health warm message that tells me "1 pg…
Xcer
  • 87
  • 2
  • 7
3
votes
2 answers

Failed to infer CIDR network for mon ip

I follow the instructions to bootstrap a new Ceph (I'm new to Ceph) cluster. I got the following error: sudo cephadm bootstrap --mon-ip INFO:cephadm:Verifying podman|docker is present... INFO:cephadm:Verifying lvm2 is…
Alexandre A.
  • 1,619
  • 18
  • 29
3
votes
1 answer

Ceph BucketNotifications do not push messages to Kafka

I have a ceph test cluster with three nodes with radosgw installed on the first node. ceph version is 14.2.6 (f0aa067ac7a02ee46ea48aa26c6e298b5ea272e9) nautilus (stable) # cat /etc/ceph/ceph.conf [global] fsid =…
fenhir
  • 31
  • 2
3
votes
2 answers

How do I fix a dial tcp 10.96.0.1:443: i/o timeout error for Operator pod installed via helm-rook?

I pretty much added the repo with this command helm repo add rook-stable https://charts.rook.io/stable Then I ran the command helm install --namespace rook-ceph-system The operator is created at first but then turns into a…
CoderDude74
  • 31
  • 1
  • 1
  • 2
3
votes
2 answers

Why Ceph turns status to Err when there is still available storage space

I built a 3 node Ceph cluster recently. Each node had seven 1TB HDD for OSDs. In total, I have 21 TB of storage space for Ceph. However, when I ran a workload to keep writing data to Ceph, it turns to Err status and no data can be written to it any…
Eugene
  • 10,627
  • 5
  • 49
  • 67
1 2
3
…
40 41