Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
1
vote
0 answers

Ceph Nautilus with step by step instruction to access existing CephFS cluster from Kubernetes pod

The most recent Ceph "Nautilus" release claims Kubernetes support in CephFS (not via RDB). It is not clear how to configure Kubernetes (without Rook) to get access to my CephFS cluster just like I can access NFS storage. What I did: 1.Installed the…
1
vote
0 answers

How does Rooks storage migration work under the hood?

Question: Could anyone point me to a source which explains how Rook executes its storage migration under the hood? Background: Rook is a cloud-native storage orchestrator often used in combination with Ceph. Rook automates tasks like scaling,…
User12547645
  • 6,955
  • 3
  • 38
  • 69
1
vote
0 answers

Rook/Ceph data not synced normally between two clusters

I have two Rook Ceph clusters and made a replicated pool with RBD mirror, but the data not synced,next is the info [root@ceph-node5 tmp]# rbd mirror pool status replicapool --verbose health: WARNING images: 2 total 2 unknown rbd: newer…
xizhao
  • 11
  • 3
1
vote
0 answers

Why calling the boto3 list buckets operation returns Bad Gateway (502) during a ceph osd flapping?

This could be more related to the Ceph cluster than the python lib boto3. When an OSD goes down all cluster responding 502 (Bad Gateway) to our s3 clients (boto3, s3cmd, rclone, aws-cli). The big picture of my cluster: - 3 Rados Gateway with Nginx…
1
vote
0 answers

Collectd plugin issue with Ceph Luminous

How do you create a metric for the highest used OSD with data from the Collectd plugin (Ceph Luminous). Metrics are not generating correctly.
Vishal Bhosale
  • 51
  • 3
  • 11
1
vote
1 answer

Boto3 put object results in botocore.exceptions.ReadTimeoutError

I have setup two ceph clusters with a rados gateway on a node for each of them. What I'm trying to achieve is to transfer all objects from a bucket "A" with an endpoint in my cluster "1" to a bucket "B" which can be reached from another endpoint on…
user3561383
  • 77
  • 1
  • 13
1
vote
0 answers

Ceph rbd write poor performance

We have a ceph cluster of four nodes, 48GB of memory on each, and Debian 9.8. Cluster connected 10Gbe. Cisco sg350xg-24t switch, Intel Corporation Ethernet Controller 10G X550T Cards. One port for internal network, one for external. For tests, each…
1
vote
3 answers

How to change the access mode of PVC in open shift

How I will be able to change the access mode in the persistent volume claim access mode? currently it is showing as RWO, and I need to change it as RWX? Many thanks in advance.
Anuradha Fernando
  • 1,063
  • 12
  • 17
1
vote
1 answer

CEPH Write Acknowledgement in case a replica node is down

While a ceph write operation , standard PUT operation - in case the data node that holds the partition (based on hash) is found dead, then does the coordinator node still sends SUCCESS ACK back for write operation ? So the question is in case one of…
fortm
  • 4,066
  • 5
  • 49
  • 79
1
vote
0 answers

libceph: kernel client remains invalid connection retry

After ceph server's ips change, kernel libceph client keeps connection retry to old monitor ips. could someone please has experience to resolve the problem, namely cleaning kernel errors up? kernel log errors resemble below: [Fri Dec 21 15:11:42…
1
vote
1 answer

Ceph Disaster Recovery Solution

I m sitting up a new cluster , i would like to set up another cluster and enable sync between the two, the second cluster work as disater recovery. i'm new to Ceph and i'm not sure how to do it?
beyond
  • 11
  • 2
1
vote
1 answer

debian systemd: ceph-osd@x.service: Failed at step LIMITS spawning /usr/lib/ceph/ceph-osd-prestart.sh: Operation not permitted

The error appears in /var/log/syslog while creating new OSDs to a Ceph cluster. The symptoms are silent and ansible shows the following error: monclient: authenticate NOTE: no keyring found; disabled cephx authentication", "librados:…
Vishal K
  • 1,164
  • 1
  • 10
  • 21
1
vote
0 answers

How to deploy Docker services to swarm using cephFS?

I have configured Ceph in a Docker Swarm with 5 nodes using the daemon/ceph Docker image. The status of the same is given below. root@master1 mnt]# ceph -s cluster: id: eec52783-a0b5-4195-82b7-b66ea5514650 health:…
Sarath Kumar
  • 145
  • 8
1
vote
1 answer

Command timesout [osd1][INFO ] Running command: sudo /usr/sbin/ceph-volume

I'm having issues running ceph-deploy or creating manually osd My environment is virtual machines on openstack which each have a virtual volume attached. Ubuntu 16.04 The command hangs at the below command: ubuntu@mr-jb:~/cluster$ ceph-deploy…
1
vote
1 answer

Ceph Disk write slow on dd oflag=dsync on small block sizes

We have deployed a ceph cluster with ceph version 12.2.5, using Dell R730xd servers as storage nodes with 10 7.2k NLSAS drives as OSDs. We have 3 storage nodes. We did not configured RAID settings and used the drives directly to create OSDs. We…