Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [ceph]

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster.

Ceph is a free software storage platform designed to present object, block, and file storage from a single distributed computer cluster. Ceph's main goals are to be completely distributed without a single point of failure, scalable to the exabyte level, and freely-available.

179 questions
0
votes
1 answer

Ceph determine PG based on rados object name

In Ceph, the command rados --pgid ls allows you to list all the rados objects that are stored in a specific placement group. My question is: is there a command that does the reverse? So, is it possible, given a specific rados object name, to…
roelvanmeer
  • 1,764
  • 3
  • 13
  • 27
0
votes
0 answers

changing queue parameter nr_request on NVMe dev

We would like to use NVMes (SAMSUNG MZ1LB1T9HALS-00007) as a cache-tier in a Ceph System (17.2.0). The problem is that the stored data has a lot of small files and if hot-tiering is set to ~70% on the NVMes many slow-ops show up. Therefore, we…
pawel_winzig
  • 101
  • 2
0
votes
2 answers

Which Ceph OSD is mapped to which pysical drive

I have a Ceph system with 8 OSD's and 8 disks mapped 1:1. One of the disks is giving me smart errors and I would like to replace it. How do I know which physical disk is mapped to which OSD?
Mr. Diba
  • 128
  • 5
0
votes
1 answer

ceph-deploy install command fails with [ceph_deploy][ERROR ] RuntimeError: configparser.NoSectionError: No section: 'main'

Command ceph-deploy install admin datanode_dn2 fails with output: [ceph_deploy.install][INFO ] Distro info: rocky 9.1 blue onyx [admin][INFO ] installing Ceph on admin [admin][INFO ] Running command: sudo yum clean all [admin][DEBUG ] 57 files…
Kabira K
  • 133
  • 5
0
votes
1 answer

Cache mechanisme in kubernetes

I've got the next setup: Proxmox 7.2 CEPH 16.2.9 K3S v1.23.15+k3s1 CEPH CSI v3.7.2 CEPH using as RBD-storage for QEMU images and K8S PVC. When I do disk benchmark in QEMU I've got the next results: Name Read(MB/s) Write(MB/s) SEQ1M Q8…
chs_voks
  • 33
  • 1
  • 5
0
votes
1 answer

Why is ceph is not detecting ssd device on a new node?

I have installed a ceph cluster (quincy) with already 2 nodes and 4 OSDs. Now I added a 3rd host running Debian (bullseye) to the cluster. The new host is deteced correctly and runs a mom. The problem is that no OSDs are listed on the new host even…
Ralph
  • 101
  • 4
0
votes
1 answer

Enabling Cephx In cephadm depolyment

Hello i am trying to enable cephx in my ceph cluster i added this three lines to /etc/ceph/ceph.conf auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx i didn't don generate any keyring since cephadm did…
Hoodad Tabibi
  • 109
  • 6
0
votes
0 answers

Unable to start Ceph RGW service

Context: I'm trying to setup a new ceph-17.2.5 cluster Initial setup consists of 1 mgr, 1 mon and 1 osd all installed on same box using cephadm. So far I am able to access http://192.168.3.50:8080/api/auth and get token in the response. But…
Karan Shukla
  • 1
  • 1
0
votes
1 answer

In Ceph cluster, for the same total raw volume, for example 32To each in 5 nodes, how to choose between 16 ssd of 2To or 8 of 4To? Any guidance rules?

I'm designing a ceph cluster for mixing cephFS and rbd for my company( VM et file infrastructure). In my set I need 32To raw storage by node. I start with 5 nodes. The seller quotes propose me to choose beetween 16 ssd of 2 teras or 8 ssd of 4 teras…
Ztevoz Milloz
  • 3
  • 3
0
votes
0 answers

Dedicated Network connection for CEPH or aggregated general purpose network connection?

We are building a Kubernetes Cluster on bare metal. As the cluster is getting physically installed, I was asked to weigh in on the following question: Each node has two network connections of 25Gbps. We will be using Ceph as a Filesystem for the…
bountrisv
  • 1
0
votes
0 answers

Where do I find a script to check a Ceph iSCSI gateway configuration?

On a Ceph cluster with iSCSI gateway we have an issue with gateway configuration changes being applied partially. The result is a broken gateway.conf, which goes unnoticed until (possibly weeks later) a gateway is restarted, for whatever reason, at…
reinierpost
  • 412
  • 3
  • 9
0
votes
1 answer

Is running CEPH on public cloud without data replication a good idea?

My startup is thinking about adopting CEPH for block storage (and other features it provides). Most of our infrastructure runs on public cloud (DO,GCP,AWS,etc...). On public cloud data storage you usually have a bunch of guarantees with regards to…
mohamed emad
  • 11
  • 3
0
votes
0 answers

Serve cephFS files over HTTP (or S3?)

I have a CEPH+LXD cluster configuration. And I would like to serve the files in the container over HTTP (S3,whatever doesn't matter). Is there a way to do this using the rgw service? Like can I point it to serve the cephFS directories and stuff? In…
mohamed emad
  • 11
  • 3
0
votes
0 answers

Volume not getting mounted (Nexus is running on this Pod)

Nexus is running on worker node and Nexus UI went down because of storage issue. We increased the storage space from 150 GB to 210GB for PV & PVC. Increased storage for PV and PVC Then, when we tried to up the Nexus, volume is not getting mounted…
Shree
  • 1
0
votes
1 answer

Remove orphaned Ceph volumes

I have installed a Ceph cluster across three nodes which needed completely reinstalling after testing. It seems that on one of the nodes, some configuration data remained which Ceph is still picking up. On boot, Ceph seems to be looking for old…
Chris
  • 1,289
  • 2
  • 18
  • 34
1 2 3
…
11 12