Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
1
vote
1 answer

Minio Slow performance when there are many users?

I have 1 minio object storage cluster, everyday it is running so ok but someday when there are many users using to put and download data that make performance too slow and maybe corrupt and especially with small data size. So how the way can i make…
marock
  • 31
  • 2
1
vote
1 answer

ceph shared file system mounting error: permission denied

I am facing this issue when mounting a static Ceph volume to K8s. MountVolume.MountDevice failed for volume "test1-pv" : rpc error: code = Internal desc = an error (exit status 32) occurred while running mount args: [-t ceph │ │…
ozmhsh
  • 61
  • 2
  • 8
1
vote
1 answer

Hadoop archive utility alternative for CEPH

I have some HAR files (Hadoop archive files) on my HDFS based storage, which have some archived data that is not frequently used. Now we have a plan to move to CEPH based storage. So I have 2 questions: Can I somehow use my existing HAR files on…
pri
  • 1,521
  • 2
  • 13
  • 26
1
vote
1 answer

ceph-deploy mon create-initial failed

I've tried reinstall and reconf serveral times, but it still doesn't work. [ceph2][INFO ] Running command: /usr/bin/ceph --connect-timeout=25 --cluster=ceph --admin-daemon=/var/run/ceph/ceph-mon.ceph2.asok mon_status [ceph2][INFO ] Running…
ghost
  • 41
  • 3
1
vote
1 answer

Ceph/Rados AWS S3 API Bucket Policy via CURL

I am currently struggling with a problem I am having with rest calls to an AWS s3 API hosted by a rados/ceph gateway. For reasons I wont go into, I can't use an SDK that is provided to talk to it, which would solve all of my woes - I'm recreating…
Sheepykins
  • 31
  • 3
1
vote
0 answers

Kubernetes: High CPU usage and zombie processes when "Disk Pressure" event

We run on-premise small K8s cluster (based on RKE stack). 1x etcd/control node, 2x worker nodes. Components are: OS: Centos 7 Docker version: 19.3.9 K8s: 1.17.2 Other, important fact: we're using Rook-Ceph storage cluster on both worker nodes…
1
vote
3 answers

ceph df max available miscalculation

Ceph cluster shows following weird behavior with ceph df output: --- RAW STORAGE --- CLASS SIZE AVAIL USED RAW USED %RAW USED hdd 817 TiB 399 TiB 418 TiB 418 TiB 51.21 ssd 1.4 TiB 1.2 TiB 22 GiB 174 GiB …
Nyquillus
  • 179
  • 1
  • 5
  • 23
1
vote
2 answers

How to use ceph to store large amount of small data

I set up a cephfs cluster on my virtual machine, and then want to use this cluster to store a batch of image data (total 1.4G, each image is about 8KB). The cluster stores two copies, with a total of 12G of available space. But when I store data…
Sc_Cloud
  • 11
  • 2
1
vote
1 answer

How to include controller nodes as OSDs in ceph when installed with rook?

I have a Kubernetes cluster with three control and three worker nodes. To install Ceph I'm using rook. After the installation, only the worker nodes are included in the Ceph cluster - but not the controller nodes. The configuration snippet: storage:…
Andreas Florath
  • 4,418
  • 22
  • 32
1
vote
1 answer

ceph pgs marked as inactive and undersized+peered

I installed a rook.io ceph storage cluster. Before installation, I cleaned up the previous installation like described here: https://rook.io/docs/rook/v1.7/ceph-teardown.html The new cluster was provisioned correctly, however ceph is not healthy…
roman
  • 892
  • 9
  • 26
1
vote
0 answers

ceph rbd import hangs

My ceph cluster is 48 ms ping away from the ceph client. Rbd import of an 8GB image on the client hangs at some point during the copy and never progresses. Ctl-C out of rbd import leaves the image locked in the cluster. When I scp the image to the…
B Abali
  • 433
  • 2
  • 10
1
vote
2 answers

Running Ceph Pacific in a Public Internet?

I am a little bit confused about the right setup of a ceph cluster running in the Internet. My goal is to access the ceph cluster from different Kubernetes Clusters. My ceph nodes have public Internet IPs and also a private network 10.0.0.0/16 The…
Ralph
  • 4,500
  • 9
  • 48
  • 87
1
vote
0 answers

What is a proper pattern to serve images from cluster

I have a problem with scaling an app, I want to serve static images from my server, but I can not find any useful information on how to do this. I use Kubernetes, Nginx and my services are running on express.js. I have 2 ideas but I would like to…
GooMee
  • 21
  • 1
  • 3
1
vote
0 answers

Ceph RBD real space usage is much larger than disk usage once mounted

I'm trying to understand how to find out the current and real disk usage of a ceph cluster and I noticed that the output of a rbd du is way different from the output of a df -h once that rbd is mounted as a disk. Example: Inside the ToolBox I have…
AndD
  • 2,281
  • 1
  • 8
  • 22
1
vote
0 answers

What could cause a 400 Bad Request from Ceph that wouldn't influence the GET URL?

I've been stuck on this same 400 error for almost a week; if anyone can help I will be thrilled. In the product I'm working with, there are two APIs. Call one API Joe and the other one Sean. So, Joe the API can already do the thing I'm trying to…
jaroldeen
  • 11
  • 2