Stack Overflow
Stack Overflow

Questions tagged [cephfs]

65 questions
0
votes
2 answers

Erasure Coded Pool suggested PG count

I'm messing around with pg calculator to figure out the best pg count for my cluster. I have an erasure coded FS pool which will most likely use half space of the cluster in the forseeable future. But the pg calculator only has options for…
Nyquillus
  • 179
  • 1
  • 5
  • 23
0
votes
1 answer

Minikube Service Not Showing up

Hello I'm currently setting up a rook-cephfs test environment using minikube running on Windows 10. So far I've ran crds.yaml, common.yaml, operator.yaml and cluster-test.yaml. I following the guide at…
Xcer
  • 87
  • 2
  • 7
0
votes
1 answer

Why Ceph calculate PG ID by object hash rather than CRUSH algorithm?

Ceph using CRUSH algorithm for PG->OSD mapping and it works fine for increasing/decreasing of OSD nodes. But for obj->PG mapping, Ceph still uses the traditional hash, which is pgid = hash(obj_name) % pg_num. This approach may lead to massive data…
Wizmann
  • 839
  • 1
  • 9
  • 14
0
votes
1 answer

Is this calculation correct ? (rook replication)

If 1 OSD crashes, does rook-ceph eventually tries to replicate missing data to the still workings OSDs or does it wait for all OSD to be healthy again ? Let's say yes so that I can explain how I calculated : I started with 1,71 TB provisionned for…
GuiFP
  • 71
  • 7
0
votes
1 answer

CephFs and CephRBD being to slow to git clone

I've deployed ceph cluster within kubernetes cluster and tried to git clone a repository inside of a pod using a volume mount of CephFs and CephRbd typ. Although it takes a huge amount of time to write all the files to the volume. The git repository…
Bruno
  • 131
  • 3
  • 17
0
votes
0 answers

ceph - resilience to network changes - recover disk after IP address allocation change

ceph does not seem to be very resilient to network moves and changes. Perhaps because the IP address is stored as an identification of the systems that make up the ceph cluster. The problem: recently our cluster was physically moved with very little…
Pete
  • 143
  • 8
0
votes
1 answer

CEPH Octupus: ceph command hangs. No data for prometheus also

I'm facing an issue with ceph. I cannot run any ceph command. It literally hangs. I need to hit CTRL-C to get this: ^CCluster connection interrupted or timed out This is on Ubuntu 16.04. Also, I use Graphana with Prometheus to get information…
Emanuel Castelli
  • 53
  • 1
  • 1
  • 6
0
votes
1 answer

Ceph MDS stays in "up:replay" for hours. MDS failover takes 10-15 hours

We have 9 nodes Ceph cluster. Ceph version is 15.2.5. The cluster has 175 OSD (HDD) + 3 NVMe for cache tier for "cephfs_data" pool. CephFS pools info: POOL ID STORED OBJECTS USED %USED MAX AVAIL cephfs_data 1…
IHeilig
  • 9
  • 3
0
votes
1 answer

ceph raw used is more than sum of used in all pools (ceph df detail)

First of all sorry for my poor English In my ceph cluster, when i run the ceph df detail command it shows me like as following result RAW STORAGE: CLASS SIZE AVAIL USED RAW USED %RAW USED hdd 62 TiB …
Morteza Bashsiz
  • 1
  • 2
0
votes
1 answer

CephFS pool can't use all the available raw space (MAX_AVAIL < AVAIL)

I have a Ceph cluster intended to run as CephFS on hard drive enclosures that provide 9PiB raw space total over a number of servers. I created a 3+3 erasure coding pool that is supposed to span the whole raw space of my hard drives. Surprisingly, it…
Boris Burkov
  • 13,420
  • 17
  • 74
  • 109
0
votes
1 answer

About the ceph kernel client's relationship with physical memory?

The CEPHFS cluster is deployed in vmware virtual machines,The virtual machine memory configuration is 4G Test with FIO The order is as follows: fio -name=task1 -filename=/mnt/testcephfs/fio-test-1 -rw=randwrite -ioengine=sync -size=1G -bs=4M…
fuzhiyu
  • 3
  • 3
0
votes
1 answer

Installing ceph using kolla-ansible for all-in-one setup

I am trying to deploy the all-in-one configuration using kolla-ansible with ceph enabled enable_ceph: "yes" #enable_ceph_mds: "no" enable_ceph_rgw: "yes" #enable_ceph_nfs: "no" enable_ceph_dashboard: "{{ enable_ceph | bool }}" #enable_chrony:…
Skyprenet
  • 60
  • 5
0
votes
1 answer

Copying Data from AWS bucket to Ceph Bucket

I have a ceph object bucket and an AWS bucket. I want to copy data from the AWS bucket to the ceph bucket without copying data to any intermediate system local system. Is there a way to do that, since there will be requirement of separate endpoint,…
lifeisshubh
  • 513
  • 1
  • 5
  • 27
0
votes
2 answers

What is the best size for cache tier in Ceph?

I have a Ceph Cluster with 500 TB of capacity. I want to create cache tier for it. I have a 20TB SSD. Is that sufficient for use 20 TB for cache 500TB? what is the best way to calculate it?
yasin lachini
  • 5,188
  • 6
  • 33
  • 56
0
votes
1 answer

health: HEALTH_ERR - how to fix it without losing data?

got ceph status: # ceph status cluster: id: b683c5f1-fd15-4805-83c0-add6fbb7faae health: HEALTH_ERR 1 backfillfull osd(s) 8 pool(s) backfillfull 50873/1090116 objects misplaced (4.667%) …
Dikobraz
  • 649
  • 2
  • 8
  • 22
1 2 3
4
5