Questions tagged [cephfs]

65 questions
1
vote
0 answers

ceph 15.2.4 -- authentication changes -- unable to reattach with kubernetes

Yesterday my teammates found a way to disable cephx authentication cluster wide (2 server cluster) in order to bypass issues that were preventing us from joining a 3rd server. Unfortunately they were uncertain which of the steps taken let to the…
new-ground
  • 11
  • 1
1
vote
1 answer

Single-node ceph cluster unresponsive from client

I have attempted to set up a small one-node ceph cluster for some proof-of-concept work with ceph fs. The cluster is running centos 7 OS with : # ceph --version ceph version 13.2.10 (564bdc4ae87418a232fc901524470e1a0f76d641) mimic (stable) The…
GSP
  • 93
  • 2
  • 7
1
vote
0 answers

"Read-only file system" error on cephfs, how to handle this?

After full recovery as described here https://docs.ceph.com/docs/master/cephfs/disaster-recovery-experts/#disaster-recovery-experts there are still problems in filesystem. "loaded dup inode" error log messages lead me to /lost+found folder loaded…
jkrzyz
  • 11
  • 1
1
vote
1 answer

kubernetes nodes keep rebooting when using rook volumes

Several days ago I faced a problem when my nodes were rebooting constantly My stack: 1 master, 2 workers k8s-cluster built with kubeadm (v1.17.1-00) Ubuntu 18.04 x86_64 4.15.0-74-generic Flannel cni plugin (v0.11.0) Rook (v1.2) cephfs for storage.…
1
vote
0 answers

CephFS failing to mount on Kubernetes

I set up a Ceph cluster and mounted manually using the sudo mount -t command following the official documentation, and I checked the status of my Ceph cluster - no problems there. Now I am trying to mount my CephFS on Kubernetes but my pod is stuck…
JYCH
  • 61
  • 7
1
vote
0 answers

pg_num autoscaling on Ceph

I am new to Ceph, and have only used it in my homelab with 3 nodes of 2 osd's each. After reading about Nautilus and pg_num autoscaling I enabled this, but this was probably a mistake. now my cluster have this status. Someone have tip on how to get…
raymondbh
  • 11
  • 2
1
vote
0 answers

Kubernetes, Rook, and Ceph: CephFS not working

My problem In Kuberentes, I built a Ceph cluster with Rook, and Ceph is reporting healthy state (ceph -s). But when I write file (cp -r) with CephFS, the file's content in CephFS is null, while if I use mv | cp -a it is normal. My…
UniQ
  • 21
  • 1
  • 1
  • 3
1
vote
1 answer

Cephfs: Dynamic provisioning are not working

It's working when I use volumes of cephfs . path is /test and user is test apiVersion: v1 kind: Pod metadata: name: cephfs spec: containers: - name: cephfs image: kubernetes/pause volumeMounts: - mountPath: "/mnt/cephfs" …
faithfull
  • 151
  • 1
  • 4
1
vote
0 answers

Ceph Nautilus with step by step instruction to access existing CephFS cluster from Kubernetes pod

The most recent Ceph "Nautilus" release claims Kubernetes support in CephFS (not via RDB). It is not clear how to configure Kubernetes (without Rook) to get access to my CephFS cluster just like I can access NFS storage. What I did: 1.Installed the…
1
vote
0 answers

How to deploy Docker services to swarm using cephFS?

I have configured Ceph in a Docker Swarm with 5 nodes using the daemon/ceph Docker image. The status of the same is given below. root@master1 mnt]# ceph -s cluster: id: eec52783-a0b5-4195-82b7-b66ea5514650 health:…
Sarath Kumar
  • 145
  • 8
1
vote
1 answer

Is there any way to run the Ceph filesystem on Windows?

Is there any dependency of Ceph on Linux file system. If not then is there any way to compile and run the filesystem on Windows. I am not looking to just run Ceph on Windows using any container.
0
votes
0 answers

k8s with external ceph storage; mount error, ceph-csi

k8s master: 172.17.1.1 worker: 172.17.2.1, 2, 3, 4 pool: 192.168.0.0 ~ ceph master: 172.17.3.1 node: 172.17.3.11, 12, 13 k8s is installed "A" server, ceph is installed "B" server. install ceph-csi helm-chart helm install --namespace ceph-fs…
ImuruKevol
  • 11
  • 2
0
votes
1 answer

Ceph: access CephFS files via S3

We have cluster with CephFS configured. It is Bluestore-based and uses SSD-based OSDs for metadata pool for performance reasons. We want to add access to files on this FS via S3. Is it possible to use Ceph Object Gateway for this, or it will not be…
0
votes
0 answers

Dynamic Provisioning of CephFS with Kubernetes

We are using the latest versions of CephFS (v17.2.5) & Kubernetes (v1.24.2). With the above versions of both, we are able to MANUALLY provision CephFS storage to be used with Kubernetes. However, we get the following error when we try to DYNAMICALLY…
0
votes
1 answer

In a Ceph FS setup, how do I order the backup MDS?

I have a CephFS Octopus system running with two active meta data servers (MDS) and seven in standby for any failures. The two active MDS run on more up-to-date machines with more RAM and CPU power, while the backup MDS are on older systems. Of the…
emil
  • 194
  • 1
  • 11