Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
3
votes
1 answer

Invalid URI for NameNode address, s3a is not of schema 'hdfs'

I'm doing something about replacing HDFS with Ceph in hadoop environment (yarn), according to my research, the guideline from hortonworks and Replace HDFS form local disk to s3 getting error shows me that I need to modify core-site.xml under…
Eugene
  • 10,627
  • 5
  • 49
  • 67
3
votes
1 answer

What's the fastest way to use Ceph volumes in Docker Swarm?

I want to set up a Swarm with persistent and replicated volumes through Ceph. I see these options to combine both services, once both are set up: Configure the host OS to mount a CephFS in /var/lib/docker/volumes. Use rexray/rbd as a volume…
Yajo
  • 5,808
  • 2
  • 30
  • 34
3
votes
1 answer

unable to get monitor info from DNS SRV with service name: ceph-mon

I can not run ceph -s when I run ceph -s,the error display: root@ceph-mon-1:~# ceph -s unable to get monitor info from DNS SRV with service name: ceph-mon no monitors specified to connect to. 7ff69982e700 -1 failed for service…
yanzhiluo
  • 133
  • 1
  • 1
  • 5
3
votes
0 answers

Spring Boot app consuming Ceph Swift API via JOSS Swift Client

I am very new to Ceph and not yet very seasoned with Spring Boot Java application development either. I have set up a Ceph Object Storage cluster with Swift Object Gateway. Now I have a Spring Boot app and I need to get/post/delete objects from my…
3
votes
1 answer

Ceph delete client.admin accidently

While learning Ceph , I accidently delete client.admin by using ceph auth del client.admin Now I get client.admin authentication error (1) Operation not permitted.Error connecting to cluster: PermissionError all the time. Is there a way to…
Terry Wang
  • 31
  • 3
3
votes
1 answer

How to store Object in Ceph Object Store

I have deployed a Ceph cluster over 3 nodes and have created msd and rgw. I have 3 machines named ceph1, ceph2 and ceph3. ceph1 runs osd, mon, mds and rwg ceph2 runs osd ceph3 runs osd I have created a user with radosgw-admin user create…
Subhankar
  • 692
  • 7
  • 25
3
votes
1 answer

Ceph raw storage usage versus pool storage usage

I am new user of Ceph. My Ceph server is running version 12.2.5. It has 3 nodes and each node is having 1 OSD with 4TB HDD. The ceph.conf osd pool default size = 3 osd pool default min size = 2 I have upload 252GB data to Ceph. For my…
Kaden Sy
  • 31
  • 4
3
votes
1 answer

why is dd with direct flag much slower than dsync

I was trying to use dd to test the performance of my ceph filesystem. During testing, I found something confusing, that is, dd with oflag=dsync or conv=fdatasync/fsync is around 10 times faster than dd with oflag=direct. My network is…
ustcyue
  • 601
  • 1
  • 7
  • 15
3
votes
0 answers

How to run MySQL on Ceph?

I want to run MySQL on Ceph, and I did the follow step to achieve my goal. (Method one)Using Ceph RBD interface: Install MySQL and Ceph Deploy Ceph environment, create a Ceph pool and create Ceph RBD device based on Ceph pool Mount XFS on RBD…
李昊华
  • 31
  • 2
3
votes
2 answers

Distributed file systems supported by Python/Dask

Which distributed file systems are supported by Dask? Specifically, from which file systems one could read dask.dataframe's? From the Dask documentation I can see that HDFS is certainly supported. Are any other distributed file systems supported,…
S.V
  • 2,149
  • 2
  • 18
  • 41
3
votes
1 answer

Flink with Ceph as the persistent storage

Flink documents suggests that Ceph can be used as a persistent storage for states. https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/checkpointing.html Considering that Ceph is a transactional database, wouldn't it have adverse…
wittyameta
  • 375
  • 1
  • 3
  • 16
3
votes
2 answers

ceph rbd with docker volumes

I just initialized a ceph instances within two differents servers cluster 241b5d19-15f5-48be-b98c-285239d70038 health HEALTH_WARN 64 pgs degraded 64 pgs stuck degraded 64 pgs stuck unclean 64 pgs stuck undersized …
Kakawait
  • 3,929
  • 6
  • 33
  • 60
3
votes
2 answers

CephFS Volume Mount Fails

I've successfully deployed a Kubernetes cluster using the docker-multinode configuration as well as a Ceph cluster and am able to mount a CephFS device manually using the following: sudo mount -t ceph monitor1:6789:/ /ceph -o…
Kyle
  • 4,202
  • 1
  • 33
  • 41
3
votes
2 answers

ceph-deploy mon create failing with exception

I am installing a ceph-cluster with one monitor node and one osd. I am following the document: http://docs.ceph.com/docs/v0.86/start/quick-ceph-deploy/ During the step 5: Add the initial monitor(s) and gather the keys (new in ceph-deploy v1.1.3), I…
Prasad Pande
  • 488
  • 9
  • 24
3
votes
2 answers

Kubernetes + CoreOS + Ceph RBD

Anyone has success or pointer on using the kubernetes to create a pod that mounts ceph rbd within the docker container? The following example from kubernetes uses Fedora 21 with installation of ceph binaries, which won't work in…
DanC77
  • 51
  • 1
  • 2