Stack Overflow
Stack Overflow

Questions tagged [radosgw]

radosgw is an HTTP REST gateway for the RADOS object store, a part of the Ceph distributed storage system. It is implemented as a FastCGI module using libfcgi, and can be used in conjunction with any FastCGI capable web server.

radosgw is an HTTP REST gateway for the RADOS object store, a part of the Ceph distributed storage system. It is implemented as a FastCGI module using libfcgi, and can be used in conjunction with any FastCGI capable web server.

45 questions
1
vote
1 answer

Boto3 put object results in botocore.exceptions.ReadTimeoutError

I have setup two ceph clusters with a rados gateway on a node for each of them. What I'm trying to achieve is to transfer all objects from a bucket "A" with an endpoint in my cluster "1" to a bucket "B" which can be reached from another endpoint on…
user3561383
  • 77
  • 1
  • 13
1
vote
1 answer

How to access files on Ceph directly as URL

I need a storage system with the following requirements: 1. It should support data/service clustering 2. It should be open-source so that I can extend functionalities later if needed 3. It should support file system because I want to access some…
user2327226
  • 29
  • 2
1
vote
2 answers

Can't find Ceph when install on CentOS

I can't install Ceph on my centos 7 system. The error message is like: node.example.com][DEBUG ] This system is not registered with an entitlement server. You can use subscription-manager to register. [node.example.com][DEBUG ] Determining fastest…
Kisen.Chin
  • 229
  • 2
  • 4
  • 9
1
vote
0 answers

Change host from Amazon for S3 and set it to work with Ceph radosgw

Is that possible, to change system from Amazon S3 to work with the other S3 provider, like cap radosgw? I'm using league/fly system-aws-s3-v3 and aws/aws-SDK-PHP packages for Laravel, but they want me to type the region, which I don't have on Ceph…
version_control
  • 107
  • 9
1
vote
1 answer

Openstack swift with ceph backend (radosgw)

I am trying to use Openstack (liberty) swift with Ceph (Jewel) using radosgw. The aim is that the objects should be stored under ceph osds. I have a working Openstack and Ceph cluster. To use Ceph as object storage backend I installed and configured…
Sbal
  • 343
  • 7
  • 20
1
vote
1 answer

ceph s3 radosgw 403

I have ceph and radosgw installed, which are working pretty well with s3cmd. I decided to setup docker registry version 2 and use s3 as storage. I'm starting it like: docker run --name registry -d -p 5000:5000 \ -e "REGISTRY_STORAGE=s3" \ -e…
Rafael
  • 11
  • 3
1
vote
0 answers

radosgw swift interface put object response 500 error?

I startup a radosgw (Civetweb embedded), i want use swift interface to put/get oject; my radosgw's ceph config： [global] fsid = 584ba99d-0665-4465-b693-6c78ae25576f mon_initial_members = n6-0**-0**, n6-0**-0**, n6-0**-0** mon_host = 10.6.**.**,…
colin
  • 11
  • 2
0
votes
0 answers

Is it possible for anonymous user to get object metadata (etag) without "full request"?

I am setting object with public-read-write ACL with following code: o = s3.Object(bucket, key) o.Acl().put(ACL='public-read-write') I can now access object on https://hostname/tenant:bucket/key publicly. I can get ETAG with anonymous user if I do…
rkj
  • 784
  • 1
  • 8
  • 19
0
votes
1 answer

Ceph: access CephFS files via S3

We have cluster with CephFS configured. It is Bluestore-based and uses SSD-based OSDs for metadata pool for performance reasons. We want to add access to files on this FS via S3. Is it possible to use Ceph Object Gateway for this, or it will not be…
Anton Chivkunov
  • 1
  • 1
0
votes
0 answers

rgw crashed on latest ceph version 17.2.6 quincy

On latest ceph version 17.2.6 quincy (stable) I got persistent error with crash radosgw process on all runned rgw. I have two rgw but it crashed simultaneously with a minimum load on the servers, while the radosgw process constantly consumes ~100%.…
Aleksey
  • 1
0
votes
0 answers

Ceph delete huge file

I have running cluster in octopus 15.2.12 . when I delete a file with with 2TB size, this file deleted from bucket list, but bucket size of cluster doesn't changed. I checked my wast usage and saw this size added to waste usage. I checked gc pool…
Meysam Rahimi
  • 164
  • 6
0
votes
1 answer

ceph df (octopus) shows USED is 7 times higher than STORED in erasure coded pool

The pool default.rgw.buckets.data has 501 GiB stored, but USED shows 3.5 TiB. root@ceph-01:~# ceph df --- RAW STORAGE --- CLASS SIZE AVAIL USED RAW USED %RAW USED hdd 196 TiB 193 TiB 3.5 TiB 3.6 TiB 1.85 TOTAL 196 TiB 193…
Arkadiy Bolotov
  • 314
  • 2
  • 8
0
votes
1 answer

Migrate ceph buckets to new user with zero downtime

I have a ceph/radosgw bucket with several million objects in it, and I need to change the ownership of the bucket to another user. Normally, this is done by linking the bucket to the new user, then chowning all of the files in it, like…
Mac Chaffee
  • 110
  • 2
  • 8
0
votes
0 answers

Migrate radosgw data to a new pool

I have a large (2.2PB, ~6 Billion files) EC pool used by radosgw. It is still under very heavy use by users for reading and writing. However, I want to start using a new ceph pool and migrate all the data in this ceph pool to the new…
user2074364
  • 31
  • 3
0
votes
1 answer

Read only users - list all the buckets I have read rights to

We are using ceph and have several buckets. We are using one read-only user to make backups of these buckets. If I know the list, I can backup all my bucket. I don't understand why, but I can't list all buckets. Is it at all possible in ceph…
Pierre Ozoux
  • 780
  • 7
  • 25
1
2
3