Swift is a massively scalable redundant storage system providing an object storage similar to Amazon's S3. Project was started in August 2009 and is part of OpenStack.
Related tag: openstack, see also http://OpenStack.org.
Questions tagged [openstack-swift]
339 questions
1
vote
2 answers
Java library to talk to swift (OpenStack) with keystone authentication
Is there a java library that supports swift (OpenStack) with keystone authentication?
It seems to be work in progress in JClouds but not finished yet, and cloudfiles does not seem to support it (yet) either.
Carsten
- 4,204
- 4
- 32
- 49
1
vote
2 answers
How does Swift-Open Stack Storage System manage file metadata?
I am working on writing a paper on the cloud storage.
I am looking into Openstack storage system called Swift.
On the page: http://swift.openstack.org/overview_architecture.html
Object Server
The Object Server is a very simple blob storage server…
leon
- 10,085
- 19
- 60
- 77
1
vote
0 answers
Hadoop/Swift/Minio... Choosing Large Object Storage solution
I'm laying out a triple-store centric architecture which is, as you may now, one of the last places in the world you would place large binaries (32mo pictures to ~50-150Go point-clouds and simulation models).
Hadoop performance is well known and…
BathtubBear
- 63
- 5
1
vote
1 answer
Is there a practical limit to the number of files in a Swift container?
A solution I work on stores files in OpenStack's Swift but the files are spread out into multiple containers. I have been told this is because the performance is awful after about a million files in a container. The only reference I could find is…
Marcel Gosselin
- 4,610
- 2
- 31
- 54
1
vote
0 answers
openstack-swift with OVH returns 401 Unauthorized
I'm using a swift bucket on OVH
The CLI tool swift -A $OS_AUTH_URL -U $OS_USERNAME -K $OS_PASSWORD list -l foto-condivise works smoothly.
My config is:
s3proxy:
image: andrewgaul/s3proxy
ports:
- 127.0.0.1:8084:80
environment:
…
lrkwz
- 6,105
- 3
- 36
- 59
1
vote
0 answers
PySpark cannot parse metadata from openstack
I'm trying to read a json file stored on my OVH object storage (openstack).
I set everything up :
import pyspark
from pyspark.sql.session import SparkSession
spark = SparkSession.builder.appName("test").getOrCreate()
also the hadoop conf…
Jean-Luc Bonnaux
- 11
- 1
1
vote
2 answers
Disable ability to list objects in OVH OpenStack Object Storage
I created an OVH Public Cloud Object Storage Public Container and I can't disable the ability for everyone to list objects in this container. OVH uses OpenStack Object Storage.
It is really annoying, because I want to expose publicly each object…
ybert
- 852
- 10
- 18
1
vote
0 answers
What is the best way to zip a file in Swift storage without physically downloading it?
We're using openstack swift what is the best way to zip a file which already is uploaded to swift container.
We need to this because we don't want to ideally download this file as it will be quite large in GBs.
Vishal
- 12,133
- 17
- 82
- 128
1
vote
1 answer
How to configure rsync with password in OpenStack Swift
I am currently working on Swfit. For safe, the op ask me to set password for rsync.
While, as we use Swift, we just set rsync work as server with "/etc/rsync.conf" , then Swift works as the client without password.
So, my question is, if i start…
kip
- 11
- 2
1
vote
1 answer
Can I use username in ACL of openstack swift
From doc, the ACL should look like :.
But does : also work?
BAE
- 8,550
- 22
- 88
- 171
1
vote
0 answers
StoredObjectListElement in Javaswift/JOSS does not match openstack swift API?
I am reading JOSS here. I got the following Class definition from https://github.com/javaswift/joss/blob/master/src/main/java/org/javaswift/joss/command/shared/container/StoredObjectListElement.java.
public class StoredObjectListElement {
…
BAE
- 8,550
- 22
- 88
- 171
1
vote
0 answers
How to connetct (accessing) to IBM cloud object store swift from R?
How to connect to IBM cloud object swift with R?
I've had that informations:
auth_url = "https://dal05.objectstorage.softlayer.net/auth/v1.0",
username = "my_user_name",
password = "my_pass",
container = "my_container",
filename…
Kirill Panin
- 49
- 5
1
vote
0 answers
Complexity to get object from openstack swift
What is the complexity of Container container = account.getContainer("my-new-container"); from http://docs.ceph.com/docs/master/radosgw/swift/java/
and the complexity of GET /v1/{account}/{container}/{object} from…
BAE
- 8,550
- 22
- 88
- 171
1
vote
2 answers
rsync "connection refused" error
I'm getting crazy with rsync which gives me a "connection refused" error. Here's my problem:
I have two servers, used to store datas, with rsync installed on because I need that both servers stay synchronized. In this way, modifies on one server…
Apokalos
- 124
- 1
- 2
- 13
1
vote
1 answer
OpenStack Swift Multi Part Upload jclouds
I'm using jclouds Java SDK to interact with the OpenStack resources, I want to upload as multipart yet I didn't find in the SDK how to do that, in the examples I only saw a way to upload multipart but just for the blobs, which is not what I'm using,…
ibr
- 319
- 1
- 5
- 19