Stack Overflow
Stack Overflow

Questions tagged [ibm-cloud-storage]

IBM offers object storage, block storage and other storage types as cloud service. Questions related to them should use this tag.

IBM Cloud storage offerings in the IBM Bluemix catalog include

  • Block Storage
  • Cloud Object Storage with Swift and Amazon S3 interface
  • Content Delivery Network
  • File Storage
115 questions
5
votes
0 answers

Unable to connect to Cloud object storage instance IBM Watson Studio

I am trying to connect to COS from IBM Watson studio but I get an error... When I hit enter I get the following error: Unable to find products data_catalog or data_science_experience in the entitlements response for account id:…
deltascience
  • 3,321
  • 5
  • 42
  • 71
4
votes
1 answer

IBM Cloud Object Storage Connection issue Watson studio Python notebook

I have been trying to get my Python notebook in Watson Studio to connect to and retrieve data from my cloud storage for hours and read many tutorials but no idea why it is not working, code below: credentials = { 'BUCKET': 'openai-data', …
Kitt Miller
  • 41
  • 2
4
votes
2 answers

How to get a direct URL to a file on IBM Cloud Object Storage

So, I have a bucket on IBM's Cloud Object Storage. In this bucket I have an file named 'test.png'. What I need is an URL i can use to access this file directly. An URL that I can just write on browser and the image will open on my browser. I've…
Bruno Lira
  • 177
  • 3
  • 13
3
votes
3 answers

ApacheSpark read from S3 Exception: Premature end of Content-Length delimited message body (expected: 2,250,236; received: 16,360)

I want to create an Apache Spark DataFrame from a S3 resource. I've tried on AWS and on IBM S3 Clout Object Store, both fail with org.apache.spark.util.TaskCompletionListenerException: Premature end of Content-Length delimited message body…
Romeo Kienzler
  • 3,373
  • 3
  • 36
  • 58
3
votes
1 answer

"The specified bucket does not exist" when trying to list objects in IBM Cloud Object Storage using Python

Following IBM documentation, I'm trying to list objects in my COS bucket using Python and ibm-cos-sdk. import ibm_boto3 from ibm_botocore.client import Config, ClientError cos = ibm_boto3.resource("s3", ibm_api_key_id=params['API_KEY'], …
mustaccio
  • 18,234
  • 16
  • 48
  • 57
3
votes
5 answers

No FileSystem for scheme: cos

I'm trying to connect to IBM Cloud Object Storage from IBM Data Science Experience: access_key = 'XXX' secret_key = 'XXX' bucket = 'mybucket' host = 'lon.ibmselect.objstor.com' service = 'mycos' sqlCxt = SQLContext(sc) hconf =…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
3
votes
1 answer

IBM Cloud Object Storage - what is the data consistency / visibility model?

What guarantee does IBM's Cloud Object Storage provide regarding data consistency / visibility? AWS's is basically read-after-write for new objects, and eventual consistency for updates/deletes. So, what is the data consistency model for IBM's…
Josh
  • 4,726
  • 2
  • 20
  • 32
2
votes
0 answers

Upload file from Django app to IBM Cloud Object Storage

I'm trying to connect a django app to IBM COS and having trouble. I'm capturing user video and want to save the file to IBM COS and the user info to Postgres also hosted on IBM. I'm able to connect from both the terminal and my app to IBM COS and…
jablok1
  • 21
  • 2
2
votes
1 answer

Cannot retrieve bucket name in IBM Cloud object storage using python

While retrieving the bucket name, it shows me this error. CLIENT ERROR: An error occurred (InvalidArgument) when calling the ListBuckets operation: Invalid Argument And another thing I want to know that COS_ENDPOINT is correct or not. Because it's…
Ritul Chavda
  • 173
  • 1
  • 9
2
votes
1 answer

IBM Cloud: creating S3-compatible creds for a bucket via API

TL;DR How can we automate the creation of per-user credentials to access COS buckets using the S3 compatibility layer? The only documented way AFAIK is the CLI; but embedding command-line executions inside a web service is not very appealing! The…
Samson Scharfrichter
  • 8,884
  • 1
  • 17
  • 36
2
votes
1 answer

create object with python ibm-cos-sdk get doesn't work

I need help... I can not access a bucket in my COS that I created with IBM Cloud dashboard from my notebook that I created in Watson Studio. Call this bucket3. Initially I created a bucket2 from a single f2.zip (csv) file using IBM Watson 'Add…
frankr6591
  • 1,211
  • 1
  • 8
  • 14
2
votes
1 answer

object storage image response type to base64 in angularjs

I'm trying to retrieve data from Object Storage. We have api to get those image files through which I got below formatted data.…
Vinod Kumar Marupu
  • 547
  • 6
  • 21
1
vote
0 answers

Cloud Object Storage Cannot be detected/identified/attached when creating a new project within IBM Cloud Pak for Data

I am working with a Lite plan of IBM Cloud. Although I have an active Cloud Object Storage (COS) instance, the Cloud Pak for Data cannot detect/identify/attached it when I tried to create a new project. I clicked "refresh", deleted the active COS…
xjfrog2001
  • 11
  • 1
1
vote
0 answers

Unable to copy HDFS data to S3 bucket

I have an issue related to a similar question asked before. I'm unable to copy data from HDFS to an S3 bucket in IBM Cloud. I use command: hadoop distcp hdfs://namenode:9000/user/root/data/ s3a://hdfs-backup/ I've added extra properties in…
dddroog
  • 33
  • 7
1
vote
0 answers

I am using IBM Cloud Object Storage and want to read a pdf file from the storage and want to store its text content in form of string

I have used ibm_boto3 as mentioned in the IBM COS documentations. I have defined the resources as following: cos = ibm_boto3.resource("s3", ibm_api_key_id=COS_API_KEY_ID, ibm_service_instance_id=SERVICE_INSTANCE_ID, …
Gauram Majmudar
  • 11
  • 2
1
2 3 4 5 6 7 8