Stack Overflow
Stack Overflow

Questions tagged [bucket]

a bucket is one of several alternative data sinks when data needs to be distributed. The term is used for algorithms, data-structures. Commercial usages include databases and cloud providers.

993 questions
8
votes
4 answers

Changing ACLs of objects in an S3 bucket using Boto3

Trying to figure out a way to set ACLs on objects in an S3 bucket using Boto3. Input should be the S3 bucket name and change the ACLs for all the objects to read only by public
Ramu
  • 111
  • 1
  • 2
  • 7
8
votes
4 answers

Can I cluster by/bucket a table created via "CREATE TABLE AS SELECT....." in Hive?

I am trying to create a table in Hive CREATE TABLE BUCKET_TABLE AS SELECT a.* FROM TABLE1 a LEFT JOIN TABLE2 b ON (a.key=b.key) WHERE b.key IS NUll CLUSTERED BY (key) INTO 1000 BUCKETS; This syntax is failing - but I am not sure if it is even…
Andrew
  • 6,295
  • 11
  • 56
  • 95
7
votes
2 answers

gsutil command to delete old files from last day

I have a bucket in google cloud storage. I have a tmp folder in bucket. Thousands of files are being created each day in this directory. I want to delete files that are older than 1 day every night. I could not find an argument on gsutil for this…
spala
  • 85
  • 1
  • 2
  • 7
7
votes
2 answers

sub-bucket in AWS S3

I'm starting with AWS S3, I already created a bucket, but I do not know how to manage it. For example, bucket named: testing, then I'd like to create a sub-bucket named: company1, company2. In each of sub-bucket, I'm gonna put my document on it,…
Tran Tam
  • 699
  • 3
  • 14
  • 27
7
votes
2 answers

Different behavior for "aws s3 ls" and "aws s3api list-objects"

I am seeing different behavior for aws s3 ls and aws s3api list-buckets Here is the 1st one: $ aws s3 ls s3://demo.for.customers Bucket: demo.for.customers Prefix: LastWriteTime Length Name ------------- ------ ---- …
slayedbylucifer
  • 22,878
  • 16
  • 94
  • 123
6
votes
3 answers

Writing bucket sort in c++

A book I have says this: a) Place each value of the one-dimensional array into a row of the bucket array based on the value's ones digit. For example, 97 is placed in row 7, 3 is placed in row 3, and 100 is placed in row 0. This is called a…
Jonathan Dewein
  • 984
  • 3
  • 16
  • 34
6
votes
1 answer

Unable to write files in a GCP bucket using gcsfuse

I have mounted a storage bucket on a VM using the command: gcsfuse my-bucket /path/to/mount After this I'm able to read files from the bucket in Python using Pandas, but I'm not able to write files nor create new folders. I have tried with Python…
Luis Ramon Ramirez Rodriguez
  • 9,591
  • 27
  • 102
  • 181
6
votes
1 answer

Amazon AWS S3 Glacier: is there a file hierarchy

Does Amazon AWS S3 Glacier support some semblance of file hierarchy inside a Vault for Archives? For example, in AWS S3, objects are given hierarchy via /. For example: all_logs/some_sub_category/log.txt I am storing multiple .tar.gz files, and…
Intrastellar Explorer
  • 3,005
  • 9
  • 52
  • 119
6
votes
2 answers

FirebaseError: Bucket name not specified or invalid

I'm following a tutorial online for building a Social media app using Firebase on React. What I'm finding very puzzling is I can access the storage bucket when I create a new user, setting the default sign-up image from one I've uploaded in the…
yahms23
  • 326
  • 2
  • 11
6
votes
3 answers

riak backup solution for a single bucket

What are your recommendations for solutions that allow backing up [either by streaming or snapshot] a single riak bucket to a file?
user650842
  • 81
  • 5
6
votes
1 answer

gcsfuse to mount a bucket in GKE and/or python3 boto to stream write?

I am looking for a way to "write stream" some .mp4 video files -- as they are being generated by some python app -- to a google cloud storage bucket. The python app is containerised and deployed in GKE and currently executes fine as a web service.…
Aida
  • 2,174
  • 2
  • 16
  • 33
6
votes
4 answers

how can i hash strings into a specific number of buckets

I'm trying to come up with an algorithm to hash a string into a specific number of buckets but haven't had any luck coming up with ideas on how to do this? I have a list of strings like this: a.jpg b.htm c.gif d.jpg e.swf and i would like to run a…
user226722
6
votes
2 answers

We're getting an error when users are trying to sign up and create new accounts/ albums using AWS. See terminal message below

[AWS s3 undefined 0.006s 0 retries] headObject({ Bucket: 'mypicturebank', Key: 'testing' }) There was an error creating your album: TypeError [ERR_INVALID_ARG_TYPE]: The "key" argument must be one of type string, TypedArray, or DataView. Received…
Ken G
  • 61
  • 2
6
votes
3 answers

Can two keys having different hashCode be a part of same bucket in HashMap in Java?

I have a HashMap. There are 16 buckets in it (by default). Now is it possible that two keys having different hashCodes be part of the same bucket? Or is it always a new bucket is created for a different hashCode and in this way the HashMap expands…
vijayinani
  • 2,548
  • 2
  • 26
  • 48
6
votes
2 answers

How can I check that a AWS S3 bucket exists?

Simple question here? ... How can I check with boto that a AWS bucket exists? ... preferably by providing the path? ... here is the approach I feel like taking: def bucket_exists(self, bucket_name): connection =…
David
  • 1,469
  • 5
  • 33
  • 51
1 2 3
…
66 67