Stack Overflow
Stack Overflow

Questions tagged [bucket]

a bucket is one of several alternative data sinks when data needs to be distributed. The term is used for algorithms, data-structures. Commercial usages include databases and cloud providers.

993 questions
6
votes
4 answers

List files on S3

I'm getting frustrated by not finding any good explanation on how to list all files in a S3 bucket. I have this bucket with about 20 images on. All I want to do is to list them. Someone says "just use the S3.list-method". But without any special…
malmling
  • 2,398
  • 4
  • 19
  • 33
6
votes
2 answers

Amazon S3 Bucket Policy Referer

I'm trying to edit my S3 bucket configuration such that 3rd party sites can not link to content in it. Also an added benefit is that they can only access content from my domain rather than the supplementary s3bucket.amazon-east.amazonaws.com or…
npho
  • 111
  • 2
  • 5
6
votes
3 answers

Hashcode bucket distribution in java

Suppose I need to store 1000 objects in Hashset, is it better that I have 1000 buckets containing each object( by generating unique value for hashcode for each object) or have 10 buckets roughly containing 100 objects? 1 advantage of having unique…
Jyotirup
  • 2,882
  • 9
  • 30
  • 38
6
votes
4 answers

Multiple Couchbase bucket configuration in .NET

I have 2 buckets in Couchbase one is Couchbase type and the other is Memcachced type: when I run my test I get an error: The element servers may only appear once in this section. Below is my config:
user1096099
  • 61
  • 3
5
votes
0 answers

How to serve static files from GCP Bucket and redirect from any not found path to index.html with status 200 instead 404

I'm working with GCP serving a single page application static files. for all effects, not found paths, should redirect to index.html and the main script route will display the correct page. our set is: GCP Bucket -> Load Balancer -> DNS On the GCP…
Daniel Santos
  • 14,328
  • 21
  • 91
  • 174
5
votes
3 answers

Is it possible to share a Amazon S3 bucket between Amazon S3 users?

Is it possible to share a bucket between some S3 users ? I've a S3 account for the user "me@myself.com" who can manage the bucket "my_bucket". Can I share this bucket with the S3 users "you@yourself.com" and "youtoo@yourself.com" ? i.e. They log in…
fro_oo
  • 1,610
  • 4
  • 24
  • 46
5
votes
2 answers

New To Cloud Storage -- Something Went Wrong

I just created a Google Cloud account and am attempting to load some data from my locale machine to a Storage Bucket for later use in an ML project. I'm following the quite simple instructions in the tutorial supplied to get a bucket up and running…
GMR45
  • 51
  • 2
5
votes
2 answers

GCP Storage Bucket Access Logs

If you set a storage bucket as a static website, is there any way to trace who has accessed it? e.g. IP addresses, time viewed etc... I have looked in the stackdriver logs but it only shows events e.g. bucket created, files uploaded etc...
ShrewdStyle
  • 500
  • 2
  • 5
  • 14
5
votes
3 answers

How to create a empty folder in google storage(bucket) using gsutil command?

How we can create the folder using gsutil command. I am using Bashoperator in airflow where I need to use the gsutil Bash command, Bucket is already created I want to create a folder inside bucket. I already tried with below command but It's not…
Bhagesh Arora
  • 547
  • 2
  • 12
  • 30
5
votes
2 answers

In Apache Spark's `bucketBy`, how do you generate 1 file per bucket instead of 1 file per bucket per partition?

I am trying to use Spark's bucketBy feature on a pretty large dataset. dataframe.write() .format("parquet") .bucketBy(500, bucketColumn1, bucketColumn2) .mode(SaveMode.Overwrite) .option("path", "s3://my-bucket") …
cozos
  • 787
  • 10
  • 19
5
votes
2 answers

Why does hashcode() returns an integer and not long?

In java, hashcode() method, returns integer instead of long. Is there any specific reason?
dgupta3091
  • 1,067
  • 1
  • 7
  • 18
5
votes
3 answers

write persisted keras model to s3

I ran an lstm model in keras and persisted it to a json object. I want to write this json object directly to an s3 bucket. Boto3 tutorials really don't cover this, they only show how to write files to s3. I really need to be able to store keras…
JanBennk
  • 277
  • 7
  • 16
5
votes
0 answers

Tensorflow: How to bucket my examples using the new Data API

I'm trying to group my training examples by their length: https://www.tensorflow.org/versions/r0.12/api_docs/python/contrib.training/bucketing But I want to use the new Data API. So I'm wondering is there a way to do it. Here is my code: import…
Ilia Vatahov
  • 141
  • 3
5
votes
1 answer

Configuring AWS Lambda to access S3 Bucket

I just can't figure out what is wrong with my Bucket Policy in AWS. Trying to let a Lambda function to access and read an email from the S3 Bucket. But I keep getting "Access Denied" Please note that I notice the email file is being created in the…
aviv
  • 2,719
  • 7
  • 35
  • 48
5
votes
1 answer

Advantage of Generic Cell Rate Algorithm over Leaky Bucket Algorithm

I am looking for a algorithm for rate limiting incoming requests to a REST HTTP Server. I have gone through the "Leaky Bucket" & "Generic Cell Rate Algorithm : Virtual Schedulling" As per my understanding Leaky Bucket has the following…
tuk
  • 5,941
  • 14
  • 79
  • 162
1 2 3
…
66 67