Questions tagged [s3-bucket]
56 questions
0
votes
0 answers
How to append data of all Parquet files from a folder of s3 bucket into a single dataframe in python
In my folder there are around 10 parquet files with same column names.
I want to append all 10 parquet files data into one dataframe.
I used below code but dataframe is having only first files data.
s3 =…
Jennie
- 225
- 2
- 13
0
votes
1 answer
How to upload video on S3 bucket using signed URL created by Python Boto v2.38.0?
we have one functionality where we need to create an s3 bucket signed URL for the client. the client will upload a video on that URL.
we are using Boto version 2.38.0 for generating signed URL.
conn = boto.connect_s3()
key = "test_key"
bucket =…
Nikunj
- 33
- 9
0
votes
1 answer
Get file from AWS-S3
I have files(PDF and Image) in S3 bucket, and I am trying to download using
bucket.getObject(params, function(err, data)
I am getting the data in Uint8Array, How can I get it as a file??
in AWS properties of that file:
Content-Disposition :…
Anurag Beeram Naga
- 15
- 4
0
votes
2 answers
AWS S3 Bucket Access Denied
Here is the bucket policy that I implemented in my bucket.
{
"Id": "Policy1535460101139",
"Version": "2012-10-17",
"Statement": [
{
"Sid": "Stmt1535460099601",
"Action": "s3:*",
"Effect": "Deny",
…
vishal
- 1,646
- 5
- 28
- 56
0
votes
1 answer
S3 Bucket associated with an email
Can a s3 Bucket be associated to an email Id .
For example, I wanted to automatically send a report to s3 , like an automate email from Oracle Business Intelligence Enterprise Edition and the email goes and sits in the s3 bucket. Is it possible ?…
srinivas muralidharan
- 39
- 2
- 10
0
votes
1 answer
Integration test for transfer manager download directory from S3Bucket
I have successfully downloaded the directory from S3 Bucket using transfer manager builder. The code is given below.
TransferManager transferManager =
TransferManagerBuilder.standard().withS3Client(client).build();
MultipleFileDownload download =…
Deve1
- 63
- 1
- 6
0
votes
1 answer
AWS- AWS command to view lambda function in Command Line
My Lambda function code can't be viewed in the AWS Console due to an error with the file being too large. Is there an AWS command to pull the Lambda function code and view it in the command line?
Or, can I push my lambda code onto an S3 bucket, then…
R.S Mohan Aravind
- 381
- 1
- 4
- 12
0
votes
1 answer
How to load objects from S3 bucket into Spark in RStudio?
The Object in the S3 bucket is 5.3 GB size. In order to convert object into data, I used get_object("link to bucket path"). But this leads to memory issues.
So, I installed Spark 2.3.0 in RStudio and trying to load this object directly into Spark…
Abhishek
- 471
- 5
- 17
0
votes
1 answer
Copy amazon s3 bucket folder to local
I have this link:
s3://some_path/200_files/*.gz
I have the corresponding ACCESS ID and SECRET KEY. How to copy the complete folder (200_files) OR all the .gz to the local system? Ubuntu CLI or Python based solution. I understand that this is not a…
Rakmo
- 1,926
- 3
- 19
- 37
0
votes
1 answer
java.io.FileNotFoundException while accessing from S3 bucket?
I am doing a small POC in AWS. I trying to read a csv file from S3 bucket and displaying in the CloudWatch log files . Everything is going fine but while accessing the file getting java.io.FileNotFoundException
Coding
public class…
Binay Kumar
- 279
- 6
- 23
0
votes
0 answers
Difficulties removing files from an S3 bucket. How can I use logs?
Having not yet figured out how to solve the issue mentioned in StackOverflow: Cannot remove audio data on AWS-S3 in a Parse-Server app.
I started to tackle the problem by setting access logs on the server, following Amazon S3 Server Access Logging,…
Michel
- 10,303
- 17
- 82
- 179
0
votes
0 answers
S3 user can upload and delete files from a bucket but fails to download them
I created an AWS IAM user and used the S3 Bucket policy to grant this user all privileges for a specific bucket and its related objects as shown below (where Xs are used there should be some specific identifiers). This user can programmatically(AWS…
geobudex
- 536
- 1
- 8
- 24
0
votes
1 answer
Permanent URLs of images from S3 without showing the path of image in S3 bucket
I am new to AWS S3 Service and working on a project like Dropbox. Now I want to store all the images in S3 with PHP and currently, I am using S3 presigned URL to PUT Image. Now I want to show the Image to the users. I found 2 ways to do this:
Give…
a_b_h_i
- 13
- 4
0
votes
2 answers
Find all the s3 public buckets
I was working on boto3 module in python and I have had created a bot which would find the publicly accessible buckets, but this is done for a single user with his credentials. I am thinking of advancing the features and make the bot fetch all the…
Akash
- 100
- 1
- 10
0
votes
2 answers
Unable to mock AWSClient, S3Object while reading a file from S3 bucket
I am reading a file from S3 bucket as below:
class VersionServiceImpl implements VersionService {
VersionDto versiondto = new VersionDto();
try {
BasicAWSCredentials awsCreds = new BasicAWSCredentials(versionConfig.getAccessKeyId(),…
Anil_K
- 1
- 1
- 3