Questions tagged [jets3t]

JetS3t is a Java toolkit and application suite for Amazon S3/CloudFront and Google Storage

JetS3t (pronounced "jet-set") is a free, open-source Java toolkit and application suite for Amazon Simple Storage Service (Amazon S3), Amazon CloudFront content delivery network, and Google Storage for Developers.

JetS3t Home

JetS3t Development @ BitBucket.org

45 questions
0
votes
0 answers

Amazon Cloudfront signed URLs, missing Key-Pair-Id

I am not being able to access a video stored in my Amazon s3 bucket through my Cloudfront distribution. I have set the distribution to require signed URLs or signed cookies(generated by "self" user) and configured everything according to the…
Santiago Hitta
  • 21
  • 1
  • 12
0
votes
1 answer

How does one use Spark with google cloud storage's "interoperability mode"?

Google offers "s3-compatible" access to their Cloud Storage service in the form of something called "Interoperability Mode". We're running spark on a closed network and our connection to the internet is through a proxy. Google's own hadoop…
0
votes
1 answer

jets3t cannot upload file to s3

I'm trying to upload files from local to s3 using hadoop fs and jets3t, but I'm getting the following error Caused by: java.util.concurrent.ExecutionException: org.apache.hadoop.fs.s3.S3Exception: org.jets3t.service.S3ServiceException: Request…
pl0u
  • 365
  • 7
  • 16
0
votes
1 answer

--move option of jets3t synchronize not moving S3 file

I was trying to use --move option with jets3t Synchronize tool to move files from S3 folder to local directory with below command. ./synchronize.sh DOWN --move mybucket/folder/ /mylocal-directory/ I was expecting after execution of this command,…
SSK
  • 123
  • 1
  • 7
0
votes
1 answer

jets3t and Downloading Files from AmazonS3 with Different Name

We're using Amazon S3 for file storage and recently found out that we need to keep some sort of directory structure. Since S3 doesn't allow that, we know we can name the files according to their structure for storage. For…
Gregg
  • 34,973
  • 19
  • 109
  • 214
0
votes
1 answer

Duplicate jars while deploying oozie job

I have an oozie job which uses jets3t v 0.9 jar. By default oozie is loading jets3t v 0.6 jar from Hadoop lib directory. Due to this both jars are getting loaded and am getting a java verifierError. Is there any way to stop oozie from loading…
dnivra
  • 749
  • 4
  • 12
  • 30
0
votes
1 answer

error in download data from S3 'requester pay' bucket using hadoop

I was using Hadoop 1.2.0 with command distcp to download a data from a S3 'requester pay' bucket, I have valid aws id and key, however, it went to an error, as shown below. org.jets3t.service.S3ServiceException: S3 GET failed for '/dataset' XML…
edwin
  • 377
  • 3
  • 3
0
votes
1 answer

Calculating Amazon S3 Bucket Size

My requirement is to calculate individual bucket sizes on Amazon s3. Currently am doing it using JetS3T library. Am using the ThreadedStorageService.listObjects() method to find the size of each individual object and then sum it up. Even though the…
dnivra
  • 749
  • 4
  • 12
  • 30
0
votes
1 answer

Grails, connecting to S3 using jets3t

I am trying to connect to Amazon S3 Buckets using "JetS3t", I am also using Quartz plugin, I have a job in grails-app/jobs, in which I like to access S3, but I get an error in the socond line: AWSCredentials awsCredentials = new…
iMiX
  • 301
  • 4
  • 8
0
votes
0 answers

Jets3t zipfile upload, stream being closed automatically

I am uploading a zipped file through a multipart webform. I am using groovy and grails for the upload but code would look similar in Java(with spring) as well... def processUpload(){ def uploadedFile = request.getFile('payload') String vloc…
Sap
  • 5,197
  • 8
  • 59
  • 101
0
votes
1 answer

How to Access and read bucket information of shared bucket using jets3t API?

Here is the explanation for my error. I have registered two User's A, B in Eucalyptus (open-source). I Created a bucket B1 using Jets3t API in User A's Account and granted Read Permission To user B (Using "CanonicalGrantee" Interface). While Listing…
0
votes
1 answer

JetS3t client putObject stopped working with HTTPS hostname invalid exception

Basic put object calls suddenly stopped working (sometimes it succeds). It has been working since long. Looks like a SSL cert issue. Stack Trace snippet. org.jets3t.service.S3ServiceException: S3 PUT connection failed for…
instanceOfObject
  • 2,936
  • 5
  • 49
  • 85
0
votes
2 answers

Android and jets3t? Library Issues

I am trying to use jets3t0.9.0 in my android application but running into classnotfoundexceptions and noclassdeffounderror. I added the httpcore4.2 and httpclient 4.2, logging and the commons-io jar files to the build library. Thanks Droidment
droidment
  • 555
  • 5
  • 7
0
votes
1 answer

JetS3t fills up my /tmp directory. How should I remove the old files?

I'm developing some HTTP server software on Linux that uses JetS3t to retrieve files from S3. The files are all around 5MB. Over time, JetS3t creates a large number of *.tmp files in the /tmp directory. However, since this is all running on a…
Tom
  • 18,685
  • 15
  • 71
  • 81
-1
votes
2 answers

Configure Hadoop to use S3 requester-pays-enabled

I'm using Hadoop (via Spark), and need to access S3N content which is requester-pays. Normally, this is done by enabling httpclient.requester-pays-buckets-enabled = true in jets3t.properties. Yet, I've set this and Spark / Hadoop are ignoring it. …
SRobertJames
  • 8,210
  • 14
  • 60
  • 107
1 2
3