0

Does location constraint require extra permission policy for hadoop s3a?

I am seeing 

Exception in thread "main" com.qubole.com.amazonaws.services.s3.model.AmazonS3Exception: Bad Request (Service: Amazon S3; Status Code: 400; Error Code: 400 Bad Request;

For all buckets that have

{
    "LocationConstraint": "us-west-1"
}

in qubole hadoop

but not for buckets without location constraint

{
    "LocationConstraint": null
}
Jal
  • 2,174
  • 1
  • 18
  • 37

1 Answers1

0

never seen that, but I've never played with that restriction. What could be the cause is that the client is defaulting to talk to S3 through the default central endpoint, not the us west one.

see s3a troubleshooting

set fs.s3a.endpoint to the relevant one listed here

if this works -update this question...it'll be something to update the s3 docs with then

stevel
  • 12,567
  • 1
  • 39
  • 50