2

File transfer service seems to be rejecting valid credentials from AWS? I have an s3 bucket:: >>> s3://my-bucket-name/icd_to_ccs.csv Have tried to set up the transfer service using the access key and secret

The key and secret work fine using boto3 and the aws command line for accessing the same file on my local machine Can't come up with the right foo to make it work using the cloud console transfer facility. I have tried with and without the Filter setting with and without the file name in the original "bucket" window.

It keeps giving me invalid access key? any guidance or tricks to this?

Have checked this answer and verified that my bucket has permissions for list the Amazon S3 bucket, get the location of the bucket, and read the objects in the bucket.

As mentioned the same key(and an alternate set of fresh keys) works fine via the boto3/cli on my local but no go on the web console..

Community
  • 1
  • 1
dartdog
  • 10,432
  • 21
  • 72
  • 121
  • Interestingly the Google web client has no method of specifying region, which I thought the AWS client wants? We are us- east.. – dartdog Apr 27 '16 at 19:33

1 Answers1

3

I'm an engineer on the Transfer Service team.

Are you writing out "s3://my-bucket-name/icd_to_ccs.csv" within the web UI? Make sure that you enter this as "my-bucket-name" only. The "s3://" part should be filled out for you (and will cause issues), and the tool does not transfer on an item-by-item basis (so don't include "/icd_to_ccs.csv").

If you want to restrict a transfer to only one item, use "Specify file filters" (from "Select source" in step 1) to provide an include prefix.

If none of the above is actually the problem, then I'll need a Transfer ID. You can obtain that by clicking on your failed job; the URL will now be ".../transfer/details/?project...". I just need the number specified by 'ID number'. With that, I'll be able to do more detailed diagnosis. (EDIT: You should email that Transfer ID to gs-team@google.com, rather than posting it here.)

EDIT: The client doesn't need a region to be specified. AWS uses a global namespace, and any needed region information can be determined by looking at the bucket itself.

Jacob Criner
  • 134
  • 3
  • went back and did exactly as suggested as far as I can see, which was also what I did prior no place to "click on failed job"? that I can see The uri is just the console transfer page – dartdog Apr 27 '16 at 19:59
  • Damm, re-entered as before now says running... And by the way that gives me a job that I would be able to click on. The prior times never got that far,, maybe some sort of browser cache issue from prior failures? – dartdog Apr 27 '16 at 20:06
  • Does it look like everything is working as intended, now? (As for your other question: I don't think there would be any caching at that stage, but I didn't write the UI.) – Jacob Criner Apr 27 '16 at 20:11
  • yes now working as expected.. The doc could be a bit clearer re file name vs bucket with regard to the filter but I had already tried that.. Oh well.. – dartdog Apr 27 '16 at 20:13
  • 1
    One more note (personal confession) the early error could have been due to a file of the same name existing in the target G cloud storage bucket but given the error (AWS auth) I did not see it 1st so when I restarted from scratch I used another file name.. – dartdog Apr 27 '16 at 21:52