Fastest way to bulk upload files to google bucket

Question

I have large number of pdfs to upload to google bucket. What is the fastest way to upload all these files to google bucket? I have tried uploading using drag and drop but it's taking a lot of time should I create a python script or is there any faster way to bulk upload data to GCP bucket.

Any help is appreciated.

Not exactly python related, but [`gsutil cp`](https://cloud.google.com/storage/docs/gsutil/commands/cp) might be helpful, since it has a parallel option `-m` — C.Nivs, Jul 06 '20 at 14:09

score 2 · Accepted Answer · answered Jul 06 '20 at 19:40

2

Use gsutil, specifically the gsutil cp command.

answered Jul 06 '20 at 19:40

Dustin Ingram

20,502
7
59
82

1

Also, the -m switch enables parallel upload which makes the entire operation way faster. – Hollay-Horváth Zsombor Jul 06 '20 at 19:56

Fastest way to bulk upload files to google bucket

1 Answers1