I want to use Google cloud shell to move files that contain a specific text to another bucket.
There are more than 10K files in the bucket so I can't do it manually by the interface.
Please advise how to deal with this issue.
Asked
Active
Viewed 80 times
-1

idan
- 1,508
- 5
- 29
- 60
-
1You cannot query by the content of the objects, you may need to download and check every file – Puteri Feb 25 '22 at 19:12
-
1You have to read all files... Depending on your requirements and context - a dataflow https://cloud.google.com/dataflow/ might be an option to use for development. If files are small - another option - a cloud function https://cloud.google.com/functions/ – al-dann Feb 25 '22 at 19:51
1 Answers
1
As mentioned in comments by @Ferregina Pelona & @al-dann, At the moment Google Cloud Storage
does not support this kind of file/s processing (i.e. you can't operate over file/s content).
You will have to use any of the available compute services like GCE
, GKE
, Cloud Functions
, Dataflow
, Cloud Composer
, etc.

Atef Hares
- 4,715
- 3
- 29
- 61