Questions tagged [google-bucket]

64 questions
0
votes
1 answer

How to upload screenshots from puppeteer to cloudinary or google bucket?

I was saving screenshots to my react frontend build src folder, however I found out after deployment you cannot save images to this folder. So I was looking into cloudinary and am confused with the documentation I have my cloudinary setup like…
0
votes
1 answer

How sensitive is the data in Data Access and Access Transparency Cloud Audit Logs?

I would like to understand what can be captured in Data Access and Access Transparency Cloud Audit logs in GCP to consider it more 'risky' for users to view the logs. That is, why is it necessary to separate these logs from Admin Activity logs for…
0
votes
2 answers

google storage buckets configuration main page

I made a bucket lets call it my bucket. I gave "Legacy Storage Read" to this bucket and it means that it should not list the buckets but if someone knows the URL of specific files or folders inside the buckets they could visit it. If I enter the…
0
votes
1 answer

File stops downloading in Ubuntu 18.04 VM from Google Cloud storage buckets

I am trying to download a large dataset from my Google storage in my virtual machine running Ubuntu 18.04 but my download stops halfway. I am using the command: gsutil cp -r gs://my-storage-bucket/dataset1 /home/user/data I managed to download a…
brokkoo
  • 157
  • 7
0
votes
1 answer

Pyspark GCP UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary$PlainDoubleDictionary

I am new to pyspark, so hope someone can help. I am trying to read parquet files stored on a GCP bucket. The file are partitioned by date so for example bucket-name/year={}/month={}/day={} For a given file we have the below schema…
0
votes
1 answer

Create a Automatic script to upload files in google cloud storage

I create a script to automatically upload my files to google cloud storage, my vm is in the same project as my Google Cloud Bucket... So I create this script but I can't run it properly #!/bin/bash TIME=`date…
gabb00
  • 23
  • 4
0
votes
1 answer

How to mount a Google Bucket in Kubeflow Pipeline?

I have a KubeFlow Pipeline up and running on a VM in GCP with KF. I create the pipeline using a Jupyter Notebook server with image jupyter-kale and python. The first part of the pipeline is doing the dataprep, it downloads images and saves them to a…
0
votes
2 answers

Google Cloud Storage Transfer Service fails with PERMISSION_DENIED error

I've set up a transfer with Google Cloud Storage Transfer Service in order to back up the bucket to another region. The setup is very simple: transfer all bucket data to another bucket. Both buckets are owned by the same Google Cloud Platform…
0
votes
1 answer

how to use gsutil rsync. login and download bucket contents to a local directory

I have the following questions. I got access to a cloud bucket to my email id. Now I want to download the whole bucket folder into a local directory on ubuntu. I installed gsutil from pip. Is the command correct? gsutil rsync gs://bucket_name…
Bot_Start
  • 145
  • 1
  • 2
  • 9
0
votes
1 answer

How to access an object stored in a non-public google bucket using app-script

Is there a way to access an object stored in a non-public google bucket using app-script? i have this function which works for publicly available files, but i cant seem to find any documentation on how to access a non-public bucket? How do i…
0
votes
1 answer

Using IMPORTDATA() with objects from google bucket

Does the '=IMPORTDATA()' function within google sheets, work when using URLs from google buckets? I can only seem to get external URLs from other sites (AWS, etc.) to load when using the function.
Carlo B.
  • 119
  • 2
  • 16
0
votes
0 answers

IMPORTDATA() on sheets not working for files in drive or google bucket

I've been trying to use =IMPORTDATA() and it seems to only work in certain situations. Using the example URL in the = IMPORTDATA("http://www.census.gov/2010census/csv/pop_change.csv") I get no issue and it works as intended. I have created a public…
0
votes
1 answer

React hosting on Google cloud bucket No Such Key Error

I am hosting a react website on Google cloud bucket. The bucket is exposed to public internet and cname is pointed to c.storage.googleapis.com. and web settings is also updated to load index.html. Inside bucket there is app.yaml and build folder…
kpb
  • 21
  • 4
-1
votes
1 answer

Optimal method for storing memes on Google Cloud in terms of costs, speed, and scalability

I'm building a reddit-like app on which you can share memes (no videos for now). I read online on the best way to store them, and I found out that the choice comes down on whether you use file system or not. The other option is to simply store them…
-1
votes
1 answer

How to move only files that contains specific text from one Google bucket to another

I want to use Google cloud shell to move files that contain a specific text to another bucket. There are more than 10K files in the bucket so I can't do it manually by the interface. Please advise how to deal with this issue.