Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [google-cloud-storage]

Google Cloud Storage, also called GCS, is a cloud service for storing and accessing arbitrarily large objects.

Google Cloud Storage is a RESTful, cloud service for storing and accessing data on Google's infrastructure. The service combines the performance and scalability of Google's cloud with advanced security and sharing capabilities. Learn more about Google Cloud Storage here.

Google Cloud Storage is comparable to Amazon's S3 or Microsoft's Azure Storage.

161 questions
29
votes
2 answers

Using JSON keys with google cloud gsutil

I have a ssh private key in a key.json file, and I want to use this credential to access a storage bucket using gsutil. I can't seem to find anything about how to include json keys as a authentication method, only "private" and "secret" fields. The…
GuySoft
  • 435
  • 1
  • 4
  • 12
19
votes
5 answers

Google Cloud : check disk space usage

How to check the used disk space of Google Persistent Disk without looking into each of them?
Mr.Wang from Next Door
  • 535
  • 1
  • 10
  • 18
15
votes
2 answers

Service account does not have storage.buckets.get access to bucket

I'm trying to get a list of buckets in a project, using python like this: from google.cloud import storage storage_client = storage.Client(project='[project-id]') bucket = storage_client.get_bucket([bucket-name]) blobs = bucket.list_blobs() for…
Dimitri
  • 251
  • 1
  • 2
  • 4
14
votes
2 answers

Backing up Google Cloud Storage Bucket

Is there a way I can regularly backup one bucket into another one so that in case files get deleted from one bucket, they can always be recovered from another?
spinalkracker
  • 141
  • 1
  • 1
  • 3
11
votes
2 answers

permission errors using gcsfuse as nonroot user on google compute instance

We are currently trying to demo the google cloud platform for some workloads that require lots of storage. We are trying to use google cloud storage but are having problems mounting the buckets using gcsfuse. I am currently able to mount my test…
echdee
  • 213
  • 1
  • 2
  • 6
10
votes
1 answer

Can I mount Google cloud storage bucket to a pod as a persistent disk. If yes how?

I have a gke cluster with nodes in 3 different Zones but same region. I want to use persistent disks to my pods. But the pods are created randomly in all the 3 zones.How can I use a gcePD (common for all the nodes). or Can I add the storage bucket…
Ram
  • 261
  • 1
  • 2
  • 7
10
votes
2 answers

How do I access a google cloud storage bucket using a service account from the command line?

I thought it would be pretty straight forward to do this, but I can't get it to work: I'm trying to push files from a server (GCE) to a google cloud storage bucket. To avoid granting the gsutil command on the server too many rights, I have created a…
bjoseru
  • 103
  • 1
  • 1
  • 7
9
votes
2 answers

How to prevent DDoS attack on Google Cloud Storage

How can I protect my public images hosted on GCS from ddos attacks? Does Google provide any protection, or should I pay for the bandwidth used by that attack?
Sed
  • 93
  • 1
  • 3
8
votes
1 answer

Lost Permissions to Google Cloud Storage Bucket

I accidentally deleted the "Storage Legacy Bucket Owner" permission on a bucket and now even though I'm the project owner and I created the bucket I cannot access it at all. What recourse do I have? It seems like now no one at all has permissions on…
Jonathan Potter
  • 1,553
  • 1
  • 10
  • 7
8
votes
4 answers

Why can't I access a cloud storage object despite being a project owner?

I'm a project owner for a particular project, which has a bucket with a few hundred gigs of objects. I have recently discovered by a failed gcloud rsync that there are some objects in my bucket that I can list but not cp or acl get etc., neither…
as.
  • 183
  • 1
  • 1
  • 4
8
votes
2 answers

Keeping Google Cloud Storage buckets backed up

Basically, my question is: what are the best ways to keep my Google Cloud Storage bucket data safe? I understand that using Object Versioning is a first measure you can take to protect yourself against accidentally deleting data. However, I would…
Remko
  • 183
  • 3
7
votes
3 answers

GCP: No access to Container Registry from Compute Engine

I have a Docker image pushed to Google Container Registry at gcr.io/my-project/my-image:latest. In the same project, I created a Google Compute Engine instance based on COS (Container-Optimized OS) with a read access to Google Storage (enabled by…
Sony
  • 251
  • 2
  • 8
6
votes
1 answer

Checking file's existence by name in a GCS bucket with Node.js

I'd like to know if Google Cloud Storage provides an efficient way of checking if a file with a given name exists in a given bucket with node.js. A method such as bucket.fileExists('someName') would be ideal. I apologize if there's an obvious…
Lex
  • 191
  • 1
  • 1
  • 7
6
votes
1 answer

Slow synchronisation stage on gsutil rsync?

I've just started to use GCS as backup for my web servers. One server has 1.2 million JPEGS (3.5TB) and this all rsynced over flawlessly over 10 hours or so. The other has 2.5 million JPEGS (just thumbnails/previews though - 300GB total). The…
Codemonkey
  • 1,086
  • 4
  • 19
  • 41
6
votes
2 answers

How to get a download URL for files in Google Cloud Storage?

I have created a service using : storage.Client(project='project_name', credentials=credentials) https://googleapis.dev/python/storage/latest/client.html And I'm able to upload, delete and list the files in a users Google Cloud bucket. I've seen an…
subin_john_
  • 61
  • 1
  • 1
  • 3
1
2 3
…
10 11