Stack Overflow
Stack Overflow

Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

149 questions
2
votes
1 answer

GCloud gcsfuse permission denied

Anyone successfully using gcsfuse? I've tried to remove all default permission to the bucket, and setup a service account: gcloud auth activate-service-account to activate serviceaccname And then running: gcsfuse --debug_gcs --foreground…
James Tan
  • 1,336
  • 1
  • 14
  • 32
2
votes
1 answer

Best way to check if a bucket is ready in node.js

I'm using gcsfuse to mount a volume in a container, and I need it to start my node.js application. To mount the volume I'm using the lifecycle hooks of kubernetes, but it doesn't ensure that it will be executed before the entrypoint of my…
Ivan Beldad
  • 2,285
  • 2
  • 21
  • 33
2
votes
1 answer

Cannot Create File in a Google Cloud Bucket

On Google Cloud I have 4 buckets and I have two VMs running, one Ubuntu 14 and the other 16. On both machines, I can mount (gcsfuse) all four buckets. However, I'm having a problem with one (and only one) bucket (project-x-logs). On the machine…
Joe
  • 511
  • 1
  • 6
  • 13
2
votes
1 answer

How to grant Google compute engine instance access to a cloud storage bucket?

I have a compute engine instance (Ubuntu 16.04) and a storage bucket both in the same project. I want to mount the storage on the compute instance. I found some resources on this page: https://cloud.google.com/storage/docs/gcs-fuse. I already…
Szabolcs
  • 3,990
  • 18
  • 38
2
votes
2 answers

gcsfuse touch: cannot touch ‘test2/test.txt’: Input/output error

I am trying to mount a google bucket using gcsfuse. I am able to mount it but am getting an input/output error message when I try to use touch to test making files inside of it. The command below shows that there are no errors trying to connect to…
lathomas64
  • 1,612
  • 5
  • 21
  • 47
2
votes
2 answers

Where Are the Files in My Google Cloud Storage Bucket?

I have mounted a bucket from my Google Cloud Storage account using gcsfuse. I'm surprised to see that none of the file from that bucket are now on my machine. This is a Google "instance" Debian 8, but I suspect the problem is more my not…
Randy L
  • 14,384
  • 14
  • 44
  • 73
2
votes
1 answer

Google Cloud Storage Buckets: Mounting in a Linux instance with Global Permissions

I've created a standard Google storage bucket that I'm trying to mount in a CentOS Linux compute engine instance, but the permissions don't seem to let me grant access to users other than the root user (who can read and write to the storage location…
Daniel Alex Finkelstein
  • 108
  • 8
2
votes
1 answer

Sharing to other users on the same machine a bucket mounted with gcsfuse

I'm working on it since a few hours but I'm not able to get it working. I successfully mounted an existing GCS bucket (my-bucket) on a running instance. I, with my_user, am able to list and copy files from the mounted bucket. Now another user on the…
toomuchkevin
  • 161
  • 2
  • 7
2
votes
1 answer

What is the fastest way to access data from google cloud storage and stream it into software running on a google cloud VM

Right now I am storing ~300Gb of images on google cloud storage (GCS). I have software that runs on a google compute engine (GCE) virtual machine (VM) and needs to read in all of these images and process them sequentially. These images do not need…
Tyler Garvin
  • 101
  • 1
  • 4
1
vote
2 answers

GCSFuse not finding default credentials when running a cloud run app docker locally

I am working on mounting a Cloud Storage Bucket to my Cloud Run App, using the example and code from the official tutorial https://cloud.google.com/run/docs/tutorials/network-filesystems-fuse The application uses docker only (no cloudbuild.yaml) The…
Finglish
  • 9,692
  • 14
  • 70
  • 114
1
vote
0 answers

Model path injection and gcsfuse

I observed that VertexAI uses gs:// rather than /gcs as the path to store trained models (started a few days ago). In my understanding, when gcsfuse is mounted correctly (which is the case for me - according to the logs), then I would expect nothing…
EiJay
  • 43
  • 5
1
vote
2 answers

Docker image error while installing gcsfuse

I'm trying to install fuse to my docker image that's inside Google Kubernetes Engine. Here is my Dockerfile: FROM --platform=amd64 ubuntu:22.10 # Use baseimage-docker's init system. CMD ["/sbin/my_init"] # Install. EXPOSE 80 RUN ls -la RUN \ …
Turgut
  • 711
  • 3
  • 25
1
vote
0 answers

getting permission denied when i "ls" into mounted gcp bucket

using this bash command to mount the bucket. mkdir /tmp/gcpbucketname-full && gcsfuse --implicit-dirs gcpbucketname /tmp/gcpbucketname-full/ the bucket mounts successfully - Yet I get permission denied when running ls…
jidohansha
  • 11
  • 3
1
vote
0 answers

Mounting with gcsfuse and get "Transport endpoint is not connected" after a while

I had mounted my gcs bucket to my virtual machine with the following command. mount -t gcsfuse -o rw,key_file=gcskey.json,_netdev,allow_other,uid=65534,gid=65534 mybucket /mypath It seemed to be working at first but after I copied files with an…
Mgronline Management
  • 11
  • 1
1
vote
1 answer

What happens when network connection to GCP is lost?

Imagine I have a GCS bucket mounted on my local Linux file system. Imagine I have an app that is writing new files into a Linux directory that is mounted to GCS. My goal is to have those locally written files eventually show up in GCS. I…
Kolban
  • 13,794
  • 3
  • 38
  • 60
1 2 3
…
9 10