Stack Overflow
Stack Overflow

Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

149 questions
1
vote
1 answer

GCSFuse Provided scope(s) are not authroized error

I am using gcsfuse with public access Google Cloud Storage. When i try to mount storage with command(gcsfuse -o allow_other --implicit-dirs bucket-name /mnt/my_directory), i can see below messages. 2021/10/22 09:08:46.859250 Using mount point:…
Hoonki
  • 125
  • 6
1
vote
1 answer

GCP bucket reachable in UI but not by gcsfuse in the cloud shell

Hi I want reach some files in a GCP bucket from the cloud shell terminal (for sftp reasons), gcsfuse successfully mounts the father dir and it has all the directories except the one I need, any ideas what am I doing wrong?
Ezer K
  • 3,637
  • 3
  • 18
  • 34
1
vote
0 answers

nginx-rtmp with gcsfuse ffmpeg permissions

I'm using nginx-rtmp-module in a Docker to record rtmp streams into a Google Cloud Storage bucked mounted with gcsfuse. While I'm able to record the stream into .flv, using exec_record_done to convert the files to .mp4 results in a .mp4 with 0 byte…
fitzmode
  • 1,007
  • 1
  • 18
  • 29
1
vote
2 answers

GCSFuse installation in Docker in GCloud failing

I'm running a command that worked until yesterday, and works locally on my local Docker, to install gcsfuse version 0.28.1: E: Version '0.28.1' for 'gcsfuse' was not found I tried it on the google cloud console too, and got the same error there. Any…
kic00
  • 11
  • 5
1
vote
1 answer

Install gcsfuse in Google Cloud Container Optimized OS (COS)

Does anyone know how do I install gcsfuse into a Google Container Optimized OS so that I could mount bucket in the VM instance itself. I tried running a docker with gcsfuse mounted volume from host. The docker container successfully mounted the…
jlim
  • 909
  • 2
  • 12
  • 24
1
vote
2 answers

gcsfuse command fail with gcsfuse takes exactly two arguments

I am using GCSFuse for mounting the GCS bucket to my user pod in JupyterHub, but it always fail with the error message gcsfuse takes exactly two arguments. Here is my DockerFile: FROM jupyter/minimal-notebook:177037d09156 ENV GCSFUSE_REPO…
tank
  • 465
  • 8
  • 22
1
vote
1 answer

Bucket uploaded file not shown in all mounted VMs

I have a Google Cloud Storage Bucket which is mounted to 3 virtual machines using fstab. When I upload a file from another machine to google bucket using gsutil command, the uploaded file is accessible from only 2 vms (Set A). The other vm (Set B)…
Shadhini
  • 43
  • 6
1
vote
0 answers

Gcsfuse vs kubernetes conflict?

I'm running a flask application that serves an ML model that loads in a wordembeddings file (2GB) on k8s. This file is being loaded with gcsfuse and we have the application running for about 2 years. Since a recent restart of the pod, this setup is…
Brecht Coghe
  • 286
  • 1
  • 7
1
vote
1 answer

Unable to unzip very big files from/to google buckets when mounted with gcsfuse

On Google Cloud I have a linux Compute Engine and a bucket. I have mounted the bucket as a drive to the CE using gcsfuse - as recommended by Google - and from time to time I have had a big 7zip archive (tens of GBs) uploaded to the bucket. When I…
Vee6
  • 1,527
  • 3
  • 21
  • 40
1
vote
0 answers

Share Google Fuse mounted drive with Samba

I'm trying to mount a google cloud storage bucket with the Google Fuse plugin and share it over Samba. Mounting the bucket works fine. I'm using the following command: gcsfuse --uid 1001 --gid 1002 --only-dir data -o allow_other bucket-name…
Ybrin
  • 901
  • 8
  • 30
1
vote
1 answer

High latency on Google cloud storage buckets mounted from VM with gcsfuse --implicit-dirs

I am attempting to mount several Google cloud storage buckets from a Google cloud compute virtual machine instance using gcsfuse. It seems that some of the buckets show their contents correctly and others do not unless the --implicit-dirs options is…
Ari
  • 31
  • 6
1
vote
2 answers

GCFS write exceeding quota and throws HTTP error 429

When running GCFS application via papermill[gcs] papermill gs://my-bucket/test.ipynb gs://my-bucket/output/test.ipynb I'm getting Error: HTTP 429 exceeds the rate limit. Works if output notebook is written locally: papermill…
gogasca
  • 9,283
  • 6
  • 80
  • 125
1
vote
1 answer

mount GCPs buckets with write access

I can successfully mount my bucket using the following command sudo mount -t gcsfuse -o rw,noauto,user,implicit_dirs,allow_other fakebucket thebucket/ I can go into the bucket find the subfolders and etc. however I can't write anything touch:…
Areza
  • 5,623
  • 7
  • 48
  • 79
1
vote
2 answers

How Can we share files between multiple Windows VMs in GCP?

I have 10 Windows VMs where I want to have PD with both read-write in all the VM's. But I came to know that we cannot mount a disk to multiple VMs with read-write. SO I am looking for option where I can access a disk from any of those VMs. For Linux…
Ram
  • 655
  • 2
  • 7
  • 27
1
vote
1 answer

Slash added automaticaly before bucket name with fstab and gcsfuse

I use gcsfuse to mount bucket in google compute engine. For this i use this syntax in my fstab : my_bucket /my_bucket gcsfuse rw,uid=1001,gid=1002 But gcsfuse process is launch like this : /usr/bin/gcsfuse --foreground -o rw --uid 1001 --gid 1002…
Bastien D
  • 1,395
  • 2
  • 14
  • 26
1 2 3
…
9 10