Stack Overflow
Stack Overflow

Questions tagged [gcsfuse]

gcsfuse is a user-space file system for interacting with Google Cloud Storage.

149 questions
0
votes
1 answer

Mounting GCS over FUSE

When mounting GCS through FUSE, gcsfuse does the file/files stored in the mount point are saved on the local disk file system (meaning does it consume actual disk space) or all data is stored directly to the cloud?
quarks
  • 33,478
  • 73
  • 290
  • 513
0
votes
2 answers

Docker file already exists when mounting with gcsfuse

So, I mounted a GCS Bucket on my VM using the gcsfuse --implicit-dirs [bucket] [mount-point] command. I'm using the same [mount-point] with docker to persist my data. However, when I start my containers with docker-compose up I'm getting an error…
Dragotic
  • 193
  • 1
  • 1
  • 7
0
votes
1 answer

Google VM not enough permissions to write on mounted bucket

I am running a Google Compute Instance which must be able to connect to read and write to a bucket that is mounted locally. At the moment, while ssh-ed into the machine I have the permission to read all the files in the directory but not to write…
mariob6
  • 469
  • 1
  • 6
  • 16
0
votes
1 answer

mounting gcs bucket using gcsfuse in a startup script

I would like to mount a bucket on my instance when it starts up. The command I use is: gcsfuse --implicit-dirs mybucket /my/folder This works when I do it manually ssh-ing into the instance. However, it fails within the startup script. There…
Alex
  • 19,533
  • 37
  • 126
  • 195
0
votes
1 answer

How to mount all bucket in Google Cloud Storage

From document https://cloud.google.com/storage/docs/gcs-fuse, when use FUSE GCS there is only mound predefine bucket to the specified path. In case I have many buckets, show how I can mount all buckets as root directory can access or create any…
Tang Khai Phuong
  • 301
  • 1
  • 4
  • 10
0
votes
1 answer

I/O error on writing files - GCSfuse in GKE

I am trying to mount and use googleBucket in multiple pods in kubernetes "cluster" for our use case. (GFS and NFS are viable solutions but not for us) I am able to mount the bucket and can see the contents of the bucket but when I am trying to write…
Stunn3r
  • 53
  • 1
  • 12
0
votes
1 answer

Reading video during cloud dataflow, using GCSfuse, download locally, or write new Beam reader?

I am building a python cloud video pipeline that will read video from a bucket, perform some computer vision analysis and return frames back to a bucket. As far as I can tell, there is not a Beam read method to pass GCS paths to opencv, similar to…
bw4sz
  • 2,237
  • 2
  • 29
  • 53
0
votes
1 answer

After gcsfuse mounting of a bucket transferred from S3 using Cloud Storage Transfer service, the s3 bucket fail to show when issuing a ls command.

I transferred a S3 bucket to GCS using Transfer Service. The transfer went well. From cloud console, I can see the s3 bucket. However, after I use gcsfuse to mount the GCS bucket (with the transferred s3 bucket inside) in a GCE VM, it fails to…
火星一號
  • 133
  • 1
  • 4
0
votes
1 answer

Mount google bucket during startup

I'm trying to mount google bucket to an instance during startup (or access) 1st way - via fstab: alex-backup-test /mount gcsfuse uid=0,gid=0,rw,user,key_file=/etc/google/service-account.json After reboot it isn't mounted ( But when I'm trying to do…
Alex Saraseka
  • 81
  • 6
0
votes
0 answers

gcsfuse: ls directory with 30,000+ files results in ls: reading directory [directory]: Input/output error

I have a mounted gcsfuce bucket that after the ls command is given resports an Input/Output error. Version: gcsfuse version 0.21.0 (Go version go1.8) Mount Command: gcsfuse -o rw -o allow_other --implicit-dirs --foreground --debug_fuse --debug_gcs…
Luke Fraser
  • 31
  • 1
0
votes
1 answer

How to use mount command in fstab file

After creating /mnt/bucket folder which is to be used as a local mounting-point for Google Bucket: sudo mkdir /mnt/bucket sudo chmod 777 /mnt/bucket I can successfully mount it to mybucket Google Bucket by simply typing sudo mount followed by with…
alphanumeric
  • 17,967
  • 64
  • 244
  • 392
0
votes
2 answers

Input/output error when writing to google cloud storage bucket

I created a gcs bucket on https://console.cloud.google.com/storage/ and successfully mounted on an instance with gcsfuse, however, when I try to write to the mounted directory, it shows an Input/output error. fuse_debug: Op 0x00000003 …
V Y
  • 685
  • 10
  • 21
0
votes
1 answer

gcsfuse to transfer files from joomla to cloud bucket

I have a google compute engine with one instance running joomla and another with GC storage bucket. I created a gcsfuse mount point from my joomla instance to the bucket and it works as root user to tranfer files into my bucket from my joomla…
Mohammedali H
  • 1
  • 2
-1
votes
1 answer

Cannot move files to a mounted gscfuse storage bucket (gcloud)

I'm having a problem almost exactly like this guy https://github.com/GoogleCloudPlatform/gcsfuse/issues/288 except that when they solved the problem they did not give enough details as to its solution. I have a mounted storage bucket on a gcloud VM…
logic1976
  • 519
  • 1
  • 6
  • 19
1 2 3
…
9
10