Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [gsutil]

34 questions
1
vote
2 answers

Convert filenames to lowercase [Google Cloud Storage] [gsutil]

We recently moved all product images from our website to Google Cloud Storage. Due to bad naming policies in the past the casing (lowercase, uppercase) in the file names does not always match the way file names are listed in our product database.…
m4v21
  • 21
  • 3
1
vote
0 answers

gsutil fails with "OSError: Operation not permitted" when running from cron

I have a php script that does backups. The backups have been failing, because one of the first commands throws an error and stops the script. When I run the script in the terminal, it works just fine. I even set up the cron to run at the next…
Kenny Wyland
  • 200
  • 1
  • 12
1
vote
1 answer

Gcloud cannot detect network connection

I have internet connection on the ESXi server and I want to copy everything to GCP storage. But Gcloud couldn't authenticate. It looks like it can't reach the gloud login servers. I'm not if the esxi provider has blocked GCP IP's but is there a way…
user630702
  • 495
  • 10
  • 32
1
vote
1 answer

Attempt to copy files from google cloud bucket to VM instance using gsutil is falling after reaching size limit

I have a bucket with a file whose size is larger than 11 GB. I note that I can access all bucket's data from the standard google cloud console. Unfortunately, this console has very limited configurations since, I believe, it was primarily thought of…
Lucas
  • 113
  • 6
1
vote
1 answer

gsutil from gcloud/Google Cloud SDK failing with "SyntaxError: invalid syntax" error in bcrypt

Trying to use gsutil today I got the following error: + gsutil cp -nra public-read a gs://b /usr/local/lib/python2.7/dist-packages/cryptography/__init__.py:39: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team.…
Alexander Ljungberg
  • 471
  • 4
  • 13
1
vote
1 answer

start/stop a Google Cloud VM from desktop

I have a VM running on Google cloud that I would like to start and stop. I am able to start/stop it from another VM in the same project using the command sudo gcloud compute instances stop my-daily-data-vm --zone us-central1-c Now, I would like to…
Milind Shastri
  • 13
  • 2
0
votes
1 answer

gsutil error /bootstrapping/gsutil.py

gsutil is giving me the following error. It is installed in its latest version on a linux suse 12. Can you help me? gsutil Traceback (most recent call last): File "/root/google-cloud-sdk/bin/bootstrapping/gsutil.py", line 13, in …
Mag
  • 1
0
votes
0 answers

Why would gsutil come up short when transferring files into a bucket?

I have a very large directory tree sitting in the file system of a Google Compute instance. If I do a "find foo -type f | wc -l" on it, it comes back with 34577, and I have no reason to assume that number is wrong. Yet when I do a "gsutil -m cp -r…
hbquikcomjamesl
  • 259
  • 2
  • 16
0
votes
2 answers

How to run gsutil rsync without auth?

aws s3 sync provides a parameter named --no-sign-request, so user can sync a publicly-visible bucket without any auth in advance. gsutil help anon says that: gsutil users can access publicly readable data without obtaining credentials. For…
lz96
  • 131
  • 5
0
votes
1 answer

gsutil "Copying mtime from src to dst" having moved source files?

I use gsutil to backup photos from a dedicated box to google nearline storage. Recently I moved all of my photos from that dedicated box to a new dedicated box. I made sure to use the relevant archival rsync flags to avoid changing the files…
Codemonkey
  • 1,086
  • 4
  • 19
  • 41
0
votes
2 answers

Dedicated Interconnect to GCP Storage (gsutil)

We are have a dedicated interconnect setup from our data center to GCP using a cloud router. We have a RHEL linux server setup in the datacenter with a nic port connected to the public Internet and a dedicated 10GB port attached to the router that…
jlnelson7613
  • 11
  • 2
0
votes
0 answers

Why does gsutil rsync on CoreOS fail with 'CommandException: arg () does not name a directory, bucket, or bucket subdir'

On a recent Google Cloud Platform CoreOS VM, the command gsutil rsync -r gs://some-bucket-here dest fails with: CommandException: arg (dest) does not name a directory, bucket, or bucket subdir. $ gsutil --version gsutil version: 4.28 The result…
Ray Walker
  • 56
  • 6
0
votes
0 answers

What is the difference between -i and -u options in gsutil rsync command?

The gsutil rsync documentation describes two options which sound identical: Option Description -i This forces rsync to skip any files which exist on the destination and have a modified time that is newer than the source file. (If an existing…
AKd
  • 101
  • 1
0
votes
1 answer

Where can I find the gsutil.tar.gz file for version 4.66 of gsutil?

The situation on my end is really very complicated1. The bottomline, however, is that I desperately need to download an version of the gsutil.tar.gz file that is older than the one currently available at…
kjo
  • 115
  • 5
0
votes
2 answers

Using gsutil on Windows to download a Google Workspace Data Export

What is the easiest approach to automatically download all export files onto a Windows system? I need to download a full Google Workspace Data Export using Windows. The Google Workspace Data Export is similar to Google Takeout but for the whole…
hultqvist
  • 761
  • 5
  • 13
1
2
3