Stack Overflow
Stack Overflow

Questions tagged [google-bucket]

64 questions
0
votes
0 answers

Creating an Inventory of gcloud instances using googleapiclient

I am attempting to use googleapiclient.discovery.build('compute', 'v1').instances() to generate a list of devices. The below works fine but I want to know if there is a way I can pass format "json(disks,networkInterfaces,machineType,scheduling)"…
Silverthorn
  • 1
  • 1
0
votes
1 answer

How to export a huge table from BigQuery into a Google cloud bucket as one file

I am trying to export a huge table (2,000,000,000 rows, roughly 600GB in size) from BigQuery into a google bucket as a single file. All tools suggested in Google's Documentation are limited in export size and will create multiple files. Is there a…
Roee Anuar
  • 3,071
  • 1
  • 19
  • 33
0
votes
1 answer

What is google Cloud CLI command to retrieve current date populated files presented in the bucket ? without specifying date manually

What is google Cloud CLI command to retrieve current dated files presented in the Google Storage bucket ? without specifying date manually. Do we have any sysdate or createdate kind of command ?
SUNITH
  • 15
  • 10
0
votes
0 answers

How to use Google Session Token in Spark to connect to Google Cloud Storage bucket

I want to read data from Google Storage Bucket using Google Session Token in Spark Application. Here instead of json.keyfile I want to use Google Session Key in spark conf option. I tried with json.key file but Actually I am looking for Google…
Sachin Patil
  • 1
  • 3
0
votes
3 answers

How to check if file exists in Google Cloud Storage with the gcloud bash command?

I need to check if a file exists in a gitlab deployment pipeline. How to do it efficiently and reliably?
sg_rs
  • 411
  • 3
  • 13
0
votes
1 answer

Can I leverage having my app engine and storage in the same bucket?

I have an app engine instance which needs to read frequently from my storage (using http). The files on storage are updated very frequently so it's not relevant to deploy them with the app. I can't see any way to leverage the "proximity" of having…
Omri
  • 483
  • 4
  • 12
0
votes
1 answer

count columns from externat stage on snowflake

I'm ussing snowflake flake to create a data warehouse. and i puted scripte to let data updated. the data is stored on GCP bucket (external stage). So that i can control if the data is updated correctlly or not i'm traying to compare between rows…
Elhaj
  • 1
  • 2
0
votes
0 answers

File not uploading completely to Google Bucket NodeJs

The file does get uploaded but instead of it being 100s of Kbs or few MBs its just a couple of Bytes, and when trying to open it shows blank or "file not exist" error. same issue with text files and images. I believe the problem is with the stream…
Bang
  • 13
  • 2
0
votes
0 answers

Error while connecting node js to google cloud

const {Storage} = require('@google-cloud/storage'); const fs = require('fs'); const { createReadStream } = require('original-fs'); const util = require("util"); const Multer = require("multer"); const maxSize = 2 * 1024 * 1024; //const bucketName =…
ezmzi
  • 1
0
votes
1 answer

Google Buckets / Read by line

I know that is currently possible to download objects by byte range in Google Cloud Storage buckets. const options = { destination: destFileName, start: startByte, end: endByte, }; await…
Hitmands
  • 13,491
  • 4
  • 34
  • 69
0
votes
1 answer

Complement of AWS FsX in Google Cloud Platform

a few weeks ago, I've set up a microservice in AWS including Windows Virtual Machines (EC2) and a FsX Share (including Active Directory). I've decided to use a FsX instead of a s3 Bucket, as the customer wants to mount the share as drive in the…
bianconero
  • 215
  • 1
  • 12
0
votes
1 answer

Verify image in Google Cloud Storage Bucket

I have system that creates uploadable link to Google Cloud Storage Bucket uploads. After that user is uploading it directly there from Frontend. Is there a way to verify this image file there without downloading it to a Backend app and verify there…
wowkin2
  • 5,895
  • 5
  • 23
  • 66
0
votes
1 answer

Python script to count the number of records in a file on Google cloud bucket

Can you please help on providing python script to capture count of records in a file that is on GCS. Im trying to connect from linux server to GCS Bucket and capture the count of records/size of file.
Prashanth
  • 109
  • 1
  • 5
0
votes
0 answers

Issue with google bucket image upload in a Cypress test

I'm trying to create a Cypress test that involves uploading an image directly to a google storage bucket. I'm following this stack overflow suggestion: Upload File with Cypress.io via Request and I have it to the point where the image file gets…
opike
  • 7,053
  • 14
  • 68
  • 95
0
votes
1 answer

Delete all objects from a directory in google storage bucket using cloud storage options

I'm using cloud storage options from google cloud to manage data in a GCP bucket. I've a directory under which I want to delete all the objects before I start writing new objects. sample directory: gs://bucket-name/directory1/subdirectory/ I'm able…
Dookoto_Sea
  • 521
  • 1
  • 5
  • 16
1 2
3
4 5