Stack Overflow
Stack Overflow

Questions tagged [bigrquery]

bigquery is an R package makes it easy to work with data stored in Google BigQuery by allowing you to query BigQuery tables and retrieve metadata about your projects, datasets, tables, and jobs

The bigrquery package makes it easy to work with data stored in Google BigQuery by allowing you to query BigQuery tables and retrieve metadata about your projects, datasets, tables, and jobs

77 questions
1
vote
2 answers

Bigrquery forcefully coerces strings to integers (schema is a string)

I'm working with zip codes, which of course have leading zeros. I am correctly loading my dataframe to preserve the leading zeros in R, but the upload step seems to fail. Here's what I mean: Here's my minimal.csv…
Mittenchops
  • 18,633
  • 33
  • 128
  • 246
0
votes
0 answers

How to use the allowjaggedrows argument with bq_table_upload

I want to load CSVs from a Google Cloud Storage via bq_table_upload into a BigQuery table. The CSVs can have different columns. Therefore I want to use the allowjaggedrows argument…
netzstreuner
  • 35
  • 5
0
votes
0 answers

Create a BigQuery Session in R using bigrquery

I am using the bigrquery package with documentation found here: https://bigrquery.r-dbi.org/ I am connecting to GCP and would like to use "sessions" as defined here: https://cloud.google.com/bigquery/docs/sessions-create The purpose would be to use…
P5C768
  • 152
  • 10
0
votes
0 answers

Warning: uses an old dbplyr interface

I'm trying to suppress the following warning Warning: uses an old dbplyr interface ℹ Please install a newer version of the package or contact the maintainer This warning is displayed once every 8 hours. I know the code that…
cashes11
  • 1
  • 2
0
votes
1 answer

How to upload data frame from R to BigQuery to existing table?

I have a dataframe which I have earlier uploaded to the GCP BQ table, but later on there was some mistake in the existing dataframe's column names and I changed the column names. I am doing the following in R to truncate the existing table and…
Neil
  • 7,937
  • 22
  • 87
  • 145
0
votes
0 answers

Can I stop BigRQuery writing to disk?

We have some big datasets to process which are requiring us to hire space on a Virtual Machine - we are renting one with plenty of RAM (128-256GB) and were hoping that this would enable the process to be done entirely in RAM, however we have just…
DJD
  • 31
  • 3
0
votes
0 answers

R - bigrquery::bq_auth() function does not work - I can not reauthenticate to connect with BigQuery

First things first: Operating System: Windows 10 R version: 4.2.2 Story I am trying to import data from Google BigQuery to R. I am using bigrquery package. However any operations after creating DBI connection results in the same way - I get error…
Adrian Gasiński
  • 23
  • 1
  • 1
  • 4
0
votes
0 answers

How to insert nested values from R into Big Query

I would like to insert data into BQ via R. When I have a normal table everything is ok. The problem begins when I have to insert table which contains a map (nested/record repeated) column. The column is defined like this: I use bigrquery package…
Marta
  • 3,032
  • 3
  • 17
  • 34
0
votes
1 answer

Authentication error with bq-auth in rstudio but not within r terminal session

I used to not having issues on this particular subject, but bigrquery::bq_auth is not working on my installed RStudio. Funnything is that within an R terminal session it works perfectly. All started when I updated the R to R version 4.2.2…
Leandro Alves
  • 13
  • 5
0
votes
0 answers

Rolling average in SQL using window function over DATETIME range

I'm trying to compute a rolling average using SQL and I was able to compute said average using the OVER and ROWS BETWEEN commands. I obtained a rolling average using the rows between the preceding 1 and following 1 rows, code seen below along with…
theneil
  • 488
  • 1
  • 4
  • 14
0
votes
0 answers

Authentication for Bigquery using bigrquery from an R in Google Colab

I try to access my own data tables stored on Google BigQuery in my Google Colab sheet (with a R runtime) by running the following code: # install.packages("bigrquery") library("bigrquery") bq_auth(path = "mykeyfile.json") projectid =…
Ben
  • 45
  • 8
0
votes
1 answer

Receiving empty tables when calling bigrquery in R language

I'm trying to get some data from GCP and I'm having issues with that. My company has an application in R and we are trying to connect and request data using the bigrquery package. I have the same credentials that we used to connect through PowerBI…
Márcio A. Freitas Jr
  • 5
  • 2
0
votes
0 answers

bigrquery error: BigQuery API has not been used in project

I'm trying to connect bigquery to R in a Jupyter notebook. The notebook is on Google Vertex as a managed workbook. I followed the documentation that Google released on how to connect using R, but I keep running into the error below. I try following…
Jennifer Cook
  • 1
0
votes
0 answers

How to upload table/data frame from R to BigQuery?

I feel like this method has changed up multiple times over the years and I haven't been able to keep up with the change. Quite simply, how can I upload a regular data frame/table from R to BigQuery: Here was my original approach and error job =…
Jaskeil
  • 1,044
  • 12
  • 33
0
votes
1 answer

Can't authorize bigrquery on Google Cloud VM, but can on local machine

I posted an issue here: https://github.com/r-dbi/bigrquery/issues/487 and a similar one previously https://github.com/r-dbi/bigrquery/issues/449. They have not been solved. And, sadly, response to issues has dropped off to almost zero. If anyone can…
abalter
  • 9,663
  • 17
  • 90
  • 145
1 2
3
4 5 6