Stack Overflow
Stack Overflow

Questions tagged [bigrquery]

bigquery is an R package makes it easy to work with data stored in Google BigQuery by allowing you to query BigQuery tables and retrieve metadata about your projects, datasets, tables, and jobs

The bigrquery package makes it easy to work with data stored in Google BigQuery by allowing you to query BigQuery tables and retrieve metadata about your projects, datasets, tables, and jobs

77 questions
0
votes
1 answer

Error: BigQuery does not support temporary tables

I'm trying to join tables from two different datasets in the same project. How can I do this? library(tidyverse) library(bigrquery) con1 <- bConnect( drv = bigrquery::bigquery(), project = PROJECT, …
teru
  • 308
  • 2
  • 7
0
votes
1 answer

Bigrquery library in R doesn't upload the data and returns no error. Getting application call back when press stop

I am trying to upload the data into Google Big Query using Bigrquery package in R - I was able to successfully run the script before, but today it failed with no changes within a script. Please see the script below: library(bigrquery) df = mtcars …
Kirill Konovalov
  • 59
  • 1
  • 12
0
votes
1 answer

load bigquery JSON data dump into R tibble

I have downloaded a JSON extract from Big Query which has nested and repeated fields (similar to the package bigrquery) and am attempting to further manipulate the resulting tibble. I have the following code to load from JSON and convert to a…
user1420372
  • 2,077
  • 3
  • 25
  • 42
0
votes
1 answer

bigrquery - Error: No matching signature for operator - for argument types: DATE, FLOAT64

When filter()ing by date, and using a function to provide that date, I see an expected error: library(tidyverse) library(bigrquery) table1 %>% filter(date > as.character(today() - 730)) %>% tally() # Error: No matching signature for…
stevec
  • 41,291
  • 27
  • 223
  • 311
0
votes
1 answer

Fill in missing values in dbplyr

I have data in a database that look like: ID month_year value 1 01/06/2014 10 1 01/07/2014 100 1 01/10/2014 25 I would like to fill in the missing months: ID month_year value 1 01/06/2014 10 1 01/07/2014 …
Liam
  • 159
  • 11
0
votes
1 answer

How to flatten dataframe (loaded from BigQuery) with multiple list-columns in R

I am using R's bigrquery library to load data from a BQ database into R. bigrquery works fine, and a short example of the output I am receiving is as such: dput(my_df_from_bq) structure(list(season = c("2019", "2019", "2017", "2018", "2018" ),…
Canovice
  • 9,012
  • 22
  • 93
  • 211
0
votes
1 answer

Week of year using bigquery / bigrquery and dbplyr? (equivalent of lubridate::week)

I'm trying to use bigrquery and dbplyr to get the week of the year that a date corresponds to (i.e. the same as lubridate::week(), i.e. library(lubridate) library(dbplyr) library(bigrquery) week("2015-08-11") # [1] 32 but I am using bigrquery…
stevec
  • 41,291
  • 27
  • 223
  • 311
0
votes
2 answers

Error in max(.) : invalid 'type' (list) of argument when using dplyr dbplyr and bigrquery

I'm running some very simple dplyr code on a bigquery table using dbplyr transactions %>% select(date) %>% max(.) Produces the error Error in max(.) : invalid 'type' (list) of argument I have checked that The table I am querying queries as…
stevec
  • 41,291
  • 27
  • 223
  • 311
0
votes
2 answers

Keep getting Access Denied when connecting to BigQuery with R

I am very new to GCP and BigQuery and I am trying to query a simple dataset that I have uploaded on Google BigQuery by using R. In the IAM settings, I am listed as an "BigQuery Admin", "BigQuery Data Owner" and "Owner." I can also query the dataset…
Jean_N
  • 489
  • 1
  • 4
  • 19
0
votes
1 answer

Optimisation of BigQuery generated from bigrquery and dbplyr?

dplyr functions are typically incredibly performant, having been optimised by the open source R community, with many going so far as to run c++ under the hood to make them much faster. Does the BigQuery code generated through bigrquery and dbplyr…
stevec
  • 41,291
  • 27
  • 223
  • 311
0
votes
1 answer

How can I insert non-repeated records into BigQuery using the bigrquery library?

I'm trying to insert a non-repeated record into BigQuery but keep receiving the error Array specified for non-repeated field: record.. My question is: How can I insert non-repeated records into BigQuery using the bigrquery library? If I have the…
Rhys Jackson
  • 129
  • 4
0
votes
0 answers

Error Appending Data to Existing Empty Table on BigQuery Using R

I created an empty table from Big Query GUI with the schema for the table_name. Later I'm trying to append data to the existing empty table from R using bigrquery package. I have tried below code, upload_job <- insert_upload_job(project =…
Midhun T
  • 111
  • 1
  • 9
0
votes
0 answers

Failed to install bigrquery on RStudio server

I recently installed RStudio server on Google Compute Engine and now want to connect to BigQuery. I have successfully installed and loaded packages such as dplyr and ggplot2, but failed to load bigrquery and devtools. Running the code snippet…
Stella Kusumawardhani
  • 21
  • 4
0
votes
1 answer

UseLegacySql=FALSE ignored, BigRQuery

I am having some issues with BigRQuery not recognizing the useLegacySql=false argument in my query_exec() function. My call looks like query_exec(query, project = project, useLegacySql = FALSE, max_pages = Inf) I have a few issues: 1) When…
Mike G
  • 533
  • 4
  • 12
-1
votes
1 answer

Selection using table attribute with WHERE statment in BQ

I'd like to extract inside my CF_2021 table all the columns if ID_UNIQUE = "FIGUEIRAS040C" using a query without success. In my case: # First read the table inside the Big…
Leprechault
  • 1,531
  • 12
  • 28
1 2 3 4
5
6