1

I'm importing datasets in Google Cloud Dataprep (by Trifacta) to perform transformations on my data sources. But I can't see Google Drive Sheets in the list after connecting them to Big Query Console. I'm about to use them as rules for my transformations.

I've already created another dataset and the problem persists.

Is it possible to import them or not supported yet?

Thanks,

1 Answers1

1

You are right. According to the documentation Dataprep only supports native BigQuery tables and views as BigQuery sources.

You could try downloading your Drive sheets as csv and then creating a BigQuery table from it, or maybe you could create a load job from your external table into a new native table using:

SELECT * FROM my_dataset.my_external_table
Tlaquetzal
  • 2,760
  • 1
  • 12
  • 18
  • 1
    I would add that OP could use a scheduled query to materialize and update your sheet data into a native table as well, which may be helpful if it will change frequently and he doesn't want a manual step in the process. – justbeez Jul 23 '19 at 14:38
  • I used @justbeez's approach and it works beautifully - one addition: designating a Google Sheet as an external table can result in a lot of empty rows. I added a WHERE [field] IS NOT NULL to the scheduled query to prevent adding those to the native table. – Nico Jan 29 '20 at 05:39