0

I've just started to use GCP and I have some doubts regarding the right use of some of its tools. Particularly, I'm trying to ingest data from Google Analytics into BigQuery. Would it be possible to use Dataprep on data stored in BigQuery? Almost every example I've seen uses Dataprep to visualize data stored in Google Storage, but nothing refers to BigQuery.

Any help would be really appreciated.

David
  • 51
  • 11

2 Answers2

2

You can totally use Dataprep to process data stored in BigQuery. It gives you a great way to visualize how your dataset looks, and interactively define transformations.

Now, do you really want to use Dataprep for this? The transformations will be more expensive and slow, as they will run on Dataflow - which is usually more expensive and slow than doing everything within BigQuery (as the question refers to data that's already in BigQuery).

On the other hand, the interactive environment can help you quickly define what you want and run the created recipe periodically.

See more about this on Lak's "How to schedule a BigQuery ETL job with Dataprep".

Felipe Hoffa
  • 54,922
  • 16
  • 151
  • 325
  • Thank you very much for your help, Felipe. What do yo mean by doing everything within BigQuery? Isn't it kind of read-only? – David Mar 14 '18 at 09:23
  • 2
    It's not read-only. You can smash your data with SQL, munge/transform it and write the results back to BigQuery ;-) – Graham Polley Mar 14 '18 at 09:54
0

According to the documentation on Dataprep, you can import BigQuery datasets.

But it might be easier to just to open Dataprep and check the importing options there:

enter image description here

Jofre
  • 3,718
  • 1
  • 23
  • 31