Implement SCD2 logic in Data Fusion and BigQuery

Question

I am trying to implement an SCD2 table loading with Data Fusion but can't seem to find the necessary building block to do it. (something that was presented here).

I could join the new records (stage table) with the target table, filter the unchanged records, but I could not do merge/update on the SCD2 type table, as there is no option to do this.

Is there any option to do merge/update on a BigQuery table using Data Fusion?

score 2 · Accepted Answer · answered Aug 05 '19 at 18:51

2

CDF currently does not support update on BQ, but may in the future.

answered Aug 05 '19 at 18:51

Jay

51
1

Implement SCD2 logic in Data Fusion and BigQuery

1 Answers1