1

I have the table created in BigQuery with partitioned by date and it has the Date type. DataPrep also has the same column with same data type. When i try to load the data from dataprep to bigquery table i am getting the error like "The column datatypes in the dataset must match the destination column datatypes". Screenshot also been attached, please go through it and give me a solution.enter image description here

Suresh M N
  • 99
  • 1
  • 1
  • 7
  • I'm having the same problem, but I don't see the "Show columns that don't match" link appearing for me, I just get the error message. Does anyone know why this is? – jlewkovich Oct 23 '18 at 17:18

2 Answers2

0

As the screenshot says, one is a TIME, DATETIME, or TIMESTAMP
the other is STRING as noted by the icons in front of your columns.

You need to make sure at dataset that you've chosen the right data type. Dataprep may infer wrong automatically sometimes your data type.

Pentium10
  • 204,586
  • 122
  • 423
  • 502
  • Hi, Thank you for your response. Please note in both bigquery and dataprep the type is Date only. I am also confused why the bigquery table shows string type as i have created the table with Date type only. – Suresh M N Sep 17 '18 at 13:38
  • Even if the column type is Date, sometimes Dataprep takes as string, you can fix this when you edit your dataset import in Dataprep. – Pentium10 Sep 17 '18 at 13:59
  • Problem is not with DataPrep, problem is with BigQuery as its not accepting it. While importing the data set dataPrep accepted this column as Date type only. – Suresh M N Sep 18 '18 at 04:17
0

In this this thread it is mentioned that you need to convert both types to TIMESTAMP in order to make this work. In my case this did the trick, but it is kind of cumbersome. Hopefully they will support this for simple DATE columns soon.

Wouter B.
  • 66
  • 4