I would like to upload my data frame to a Big query table using data bricks. I used the below code and got the following errors.
bucket = "databricks-ci"
table = "custom-bidder.ciupdate.myTable"
df.write.format("bigquery").mode("overwrite").option("temporaryGcsBucket", bucket).option("table", table).save()
Error Message
I created a new bucket called "databricks-ci" and also created a dataset called "ciupdate" and just gave my table name here "myTable". My project is "custom-bidder"
I am not sure why it's not loading? Can anyone advise?