I am trying to export my existing and all future data from my Firestore database to BigQuery.
I am using Export Collections to BigQuery firebase extension, which does export my new data to BigQuery. The Users_raw_latest
table has correct data in it.
The problem is it does not have the data in tabular format as I want. I am expecting the schema fields to be collection properties. The table provides following schema:
The data field has the json of each document in the collection.
When I tried to store the old data (the data already generated before the extension was installed) in the BigQuery using the BigQuery guide, it created another table Users and had the exact correct schema I wanted, i.e. the document properties are the column of the table.
Is there any way I can use this existing Users table (I don't mind deleting and craeting one again) with document properties as columns be filled with new data inserted in Firestore with this extension or any alternative automation? Or do I have to write my own functions to do so?