I have a MySQL RDS database that holds configuration/dimension tables. I also have transaction data streaming into Snowflake. I want the MySQL tables to be synced in Snowflake so that they are available in Snowflake because I will be writing a compute job that will join the config/dimension tables with the transactional data in Snowflake. What is the best way to sync the tables from MySQL to Snowflake at a certain frequency?
Asked
Active
Viewed 589 times
0
-
please define what 'best way' means from your standpoint. – Francesco Quaratino Apr 23 '21 at 14:17
2 Answers
2
In order to replicate MySQL tables towards Snowflake, you could use one of the following:

Francesco Quaratino
- 550
- 2
- 9
0
Disclaimer: I'm part of the team working on the solution suggested below
In addition to the solutions that were already mentioned, you can also create a data application using Turbine to sync your tables from MySQL to SnowflakeDB in real-time.
Depending on your current tech stack and the language you feel most comfortable developing in, you can create an application using any of the following libraries:
- Python: turbine-py
- GoLang: turbine-go
- JavaScript: turbine-js