in my workplace I was tasked to do this below work:
- what is the most cost effective method to create a CRON job that would run hourly (or maybe twice a day) to copy company's application new datas from DigitalOcean database (MySQL) into a Google Big Query ?
My colleagues told me to create a data pipeline with Airflow or something, but since I have never done any like this before.
Could someone please give me an advice of how to do this task.
