I have an Airflow DAG that runs for every 10 min. My cron tab expression looks like this */10 1-8,10-23 * * *
. This currently pauses the DAG for 1 hours(9th hour UTC). I want to change this to pause the DAG for 45 minutes from 12:30 to 1:15 AM UTC.
Any way I can achieve this using Airflow
?. I read about the timetable concept in airflow 2.2
, but I am not sure how exactly this can be achieved.
My options are(Not sure which all are possible):
- Use a cron tab expression that can handle it
- Create a separate DAG to pause jobs for 45 min(Not sure how we can do this for 45 min. I know how to pause using a python operator. Confused at setting up pause time)
Anybody have done something similar or have any points on how to achieve this? Any pointers is much appreciated!
I am using AWS managed airflow.