We are looking into using MWAA and we already have docker images stored in ECR.
Is it possible to pull a docker image in ECR from a DAG running in MWAA ?
Asked
Active
Viewed 439 times
2
-
were you able to do it ? Would love to know the procedure. – Naxi Mar 02 '23 at 07:53
-
unfortunately, the team decided not to use airflow. Had to shelf this. Would love to have used it though. – wi3o Mar 03 '23 at 22:21
-
@wi3o What did you use instead? – Dommondke May 02 '23 at 15:40
1 Answers
1
Yes it can. DockerOperator takes the image parameter, this can be an ECR URL.
You will have to ensure that your Airflow has access to the ECR. For DockerOperator this can be done by configuring an Airflow connection like docker_conn_id.
Dommondke
- 307
- 1
- 8