I sometimes get this log for tasks:
[2022-10-03, 00:34:03 UTC] {taskinstance.py:1034} INFO - Dependencies not met for <TaskInstance: dag_name.task_name scheduled__2022-10-02T00:00:00+00:00 [running]>, dependency 'Task Instance Not Running' FAILED: Task is in the running state
[2022-10-03, 00:34:03 UTC] {taskinstance.py:1034} INFO - Dependencies not met for <TaskInstance: dag_name.task_name scheduled__2022-10-02T00:00:00+00:00 [running]>, dependency 'Task Instance State' FAILED: Task is in the 'running' state.
It happens for sensors or normal tasks.
It also happens for the airflow_monitoring dag provided by google.
It is annoying because the task gets stuck until I restart it manually. Is it something I can fix with a configuration change?
Configuration:
Google Cloud Composer 1.19.1
Airflow 2.2.5
Running on Kubernetes cluster with Celery executor