Error: No response from Gunicorn master within 120 seconds . Shutting down webserver. Airflow-Webserver Service won't start

Asked Sep 03 '20 at 11:10

Active Sep 04 '20 at 04:38

Viewed 4,589 times

I want to monitor my airflow worker logs with the help of Prometheus. So I looked up on the internet and found statsd-exporter can help me. But, when I added the required configuration of statsd-exporter in Airflow.cfg , Service wont start.

Airflow.cfg file


[scheduler]
statsd_on = True
statsd_host = xxx.xxx.x.xxx
statsd_port = 9125
statsd_prefix = airflow

When I restart The service after adding these lines in Airflow.cfg , it doesnt restart and throws above error in logs.

When I remove these lines , It starts perfectly.

I installed statsd and statsd-exporter via pip. Also can anyone suggest any better way this can be done.

edited Sep 04 '20 at 04:38

asked Sep 03 '20 at 11:10

dataintransit

Have you installed all the airflow dependencies ? https://airflow.apache.org/docs/stable/metrics.html . please take a look. – hopeIsTheonlyWeapon Sep 03 '20 at 13:21
1

does this work without statsd configuration changes ? – hopeIsTheonlyWeapon Sep 03 '20 at 13:25
@hopeIsTheonlyWeapon yes – dataintransit Sep 03 '20 at 21:59
@hopeIsTheonlyWeapon yes all dependencies are installed. – dataintransit Sep 03 '20 at 22:00
Can you kindly put the complete stack trace also provide more details about the environment where you are running airflow – hopeIsTheonlyWeapon Sep 03 '20 at 23:49
@hopeIsTheonlyWeapon yes , I am running airflow in Centos 7 . This is the complete trace i get when i see the logs. – dataintransit Sep 08 '20 at 08:14

Error: No response from Gunicorn master within 120 seconds . Shutting down webserver. Airflow-Webserver Service won't start

0 Answers0