Stack Overflow
Stack Overflow

Questions tagged [airflow-webserver]

161 questions
0
votes
1 answer

Apache Airflow 2.3.0: Dags are not appearing in the browser

Can any one please help me to resolve this error, that is appearing in the Airflow 2.3.0 console. Do not use SQLite as metadata DB in production – it should only be used for dev/testing. We recommend using Postgres or MySQL. Click here for more…
Nikitha Singh
  • 11
  • 5
0
votes
1 answer

An error occurred (403) when calling the HeadObject operation: Forbidden in airflow (2.0.0)+

Error - *** Failed to verify remote log exists s3://airflow_test/airflow-logs/demo/task1/2022-05-13T18:20:45.561269+00:00/1.log. An error occurred (403) when calling the HeadObject operation: Forbidden Dockerfile - FROM apache/airflow:2.2.3 COPY…
Aditya Sinha
  • 614
  • 8
  • 18
0
votes
1 answer

Airflow 2.1.0 - DAG 'XXXXXXXX' not found in serialized_dag table

We recently upgraded from Airflow 1.10.12 to Airflow 2.1.0 and are getting issues errors like this in the UI for each of our dags. We have upgraded the version from 1.10.12 to 1.10.15 and it was successful. Then from 1.10.15 we have upgraded to…
Amal Bose Mathew
  • 1
  • 1
  • 1
0
votes
2 answers

Airflow Only works with the Celery, CeleryKubernetes or Kubernetes executors

I got this dag, nevrtheless when trying to run it, it stacks on Queued run. When i then trying to run manually i get error: Error: Only works with the Celery, CeleryKubernetes or Kubernetes executors Code: from airflow import DAG from…
Arie
  • 3,041
  • 7
  • 32
  • 63
0
votes
1 answer

Is it safe to delete airflow.db file?

I can't login in the web UI of airflow. I always get this Invalid login error. When I run the airflow users list the users are there. So my option is to delete the airflow.db and run airflow db init again. I want to know if it is safe to do that?
mee
  • 688
  • 8
  • 18
0
votes
1 answer

Hitting the Airflow API running on Astronomer cloud

We currently have airflow DAGs running on an Astronomer cloud instance, and we’re trying to develop external functions that would eventually trigger these DAGs. Referencing the documentation for this → Make Requests to the Airflow REST API |…
dlsupaolo11
  • 23
  • 3
0
votes
0 answers

In Apache Airflow postgres is not connecting

I'm trying to connect postgresql pgadmin3 with apache airflow, but can't connect with the local database. I've created a server and a database in it. And tried to connect it using connections tab in apache airflow. When I'm running my DAG, the logs…
MAHENDRAN KANAGARAJ
  • 1
  • 1
0
votes
1 answer

Apache Airflow Docker - How do I know which "Extras" are included

I tried to identify what Airflow "extras" has in Docker Image - here I tried to read documentation here - but it tells me nothing about what's already included if I pull the Docker Image. It only says "These are the extras and install them from…
ha9u63a7
  • 6,233
  • 16
  • 73
  • 108
0
votes
0 answers

Import error DAG airflow cannot import name 'serialization'

I have written a Dag file with contain ssh hook implementation. I get import error in the DAG file File "/usr/local/lib/python3.6/dist-packages/paramiko/transport.py", line 91, in from paramiko.dsskey import DSSKey File…
Sundar
  • 95
  • 1
  • 13
0
votes
1 answer

Docker Airflow running script cannot find text file ([Errno 2] No such file or directory)

I'm new to Airflow. I was able to follow a video and create the docker-compose yml file, Dockerfile, and a dag file. I am able to view my dag and run it. In my script, I'm trying to open a text file (.txt), but I get the following error:…
Zaman
  • 1
  • 1
0
votes
1 answer

Airflow with Okta integration

I'm attempting to integrate Airflow with Okta, however there is little documentation available online. I'm referring to a blog article, but I can't seem to get Okta to work. Blog URL :…
Dev
  • 612
  • 2
  • 13
  • 33
0
votes
1 answer

Why the logs are not update?

I have a simple PythonOperator: def simple(): print ("start simple") for i in range (10): time.sleep(0.7) print("hello from simple") print ("end simple") When looking on the logs window, I need to refresh the page in…
user3668129
  • 4,318
  • 6
  • 45
  • 87
0
votes
1 answer

How to run airflow dag on working days between 9am to 4pm in every 10 minutes

I have a DAG that needs to be scheduled to run in working days (Mon to Fri) between 9AM to 4PM in every 10 minutes. How do i do this in Airflow.
Amitjoc
  • 83
  • 4
  • 9
0
votes
1 answer

Airflow None Schedule is not working. Tasks are still running automatically

I have an airflow dag which i don't want to schedule. I'm using schedule_interval:None in my dag file but the dag is still running automatically once it is deployed. Airflow version used: 2.1.0 Airflow Screenshot Attached. I'm using the following…
Akash Srivastava
  • 23
  • 2
0
votes
1 answer

Dag dependency view is not showing the list of dags in Airflow 2.1.3

We have successfully installed Airflow 2.1.3 , when we click on Dag dependency view from the browse drop down , it shows none.. Do we need to enable in any place ?
Ravi
  • 793
  • 3
  • 16
  • 29
1 2 3
…
10
11