Stack Overflow
Stack Overflow

Questions tagged [airflow-webserver]

161 questions
0
votes
0 answers

My Airflow Run doesnt work stuck at running

from datetime import datetime, timedelta import psycopg2 import pandas as pd from airflow import DAG from airflow.operators.python import PythonOperator import logging import boto3 logger = logging.getLogger(__name__) logger.setLevel(logging.INFO) …
Fatih Keskin
  • 1
0
votes
1 answer

how do i import xmltodict on python 3.11.4(virtual venv) because rn it's giving me an error

I'm trying to make a project on vs code using airflow and here is the code. from airflow.decorators import dag, task import pendulum import requests import xmltodict #decorator creation @dag ( dag_id = "podcast_summary2", schedule_interval…
Abby Kaur
  • 3
  • 1
0
votes
1 answer

How can i get all dags details from airflow rest api

i have more dags (say 150dags) in my airflow account. My airflow version = 2.4.0 im using url and query parameter http://localhost:8081/api/v1/dags?limit=1000&offset=0 But my response consists only 100 records(dags). i think query parameters are not…
vbala vbala
  • 15
  • 3
0
votes
0 answers

SSL permission failure airflow

I am having issues with apache 2 airflow's webserver. Here's the error I get: [2023-06-27 02:09:34 +0000] [1710631] [ERROR] Socket error processing request. Traceback (most recent call last): File…
arcee123
  • 101
  • 9
  • 41
  • 118
0
votes
0 answers

Airflow web-server UI authentication

I have setup authentication for the Airflow web-server using this file as a template: https://github.com/apache/airflow/blob/1.10.1/airflow/default_login.py However, I am only redirected to login when I access the /airflow url or /airflow/admin url,…
Jaeline
  • 1
  • 1
0
votes
0 answers

Audit user login/logout activity in Airflow

I am using Airflow version 2.5.0. Is there a way for an admin to see logging information about users' login/logout activity, as well as failed login attempts?
dbilid
  • 279
  • 2
  • 10
0
votes
1 answer

How to call customize python function for sending mail in case of failure of task in Airflow

I have written a send_email.py python script, which runs perfectly fine. How to call this function in the send_email.py script of DAG so that above function triggers with required DAG_ID, RUN_ID, LOG_URL, TASK_ID Can anyone help with this as my…
Austin Jackson
  • 153
  • 6
0
votes
1 answer

Add parameters to dag

I would like to set some parameters to my dag file. I would like to add two parameters named: is_debug and seti. I would also like to set default values to them so if i do not specify them when running manually a dag them to be is_debug=False and…
Arie
  • 3,041
  • 7
  • 32
  • 63
0
votes
1 answer

import python libraries (eg: rapidjson) in airflow

I want to use the Python library rapidjson in my Airflow DAG. My code repo is hosted on Git. Whenever I merge something into the master or test branch, the changes are automatically configured to reflect on the Airflow UI. My Airflow is hosted as a…
x89
  • 2,798
  • 5
  • 46
  • 110
0
votes
1 answer

Airflow 1.10 version suddenly stopped sending alerts

I have been using airflow 1.10 since 3 years and even though there are no configuration changes happened recently, failed dags are not alerting the specified mailids. WHat could be the reason for not alerting?
kavya
  • 75
  • 1
  • 10
0
votes
1 answer

Error Airflow, DPY-3015: password verifier type 0x939 is not supported by python-oracledb in thin mode

I've already install Oracle Provider package for Apache Airflow and triying to connect to Oracle (version 19c) with this package, And I got this error DPY-3015: password verifier type 0x939 is not supported by python-oracledb in thin mode Error…
Mahardian Yusuf Gintz
  • 1
  • 2
0
votes
0 answers

Newly Created DAG Not Showing Up in UI

I recently installed Airflow on Windows 10. I have been running it via Ubuntu. I created a new DAG python file but it is not showing up in the UI. The only DAGs that show up are the example DAGs. I tried a number of different things so far, without…
Alex M
  • 1
0
votes
0 answers

AIrflow 2.5.0 webserver not updating "code" tab

Airflow 2.5.0 is syncing the new code correct and scheduler is executing the updated code , even when some change is made , but the webserver code isn't updating at all . I already setup almost all that I find out here…
Rafael
  • 35
  • 8
0
votes
1 answer

Why my Airflow REST API returns deleted dags

I have set of REST API in Airflow , and I have multiple dags inside my dag bag, but I have deleted one dag. After that, I restarted my Airflow scheduler and web server, but I get the deleted dag as a part of result. API:…
vbala vbala
  • 15
  • 3
0
votes
0 answers

Airflow task processes keep running on kubernetes task pods

I am running airflow(2.3.2) on kubernetes cluster. Executor is set to KubernetesExecutor. Triggering a DAG creates individual pods for every task. The tasks are successfully getting triggered and completed. The status is getting updated on Airflow…
UserASR
  • 2,015
  • 4
  • 24
  • 47
1 2 3
…
10 11