Stack Overflow
Stack Overflow

Questions tagged [airflow-webserver]

161 questions
0
votes
0 answers

How do I log parameters and metrices in MLflow using Ariflow?

I am trying to log the parameters, metrices and artifacts of my model in MLflow using Airflow . I am able to log these things when I execute the python file through the terminal, however it is not logged when I run the same file through Airflow. Is…
ishandhall
  • 1
0
votes
2 answers

Airflow Dag run marked as success although the tasks didn't run

Recently, we have been getting some errors on airflow where certain dags will not run any tasks but are being marked as complete. We had the start_date using days_ago from airflow. from airflow.utils.dates import days_ago
Shivangi Singh
  • 1,001
  • 2
  • 11
  • 20
0
votes
1 answer

Authorization for Airflow 2.0 and AWS Cognito using roles

i am deploying Airflow 2.3.0 with the official helm chart and using AWS Cognito for authentication. This works so far with the following webserver_config.py: import sys from tokenize import group from airflow import configuration as conf from…
tfleischer
  • 23
  • 4
0
votes
1 answer

Apache airflow running issue in browser (favicon.ico)

I am new to apache airflow. I installed airflow locally in my laptop using Windows subsystem for linux, after installation of Python 3 pip and other Dependancies I hit command "airflow webserver -p 8080" on ubuntu terminal. Airflow starts normally,…
rahul yadav
  • 11
  • 1
0
votes
1 answer

Airflow stored in the cloud?

I would like to know if I can make the airflow UI accessible to all people who have a user, web page type. For this, I would have to connect it to a server, no? Which server do you recommend for this? I was looking around and some were using Amazon…
Rayzek19
  • 1
0
votes
2 answers

All DAGs broken after MWAA update from 2.0.2 to 2.2.2

I am getting the following errors in AWS MWAA UI after I updated from 2.0.2 to 2.2.2 I have exhaustively searched for more details on these errors to no avail from airflow.providers.slack.operators.slack_webhook import…
ab_padfoot
  • 63
  • 1
  • 10
0
votes
1 answer

My 8080 port says it's allocated when I run Airflow. I ran docker-compose ps and it showed me airflow_airflow-init_1 that has "Exit 0"

I run "docker logs airflow_airflow-init_1" and get the following result which I don't know how to interprete. I'm new to Airflow. I've already used "netstat -ona | findstr :8080 | findstr LISTENING" to find any processes that are listening and I've…
Joshua Smart-Olufemi
  • 11
  • 4
0
votes
1 answer

Undestand the Start_date of a dag

Here's my code for a simple airflow dag. Today is 2022-07-15. I run the simple_dag. The dates that start by July 12, 20:00 and so on, on top of some dagrun means what ?
QDex
  • 139
  • 9
0
votes
0 answers

Airflow - Test a TaskGroup

Is there a way to test all tasks within a TaskGroup in Airflow without running each task separately? I have multiple task groups within a dag. I don't want to test the whole dag. I also don't want to have to test the tasks individually. See below…
j7skov
  • 557
  • 7
  • 22
0
votes
1 answer

how to use up_for_reschedule with python operator

in our orchestration we are using one DAG to trigger other child dags and till these child dags not finish our master DAG is running to check the status. we used sleep of 5 min to check status of child dags after each 5 min. As this task is…
Yugdhurandhar
  • 9
  • 3
0
votes
2 answers

How to redirect a user to the airflow homepage after authentication?

I am trying to use my own SSO for airflow web. After I authenticate and authorize a person, I am lost on how to redirect this authenticated user to the airflow homepage to access the dags. I found no direct code or understanding on how to do this.…
Wei Wei Ryu
  • 3
  • 1
0
votes
2 answers

Apache Airflow Webserver Log In Failed

I realise this is a duplicate of thousands of posts across the internet, but I have only found solutions for version <2.0, and those solutions do not apply to >2.0. Basically, I have installed Apache Airflow on an Ubuntu system. Everything installed…
Vinny Pem
  • 57
  • 1
  • 6
0
votes
1 answer

Cannot copy airflow.cfg

I would like to extract the 'airflow.cfg' file from docker container to make an easy access to configuration. I tried everything but I cannot copy this particular file. The last volume creates only folder airflow.cfg ... volumes: -…
DanielPrus
  • 3
  • 2
0
votes
1 answer

Dag is not visible on Airflow UI and not show in dags list

I build a dag using this code: from airlow import DAG from airlow.operators.bash import BashOperator from datetime import datetime default_args = { 'start_date': datetime(2020, 1,1) } with DAG('parallel_dag', schedule_interval='@daily',…
Ruslan Pylypyuk
  • 47
  • 7
0
votes
1 answer

Access airflow dag run conf in UI

I have airflow 1.10.12 installed on a server and I’ve launched a dag with a trigger dag configuration which is json. I know how to access the config in my dag’s code, but I want to get it in Airflow UI. Where should I look?
ikkalinkin
  • 23
  • 7
1 2 3
…
10 11