Airflow is a platform created by the community to programmatically author, schedule and monitor workflows.
Questions tagged [apache-airflow]
5 questions
2
votes
1 answer
Airflow: Can't connect to ('0.0.0.0', 8080)
I am trying to do some stuff with Airflow.I have installed it with pip(latter in a virtual) but problem is when I want to start webserver.
airflow webserver -p 8080
[2017-07-29 12:20:45,913] [4585] {models.py:167} INFO - Filling up the DagBag from…
MishaVacic
- 123
- 1
- 1
- 4
0
votes
1 answer
Google Cloud Composer "Error: Server Error"
My Google Cloud Composer is not working since yesterday.
I can't access the airflow interface, returning:
Error: Server Error
The server encountered a temporary error and could not complete your request.
Please try again in 30 seconds.
A warning is…
0
votes
1 answer
ETL to bigquery using airflow without have permission cloud storage/ cloud sql
i have done ETL from MySql to bigQuery with python, but because i haven't permission to connect google cloud storage/ cloud sql, i must dump data and partition that by last date, this way easy but didn't worth it because take a much time, i want to…
0
votes
1 answer
Running a task in parallel in multiple machines in GCP and orchestrating it
I have a python program for scraping that needs a lot of time to run. To parallelize it, I have modified the code so that the program can run in parallel in different machines. I also created a docker image and pushed it to Dockerhub.
I tried to use…
vettipayyan
- 101
- 3
-1
votes
1 answer
How to set smtp_password in GCP Cloud Composer for configuring third-party SMTP services
I can use only G Suit SMTP mail server due to company security policy.
I want to configuring 3rd-party SMTP service for using G Suit mail service but I can't set "smtp smtp_password" config in AIRFLOW CONFIGURATION OVERRIDES tap of Cloud…
Seonghwan Lee
- 3
- 2