I have set up a airflow 2.5.1, using docker compose in an EC2. I have already migrated all connections from my previous airflow 1.10, and installed most of the packages. But i have some problems with some connections. I have installed each in scheduler, worker and webserver.
For HDFS connection, I have installed; pip install snakebite-py3 pip install apache-airflow-providers-apache-hdfs but installation ends in error, as pip only state package sub-process problem
For Snowflake connection, I have installed; pip install apache-airflow-providers-snowflake, pip install apache-airflow-providers-common-sql, pip install snowflake-connector-python, pip install snowflake-sqlalchemy, But it still wont appear in the connection type list
For Hive Client Wrapper, Hive Server 2 Thrift, Hive Metastore Thrift pip install apache-airflow-providers-apache-hive pip install apache-airflow-providers-apache-hive[amazon] pip install thrift_hive_metastore but all installation ends in error, as pip only state package sub-process problem
Error:
Requirement already satisfied: pure-sasl>=0.6.2 in /home/airflow/.local/lib/python3.7/site-packages (from thrift-sasl>=0.1.0->pyhive[hive]>=0.6.0->apache-airflow-providers-apache-hive->apache-airflow[hive]) (0.6.2) Building wheels for collected packages: sasl Building wheel for sasl (setup.py) ... error error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [26 lines of output] running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.7 creating build/lib.linux-x86_64-3.7/sasl copying sasl/init.py -> build/lib.linux-x86_64-3.7/sasl running egg_info writing sasl.egg-info/PKG-INFO writing dependency_links to sasl.egg-info/dependency_links.txt writing requirements to sasl.egg-info/requires.txt writing top-level names to sasl.egg-info/top_level.txt reading manifest file 'sasl.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' adding license file 'LICENSE.txt' writing manifest file 'sasl.egg-info/SOURCES.txt' copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-3.7/sasl copying sasl/saslwrapper.h -> build/lib.linux-x86_64-3.7/sasl copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-3.7/sasl running build_ext building 'sasl.saslwrapper' extension creating build/temp.linux-x86_64-3.7 creating build/temp.linux-x86_64-3.7/sasl gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Isasl -I/usr/local/include/python3.7m -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-3.7/sasl/saslwrapper.o unable to execute 'gcc': Permission denied error: command 'gcc' failed with exit status 1 [end of output]
Other packages are fine after installation, example, docker, mssql, mongodb etc...
Can anyone help?
Thanks in advance
