You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/03/13 22:41:56 UTC
[GitHub] [airflow] klazaj opened a new issue #22228: Installing Apache Hive provider package results in sasl error
klazaj opened a new issue #22228:
URL: https://github.com/apache/airflow/issues/22228
### Apache Airflow version
2.2.4 (latest released)
### What happened
I'm trying to add Hive Connection using the apache-hive provider from airflow.
`RUN pip3 install --no-cache-dir apache-airflow-providers-apache-hive==2.3.0`
it results in an error:
```
Building wheel for sasl (setup.py): started
Building wheel for sasl (setup.py): finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /usr/local/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ohtsw15a
cwd: /tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/
Complete output (26 lines):
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.7
creating build/lib.linux-x86_64-3.7/sasl
copying sasl/__init__.py -> build/lib.linux-x86_64-3.7/sasl
running egg_info
writing sasl.egg-info/PKG-INFO
writing dependency_links to sasl.egg-info/dependency_links.txt
writing requirements to sasl.egg-info/requires.txt
writing top-level names to sasl.egg-info/top_level.txt
reading manifest file 'sasl.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE.txt'
writing manifest file 'sasl.egg-info/SOURCES.txt'
copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-3.7/sasl
copying sasl/saslwrapper.h -> build/lib.linux-x86_64-3.7/sasl
copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-3.7/sasl
running build_ext
building 'sasl.saslwrapper' extension
creating build/temp.linux-x86_64-3.7
creating build/temp.linux-x86_64-3.7/sasl
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Isasl -I/usr/local/include/python3.7m -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-3.7/sasl/saslwrapper.o
unable to execute 'gcc': No such file or directory
error: command 'gcc' failed with exit status 1
----------------------------------------
ERROR: Failed building wheel for sasl
Running setup.py clean for sasl
Building wheel for pyhive (setup.py): started
Building wheel for pyhive (setup.py): finished with status 'done'
Created wheel for pyhive: filename=PyHive-0.6.5-py3-none-any.whl size=51574 sha256=968710edee6b9cf14452f8cb8afae35a192d3d2d4b1fec8afcc89cc3e9cd0347
Stored in directory: /tmp/pip-ephem-wheel-cache-ih9zbbs8/wheels/5e/89/eb/d5871485edc5db37f651909a8713501b2ba4d400b52816f271
Building wheel for pure-sasl (setup.py): started
Building wheel for pure-sasl (setup.py): finished with status 'done'
Created wheel for pure-sasl: filename=pure_sasl-0.6.2-py3-none-any.whl size=11443 sha256=5237949f406e0cf98060d806cc7f2c05aeaae665bdb519eb5be8d17a2cb6a015
Stored in directory: /tmp/pip-ephem-wheel-cache-ih9zbbs8/wheels/60/6d/c4/eeb9f5eae120dce84399f49fc92b447f5b9c2788217aee3209
Successfully built thrift pyhive pure-sasl
Failed to build sasl
Installing collected packages: thrift, pure-sasl, thrift-sasl, sasl, pyhive, hmsclient, apache-airflow-providers-apache-hive
Running setup.py install for sasl: started
Running setup.py install for sasl: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: /usr/local/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-zzc1wx3h/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/airflow/.local/include/python3.7m/sasl
cwd: /tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/
Complete output (28 lines):
running install
/home/airflow/.local/lib/python3.7/site-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
setuptools.SetuptoolsDeprecationWarning,
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.7
creating build/lib.linux-x86_64-3.7/sasl
copying sasl/__init__.py -> build/lib.linux-x86_64-3.7/sasl
running egg_info
writing sasl.egg-info/PKG-INFO
writing dependency_links to sasl.egg-info/dependency_links.txt
writing requirements to sasl.egg-info/requires.txt
writing top-level names to sasl.egg-info/top_level.txt
reading manifest file 'sasl.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE.txt'
writing manifest file 'sasl.egg-info/SOURCES.txt'
copying sasl/saslwrapper.cpp -> build/lib.linux-x86_64-3.7/sasl
copying sasl/saslwrapper.h -> build/lib.linux-x86_64-3.7/sasl
copying sasl/saslwrapper.pyx -> build/lib.linux-x86_64-3.7/sasl
running build_ext
building 'sasl.saslwrapper' extension
creating build/temp.linux-x86_64-3.7
creating build/temp.linux-x86_64-3.7/sasl
gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Isasl -I/usr/local/include/python3.7m -c sasl/saslwrapper.cpp -o build/temp.linux-x86_64-3.7/sasl/saslwrapper.o
unable to execute 'gcc': No such file or directory
error: command 'gcc' failed with exit status 1
----------------------------------------
ERROR: Command errored out with exit status 1: /usr/local/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hz7mix5i/sasl_6bf120bbc77044dc8d7584de06a0a0b1/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-zzc1wx3h/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/airflow/.local/include/python3.7m/sasl Check the logs for full command output.
WARNING: You are using pip version 21.3.1; however, version 22.0.4 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
```
I tried adding the packages manually too, but same error arises.
### What you expected to happen
_No response_
### How to reproduce
Create a sample Dockerfile:
```
FROM apache/airflow:2.2.4
USER root
RUN apt-get update \
&& apt-get install -y --no-install-recommends \
libxt-dev \
default-jdk \
libsasl2-dev \
libsasl2-modules-gssapi-mit \
&& apt-get autoremove -yqq --purge \
&& apt-get clean \
&& rm -rf /var/lib/apt/lists/*
USER airflow
RUN pip3 install --no-cache-dir apache-airflow-providers-docker==2.1.0
....
```
then run `docker build`
### Operating System
Debian x86_64 GNU/Linux
### Versions of Apache Airflow Providers
_No response_
### Deployment
Docker-Compose
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #22228: Installing Apache Hive provider package results in sasl error
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #22228:
URL: https://github.com/apache/airflow/issues/22228#issuecomment-1066197295
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org