You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@airflow.apache.org by /dev /local/ca <de...@gmail.com> on 2020/02/11 06:56:24 UTC
First time Airflow install - uber fail
I tried installing airflow with this command, and I got an error message.
#pip3 install
apache-airflow[postgres,aws,celery,crypto,jdbc,kubernetes,password,samba,slack,ssh,gcp]
---
I followed the installation instructions exactly, what went wrong here?
https://airflow.apache.org/docs/stable/installation.html
---
... a long list of successful feedback, and then this:
building 'psutil._psutil_linux' extension
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/psutil
gcc -pthread -Wno-unused-result -Wsign-compare
-DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall
-Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
-fexceptions -fstack-protector-strong -grecord-gcc-switches -m64
-mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection
-fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1
-DPSUTIL_VERSION=567 -DPSUTIL_LINUX=1 -I/usr/include/python3.6m -c
psutil/_psutil_common.c -o
build/temp.linux-x86_64-3.6/psutil/_psutil_common.o
psutil/_psutil_common.c:9:10: fatal error: Python.h: No such file or
directory
#include <Python.h>
^~~~~~~~~~
compilation terminated.
error: command 'gcc' failed with exit status 1
----------------------------------------
Command "/usr/bin/python3.6 -u -c "import setuptools,
tokenize;__file__='/tmp/pip-build-1jwpvsnq/psutil/setup.py';f=getattr(tokenize,
'open', open)(__file__);code=f.read().replace('\r\n',
'\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
/tmp/pip-ni_brusw-record/install-record.txt
--single-version-externally-managed --compile" failed with error code 1 in
/tmp/pip-build-1jwpvsnq/psutil/
Re: [EXTERNAL] Re: First time Airflow install - uber fail
Posted by "Michael Penhallegon (non-Celgene)" <mp...@celgene.com>.
Hi,
RHEL 8 defaults to Python3(https://developers.redhat.com/blog/2018/11/14/python-in-rhel-8/) and carries through on Fedora’s python- -> python2- package prefix fix.
Thus install dnf -y python3-devel
I will say, I find installing Airflow on python3 works fine and that is what we are running in production. Python 2.x will EOL sometime in the Spring (unless they push that deadline out AGAIN).
Thanks,
Mike
From: /dev /local/ca <de...@gmail.com>
Reply-To: "users@airflow.apache.org" <us...@airflow.apache.org>
Date: Tuesday, February 11, 2020 at 1:18 AM
To: "users@airflow.apache.org" <us...@airflow.apache.org>
Subject: [EXTERNAL] Re: First time Airflow install - uber fail
Resent-From: <mp...@celgene.com>
I'm not finding python-devel in any RHEL 8 repo. If it's in a repo anywhere, I would not know how to find.
#dnf -y install python-devel
No match for argument: python-devel
Error: Unable to find a match: python-devel
On Tue, Feb 11, 2020 at 12:05 AM Kaxil Naik <ka...@gmail.com>> wrote:
You need to install Python header files:
On Ubuntu: sudo apt-get install python-dev.
On RedHat like distros it should be sudo yum install python-devel.
On Tue, Feb 11, 2020, 12:26 /dev /local/ca <de...@gmail.com>> wrote:
I tried installing airflow with this command, and I got an error message.
#pip3 install apache-airflow[postgres,aws,celery,crypto,jdbc,kubernetes,password,samba,slack,ssh,gcp]
---
I followed the installation instructions exactly, what went wrong here?
https://airflow.apache.org/docs/stable/installation.html<https://urldefense.proofpoint.com/v2/url?u=https-3A__airflow.apache.org_docs_stable_installation.html&d=DwMFaQ&c=CZZujK3G2KuXGEKnzq-Hrg&r=0uXzZnyJ6IWUpNSvrKF3pPzS6s4J8tZe8EK1ZpAFdk4&m=eOgiRt2baD0INwIs3Fph2eKNUkz1oKLWjNCH2EN5c9o&s=JVtbbgUPnxzlbcyQo2MVxqS6AjLqNbwwlMY4WaArJ44&e=>
---
... a long list of successful feedback, and then this:
building 'psutil._psutil_linux' extension
creating build/temp.linux-x86_64-3.6
creating build/temp.linux-x86_64-3.6/psutil
gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=567 -DPSUTIL_LINUX=1 -I/usr/include/python3.6m -c psutil/_psutil_common.c -o build/temp.linux-x86_64-3.6/psutil/_psutil_common.o
psutil/_psutil_common.c:9:10: fatal error: Python.h: No such file or directory
#include <Python.h>
^~~~~~~~~~
compilation terminated.
error: command 'gcc' failed with exit status 1
----------------------------------------
Command "/usr/bin/python3.6 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-1jwpvsnq/psutil/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-ni_brusw-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-build-1jwpvsnq/psutil/
Re: First time Airflow install - uber fail
Posted by /dev /local/ca <de...@gmail.com>.
I'm not finding python-devel in any RHEL 8 repo. If it's in a repo
anywhere, I would not know how to find.
#dnf -y install python-devel
No match for argument: python-devel
Error: Unable to find a match: python-devel
On Tue, Feb 11, 2020 at 12:05 AM Kaxil Naik <ka...@gmail.com> wrote:
> You need to install Python header files:
>
> On Ubuntu: sudo apt-get install python-dev.
> On RedHat like distros it should be sudo yum install python-devel.
>
> On Tue, Feb 11, 2020, 12:26 /dev /local/ca <de...@gmail.com> wrote:
>
>> I tried installing airflow with this command, and I got an error message.
>>
>> #pip3 install
>> apache-airflow[postgres,aws,celery,crypto,jdbc,kubernetes,password,samba,slack,ssh,gcp]
>>
>> ---
>> I followed the installation instructions exactly, what went wrong here?
>>
>> https://airflow.apache.org/docs/stable/installation.html
>> ---
>> ... a long list of successful feedback, and then this:
>>
>> building 'psutil._psutil_linux' extension
>> creating build/temp.linux-x86_64-3.6
>> creating build/temp.linux-x86_64-3.6/psutil
>> gcc -pthread -Wno-unused-result -Wsign-compare
>> -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall
>> -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
>> -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64
>> -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection
>> -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1
>> -DPSUTIL_VERSION=567 -DPSUTIL_LINUX=1 -I/usr/include/python3.6m -c
>> psutil/_psutil_common.c -o
>> build/temp.linux-x86_64-3.6/psutil/_psutil_common.o
>>
>> psutil/_psutil_common.c:9:10: fatal error: Python.h: No such file or
>> directory
>> #include <Python.h>
>> ^~~~~~~~~~
>> compilation terminated.
>> error: command 'gcc' failed with exit status 1
>>
>> ----------------------------------------
>> Command "/usr/bin/python3.6 -u -c "import setuptools,
>> tokenize;__file__='/tmp/pip-build-1jwpvsnq/psutil/setup.py';f=getattr(tokenize,
>> 'open', open)(__file__);code=f.read().replace('\r\n',
>> '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
>> /tmp/pip-ni_brusw-record/install-record.txt
>> --single-version-externally-managed --compile" failed with error code 1 in
>> /tmp/pip-build-1jwpvsnq/psutil/
>>
>
Re: First time Airflow install - uber fail
Posted by Kaxil Naik <ka...@gmail.com>.
You need to install Python header files:
On Ubuntu: sudo apt-get install python-dev.
On RedHat like distros it should be sudo yum install python-devel.
On Tue, Feb 11, 2020, 12:26 /dev /local/ca <de...@gmail.com> wrote:
> I tried installing airflow with this command, and I got an error message.
>
> #pip3 install
> apache-airflow[postgres,aws,celery,crypto,jdbc,kubernetes,password,samba,slack,ssh,gcp]
>
> ---
> I followed the installation instructions exactly, what went wrong here?
>
> https://airflow.apache.org/docs/stable/installation.html
> ---
> ... a long list of successful feedback, and then this:
>
> building 'psutil._psutil_linux' extension
> creating build/temp.linux-x86_64-3.6
> creating build/temp.linux-x86_64-3.6/psutil
> gcc -pthread -Wno-unused-result -Wsign-compare
> -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall
> -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS
> -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64
> -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection
> -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1
> -DPSUTIL_VERSION=567 -DPSUTIL_LINUX=1 -I/usr/include/python3.6m -c
> psutil/_psutil_common.c -o
> build/temp.linux-x86_64-3.6/psutil/_psutil_common.o
>
> psutil/_psutil_common.c:9:10: fatal error: Python.h: No such file or
> directory
> #include <Python.h>
> ^~~~~~~~~~
> compilation terminated.
> error: command 'gcc' failed with exit status 1
>
> ----------------------------------------
> Command "/usr/bin/python3.6 -u -c "import setuptools,
> tokenize;__file__='/tmp/pip-build-1jwpvsnq/psutil/setup.py';f=getattr(tokenize,
> 'open', open)(__file__);code=f.read().replace('\r\n',
> '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record
> /tmp/pip-ni_brusw-record/install-record.txt
> --single-version-externally-managed --compile" failed with error code 1 in
> /tmp/pip-build-1jwpvsnq/psutil/
>