You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2021/09/10 20:34:00 UTC

[jira] [Commented] (BEAM-12874) Installing apache-beam after tensorflow on Macbook M1 fails with pyarrow error

    [ https://issues.apache.org/jira/browse/BEAM-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413378#comment-17413378 ] 

Brian Hulette commented on BEAM-12874:
--------------------------------------

I don't have a mac to repro on right now. A couple of questions that would help get to the bottom of this:
1. Could you share the CMakeOutput.log and CMakeError.log?
2. Do you get the same error if you just pip install pyarrow==4.0.1 after installing tensorflow? What about if you install pyarrow==5.0.0?

> Installing apache-beam after tensorflow on Macbook M1 fails with pyarrow error
> ------------------------------------------------------------------------------
>
>                 Key: BEAM-12874
>                 URL: https://issues.apache.org/jira/browse/BEAM-12874
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Brian Hulette
>            Priority: P2
>
> PC : MacBook Air M1
> OS : macOS 11.5.2
> _I installed Tensorflow from apple repository. (Version 0.1a3)
> I need to install apache-beam for my object-detection and i used
> pip3 install apache beam
> The command was executed.
> {code}
> _ Collecting apache-beam
> Using cached apache_beam-2.32.0-cp38-cp38-macosx_11_0_arm64.whl
> Collecting dill<0.3.2,>=0.3.1.1
> Using cached dill-0.3.1.1-py3-none-any.whl
> Collecting pyarrow<5.0.0,>=0.15.1
> Using cached pyarrow-4.0.1.tar.gz (711 kB)
> Installing build dependencies ... done
> Getting requirements to build wheel ... done
> Preparing wheel metadata ... done
> Collecting typing-extensions<3.8.0,>=3.7.0
> Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
> Collecting future<1.0.0,>=0.18.2
> Using cached future-0.18.2-py3-none-any.whl
> Requirement already satisfied: requests<3.0.0,>=2.24.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (2.26.0)
> Requirement already satisfied: grpcio<2,>=1.29.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (1.33.2)
> Collecting python-dateutil<3,>=2.8.0
> Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
> Collecting orjson<4.0
> Using cached orjson-3.6.3-cp38-cp38-macosx_10_9_x86_64.macosx_11_0_arm64.macosx_10_9_universal2.whl (434 kB)
> Collecting oauth2client<5,>=2.0.1
> Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
> Collecting hdfs<3.0.0,>=2.1.0
> Using cached hdfs-2.6.0-py3-none-any.whl (33 kB)
> Collecting crcmod<2.0,>=1.7
> Using cached crcmod-1.7-cp38-cp38-macosx_11_0_arm64.whl
> Collecting pymongo<4.0.0,>=3.8.0
> Using cached pymongo-3.12.0-cp38-cp38-macosx_11_0_arm64.whl
> Requirement already satisfied: numpy<1.21.0,>=1.14.3 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (1.18.5)
> Collecting pytz>=2018.3
> Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
> Collecting fastavro<2,>=0.21.4
> Using cached fastavro-1.4.4-cp38-cp38-macosx_11_0_arm64.whl
> Requirement already satisfied: protobuf<4,>=3.12.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from apache-beam) (3.17.3)
> Collecting avro-python3!=1.9.2,<1.10.0,>=1.8.1
> Using cached avro_python3-1.9.2.1-py3-none-any.whl
> Collecting pydot<2,>=1.2.0
> Using cached pydot-1.4.2-py2.py3-none-any.whl (21 kB)
> Collecting httplib2<0.20.0,>=0.8
> Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
> Requirement already satisfied: six>=1.5.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from grpcio<2,>=1.29.0->apache-beam) (1.16.0)
> Collecting docopt
> Using cached docopt-0.6.2-py2.py3-none-any.whl
> Requirement already satisfied: pyparsing<3,>=2.4.2 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from httplib2<0.20.0,>=0.8->apache-beam) (2.4.7)
> Requirement already satisfied: rsa>=3.1.4 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (4.7.2)
> Requirement already satisfied: pyasn1-modules>=0.0.5 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (0.2.8)
> Requirement already satisfied: pyasn1>=0.1.7 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from oauth2client<5,>=2.0.1->apache-beam) (0.4.8)
> Requirement already satisfied: idna<4,>=2.5 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (3.2)
> Requirement already satisfied: certifi>=2017.4.17 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (2021.5.30)
> Requirement already satisfied: charset-normalizer~=2.0.0 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (2.0.4)
> Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./miniforge3/envs/grpcprova/lib/python3.8/site-packages (from requests<3.0.0,>=2.24.0->apache-beam) (1.26.6)
> Building wheels for collected packages: pyarrow
> Building wheel for pyarrow (PEP 517) ... error
> {code}
> Originall reported here: https://github.com/apache/beam/pull/15449



--
This message was sent by Atlassian Jira
(v8.3.4#803005)