You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andrew Wieteska (Jira)" <ji...@apache.org> on 2020/11/11 06:34:00 UTC
[jira] [Comment Edited] (ARROW-9791) [Python]
PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64
[ https://issues.apache.org/jira/browse/ARROW-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229775#comment-17229775 ]
Andrew Wieteska edited comment on ARROW-9791 at 11/11/20, 6:33 AM:
-------------------------------------------------------------------
In the failed attempt I installed Arrow C++ using this script:
{code:java}
export ARROW_HOME=$(pwd)/dist
mkdir -p cpp/build
pushd cpp/build
rm -rf *
cmake \
-DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
-DCMAKE_INSTALL_LIBDIR=lib \
-DARROW_WITH_BZ2=ON \
-DARROW_WITH_ZLIB=ON \
-DARROW_WITH_ZSTD=ON \
-DARROW_WITH_LZ4=ON \
-DARROW_WITH_SNAPPY=ON \
-DARROW_WITH_BROTLI=ON \
-DARROW_PARQUET=ON \
-DARROW_PYTHON=ON \
..
make -j4
make install
{code}
I then tried to install pyarrow (and hit the error) with
{code:java}
pushd python
export PYARROW_WITH_PARQUET=1
python setup.py build_ext --inplace
popd
{code}
was (Author: arw2019):
In the failed attempt I installed Arrow C++ using this script:
{code:java}
export ARROW_HOME=$(pwd)/dist
mkdir -p cpp/build
pushd cpp/build
rm -rf *
cmake \
-DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
-DCMAKE_INSTALL_LIBDIR=lib \
-DARROW_WITH_BZ2=ON \
-DARROW_WITH_ZLIB=ON \
-DARROW_WITH_ZSTD=ON \
-DARROW_WITH_LZ4=ON \
-DARROW_WITH_SNAPPY=ON \
-DARROW_WITH_BROTLI=ON \
-DARROW_PARQUET=ON \
-DARROW_PYTHON=ON \
..
make -j4
make install
{code}
I then tried to install pyarrow (and hit the error) with
{code:java}
pushd python
export PYARROW_WITH_PARQUET=1
python setup.py build_ext --inplace
popd
{code}
> [Python] PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64
> -----------------------------------------------------------
>
> Key: ARROW-9791
> URL: https://issues.apache.org/jira/browse/ARROW-9791
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Kouhei Sutou
> Assignee: Kouhei Sutou
> Priority: Major
>
> From ARROW-9744:
> Just tuning back in. Tried out the workaround, and received this:
>
> {code:java}
> -- Looking for python3.8
> -- Found Python lib /usr/local/lib/libpython3.8.so
> -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29")
> -- Could NOT find Arrow (missing: Arrow_DIR)
> -- Checking for module 'arrow'
> -- No package 'arrow' found
> CMake Error at /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
> Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
> ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
> Call Stack (most recent call first):
> /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
> cmake_modules/FindArrow.cmake:412 (find_package_handle_standard_args)
> cmake_modules/FindArrowPython.cmake:46 (find_package)
> CMakeLists.txt:210 (find_package)
> -- Configuring incomplete, errors occurred!
> See also "/tmp/pip-install-av0q_7o5/pyarrow/build/temp.linux-aarch64-3.8/CMakeFiles/CMakeOutput.log".
> error: command 'cmake' failed with exit status 1
> ----------------------------------------
> ERROR: Failed building wheel for pyarrow
> Failed to build pyarrow
> ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly
> The command '/bin/sh -c PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow' returned a non-zero code: 1
> {code}
>
> Failing Dockerfile on an ARMv8 system:
> {code:java}
> FROM python:3.8-buster
> RUN apt update
> RUN apt -y install gcc g++ cmake
> RUN PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)