You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andrew Wieteska (Jira)" <ji...@apache.org> on 2020/11/11 06:34:00 UTC

[jira] [Comment Edited] (ARROW-9791) [Python] PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64

    [ https://issues.apache.org/jira/browse/ARROW-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229775#comment-17229775 ] 

Andrew Wieteska edited comment on ARROW-9791 at 11/11/20, 6:33 AM:
-------------------------------------------------------------------

In the failed attempt I installed Arrow C++ using this script:
{code:java}
export ARROW_HOME=$(pwd)/dist
mkdir -p cpp/build
pushd cpp/build
rm -rf *
cmake \
 -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
 -DCMAKE_INSTALL_LIBDIR=lib \
 -DARROW_WITH_BZ2=ON \
 -DARROW_WITH_ZLIB=ON \
 -DARROW_WITH_ZSTD=ON \
 -DARROW_WITH_LZ4=ON \
 -DARROW_WITH_SNAPPY=ON \
 -DARROW_WITH_BROTLI=ON \
 -DARROW_PARQUET=ON \
 -DARROW_PYTHON=ON \
 ..
make -j4
make install
{code}
I then tried to install pyarrow (and hit the error) with
{code:java}
pushd python 
export PYARROW_WITH_PARQUET=1 
python setup.py build_ext --inplace 
popd
{code}
 
  


was (Author: arw2019):
In the failed attempt I installed Arrow C++ using this script:

 
{code:java}
export ARROW_HOME=$(pwd)/dist
mkdir -p cpp/build
pushd cpp/build
rm -rf *
cmake \
 -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
 -DCMAKE_INSTALL_LIBDIR=lib \
 -DARROW_WITH_BZ2=ON \
 -DARROW_WITH_ZLIB=ON \
 -DARROW_WITH_ZSTD=ON \
 -DARROW_WITH_LZ4=ON \
 -DARROW_WITH_SNAPPY=ON \
 -DARROW_WITH_BROTLI=ON \
 -DARROW_PARQUET=ON \
 -DARROW_PYTHON=ON \
 ..
make -j4
make install
{code}
I then tried to install pyarrow (and hit the error) with
 
{code:java}
pushd python 
export PYARROW_WITH_PARQUET=1 
python setup.py build_ext --inplace 
popd
{code}
 
 

> [Python] PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64
> -----------------------------------------------------------
>
>                 Key: ARROW-9791
>                 URL: https://issues.apache.org/jira/browse/ARROW-9791
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>            Reporter: Kouhei Sutou
>            Assignee: Kouhei Sutou
>            Priority: Major
>
> From ARROW-9744:
> Just tuning back in. Tried out the workaround, and received this:
>  
> {code:java}
> -- Looking for python3.8
>  -- Found Python lib /usr/local/lib/libpython3.8.so
>  -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29")
>  -- Could NOT find Arrow (missing: Arrow_DIR)
>  -- Checking for module 'arrow'
>  -- No package 'arrow' found
>  CMake Error at /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
>  Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
>  ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
>  Call Stack (most recent call first):
>  /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
>  cmake_modules/FindArrow.cmake:412 (find_package_handle_standard_args)
>  cmake_modules/FindArrowPython.cmake:46 (find_package)
>  CMakeLists.txt:210 (find_package)
>  -- Configuring incomplete, errors occurred!
>  See also "/tmp/pip-install-av0q_7o5/pyarrow/build/temp.linux-aarch64-3.8/CMakeFiles/CMakeOutput.log".
>  error: command 'cmake' failed with exit status 1
>  ----------------------------------------
>  ERROR: Failed building wheel for pyarrow
> Failed to build pyarrow
> ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly
> The command '/bin/sh -c PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow' returned a non-zero code: 1
> {code}
>  
> Failing Dockerfile on an ARMv8 system:
> {code:java}
> FROM python:3.8-buster
> RUN apt update
> RUN apt -y install gcc g++ cmake
> RUN PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)