You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Andrew Wieteska (Jira)" <ji...@apache.org> on 2020/11/11 03:41:00 UTC

[jira] [Commented] (ARROW-9791) [Python] PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64

    [ https://issues.apache.org/jira/browse/ARROW-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229702#comment-17229702 ] 

Andrew Wieteska commented on ARROW-9791:
----------------------------------------

Getting on MacOS Catalina. Attempting the build with the instructions in the dev docs:

 
{noformat}
(pyarrow-dev) andrewwieteska@x86_64-apple-darwin13 python % python setup.py build_ext --inplace
running build_ext
-- Running cmake for pyarrow
cmake -DPYTHON_EXECUTABLE=/Users/andrewwieteska/anaconda3/envs/pyarrow-dev/bin/python -DPython3_EXECUTABLE=/Users/andrewwieteska/anaconda3/envs/pyarrow-dev/bin/python -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=on -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /Users/andrewwieteska/repos/arrow/python
-- System processor: x86_64
-- Arrow build warning level: PRODUCTION
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Generator: Unix Makefiles
-- Build output directory: /Users/andrewwieteska/repos/arrow/python/build/temp.macosx-10.9-x86_64-3.7/release
CMake Warning (dev) at /Users/andrewwieteska/anaconda3/envs/pyarrow-dev/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:273 (message):
 The package name passed to `find_package_handle_standard_args` (PkgConfig)
 does not match the name of the calling package (Arrow). This can lead to
 problems in calling code that expects `find_package` result variables
 (e.g., `_FOUND`) to follow a certain pattern.
Call Stack (most recent call first):
 /Users/andrewwieteska/anaconda3/envs/pyarrow-dev/share/cmake-3.18/Modules/FindPkgConfig.cmake:59 (find_package_handle_standard_args)
 cmake_modules/FindArrow.cmake:39 (include)
 cmake_modules/FindArrowPython.cmake:46 (find_package)
 CMakeLists.txt:216 (find_package)
This warning is for project developers. Use -Wno-dev to suppress it.
-- Could NOT find Arrow (missing: Arrow_DIR)
-- Checking for module 'arrow'
-- No package 'arrow' found
CMake Error at /Users/andrewwieteska/anaconda3/envs/pyarrow-dev/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:165 (message):
 Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
 ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
Call Stack (most recent call first):
 /Users/andrewwieteska/anaconda3/envs/pyarrow-dev/share/cmake-3.18/Modules/FindPackageHandleStandardArgs.cmake:458 (_FPHSA_FAILURE_MESSAGE)
 cmake_modules/FindArrow.cmake:419 (find_package_handle_standard_args)
 cmake_modules/FindArrowPython.cmake:46 (find_package)
 CMakeLists.txt:216 (find_package)

-- Configuring incomplete, errors occurred!
See also "/Users/andrewwieteska/repos/arrow/python/build/temp.macosx-10.9-x86_64-3.7/CMakeFiles/CMakeOutput.log".
See also "/Users/andrewwieteska/repos/arrow/python/build/temp.macosx-10.9-x86_64-3.7/CMakeFiles/CMakeError.log".
error: command 'cmake' failed with exit status 1
(pyarrow-dev) andrewwieteska@x86_64-apple-darwin13 python %
{noformat}
 

> [Python] PYARROW_BUNDLE_ARROW_CPP=1 doesn't work on aarch64
> -----------------------------------------------------------
>
>                 Key: ARROW-9791
>                 URL: https://issues.apache.org/jira/browse/ARROW-9791
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>            Reporter: Kouhei Sutou
>            Assignee: Kouhei Sutou
>            Priority: Major
>
> From ARROW-9744:
> Just tuning back in. Tried out the workaround, and received this:
>  
> {code:java}
> -- Looking for python3.8
>  -- Found Python lib /usr/local/lib/libpython3.8.so
>  -- Found PkgConfig: /usr/bin/pkg-config (found version "0.29")
>  -- Could NOT find Arrow (missing: Arrow_DIR)
>  -- Checking for module 'arrow'
>  -- No package 'arrow' found
>  CMake Error at /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
>  Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
>  ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
>  Call Stack (most recent call first):
>  /usr/share/cmake-3.13/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
>  cmake_modules/FindArrow.cmake:412 (find_package_handle_standard_args)
>  cmake_modules/FindArrowPython.cmake:46 (find_package)
>  CMakeLists.txt:210 (find_package)
>  -- Configuring incomplete, errors occurred!
>  See also "/tmp/pip-install-av0q_7o5/pyarrow/build/temp.linux-aarch64-3.8/CMakeFiles/CMakeOutput.log".
>  error: command 'cmake' failed with exit status 1
>  ----------------------------------------
>  ERROR: Failed building wheel for pyarrow
> Failed to build pyarrow
> ERROR: Could not build wheels for pyarrow which use PEP 517 and cannot be installed directly
> The command '/bin/sh -c PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow' returned a non-zero code: 1
> {code}
>  
> Failing Dockerfile on an ARMv8 system:
> {code:java}
> FROM python:3.8-buster
> RUN apt update
> RUN apt -y install gcc g++ cmake
> RUN PYARROW_CMAKE_OPTIONS="-DARROW_ARMV8_ARCH=armv8-a" pip install pyarrow
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)