You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Kandarpa (Jira)" <ji...@apache.org> on 2021/02/08 07:00:00 UTC
[jira] [Updated] (ARROW-11075) [Python] Getting reference not found
with ORC enabled pyarrow
[ https://issues.apache.org/jira/browse/ARROW-11075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kandarpa updated ARROW-11075:
-----------------------------
Attachment: cudf_buildscrip.sh
> [Python] Getting reference not found with ORC enabled pyarrow
> -------------------------------------------------------------
>
> Key: ARROW-11075
> URL: https://issues.apache.org/jira/browse/ARROW-11075
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 1.0.1
> Environment: PPC64LE
> Reporter: Kandarpa
> Priority: Major
> Attachments: arrow_cpp_build.log, arrow_python_build.log, conda_list.txt, cudf_buildscrip.sh
>
>
> Generated the pyarrow with OCR enabled on Power using following steps:
> {code:java}
> export ARROW_HOME=$CONDA_PREFIX
> mkdir cpp/build
> cd cpp/build
> cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
> -DCMAKE_INSTALL_LIBDIR=lib \
> -DARROW_WITH_BZ2=ON \
> -DARROW_WITH_ZLIB=ON \
> -DARROW_WITH_ZSTD=ON \
> -DARROW_WITH_LZ4=ON \
> -DARROW_WITH_SNAPPY=ON \
> -DARROW_WITH_BROTLI=ON \
> -DARROW_PARQUET=ON \
> -DARROW_PYTHON=ON \
> -DARROW_BUILD_TESTS=ON \
> -DARROW_CUDA=ON \
> -DCUDA_CUDA_LIBRARY=/usr/local/cuda/lib64/stubs/libcuda.so \
> -DARROW_ORC=ON \
> ..
> make -j
> make install
> cd ../../python
> python setup.py build_ext --bundle-arrow-cpp --with-orc --with-cuda --with-parquet bdist_wheel
> {code}
>
>
> With the generated whl package installed, ran CUDF tests and observed following error:
> *_ERROR cudf - ImportError: /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so: undefined symbol: _ZN5arrow8adapters3orc13OR..._*
> Please find the whole error log below:
> ================================================================================ ERRORS ================================================================================
> ____________________________________________________________________ ERROR collecting test session _____________________________________________________________________
> /conda/envs/rmm/lib/python3.7/importlib/__init__.py:127: in import_module
> return _bootstrap._gcd_import(name[level:], package, level)
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:953: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:953: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> <frozen importlib._bootstrap>:1006: in _gcd_import
> ???
> <frozen importlib._bootstrap>:983: in _find_and_load
> ???
> <frozen importlib._bootstrap>:967: in _find_and_load_unlocked
> ???
> <frozen importlib._bootstrap>:677: in _load_unlocked
> ???
> <frozen importlib._bootstrap_external>:728: in exec_module
> ???
> <frozen importlib._bootstrap>:219: in _call_with_frames_removed
> ???
> cudf/cudf/__init__.py:60: in <module>
> from cudf.io import (
> cudf/cudf/io/__init__.py:8: in <module>
> from cudf.io.orc import read_orc, read_orc_metadata, to_orc
> cudf/cudf/io/orc.py:6: in <module>
> from pyarrow import orc as orc
> /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/orc.py:24: in <module>
> import pyarrow._orc as _orc
> {color:#de350b}E ImportError: /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so: undefined symbol: _ZN5arrow8adapters3orc13ORCFileReader4ReadEPSt10shared_ptrINS_5TableEE{color}
> ======================================================================= short test summary info ========================================================================
> *_ERROR cudf - ImportError: /conda/envs/rmm/lib/python3.7/site-packages/pyarrow/_orc.cpython-37m-powerpc64le-linux-gnu.so: undefined symbol: _ZN5arrow8adapters3orc13OR..._*
> !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
> =========================================================================== 1 error in 1.54s ===========================================================================
> Fatal Python error: Segmentation fault
--
This message was sent by Atlassian Jira
(v8.3.4#803005)