You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Michael Anselmi (JIRA)" <ji...@apache.org> on 2019/07/08 12:10:00 UTC

[jira] [Created] (ARROW-5874) pyarrow 0.14.0 macOS wheels appear to depend on shared libs under /usr/local/opt

Michael Anselmi created ARROW-5874:
--------------------------------------

             Summary: pyarrow 0.14.0 macOS wheels appear to depend on shared libs under /usr/local/opt
                 Key: ARROW-5874
                 URL: https://issues.apache.org/jira/browse/ARROW-5874
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.14.0
         Environment: macOS 10.14.5
Anaconda Python 3.7.3
            Reporter: Michael Anselmi


Hello, and congrats on the recent release of Apache Arrow 0.14.0!

This morning I installed pyarrow 0.14.0 on my macOS 10.14.5 system like so:

 
{code:java}
python3.7 -m venv ~/virtualenv/pyarrow-0.14.0
source ~/virtualenv/pyarrow-0.14.0/bin/activate
pip install --upgrade -- pip setuptools
pip install pyarrow  # installs pyarrow-0.14.0-cp37-cp37m-macosx_10_6_intel.whl

pip freeze --all
# numpy==1.16.4
# pip==19.1.1
# pyarrow==0.14.0
# setuptools==41.0.1
# six==1.12.0
{code}
However I am unable to import pyarrow:

 

 
{code:java}
python -c 'import pyarrow'
# Traceback (most recent call last):
#   File "<string>", line 1, in <module>
#   File "/Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/__init__.py", line 49, in <module>
#     from pyarrow.lib import cpu_count, set_cpu_count
# ImportError: dlopen(/Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/lib.cpython-37m-darwin.so, 2): Library not loaded: /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib
#   Referenced from: /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow.14.dylib
#   Reason: image not found
{code}
 

pyarrow is trying to load a shared library from a path under /usr/local/opt that doesn't exist.  This makes the pyarrow 0.14.0 wheel completely unusable on my system.

Additional diagnostic output below.  I ran {{otool -L}} on each .dylib and .so file in /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow and included the output for those with dependencies under /usr/local/opt:

 
{code:java}
otool -L /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow.14.dylib
# /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow.14.dylib:
#         @rpath/libarrow.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.8)
#         @rpath/libarrow_boost_system.dylib (compatibility version 0.0.0, current version 0.0.0)
#         @rpath/libarrow_boost_filesystem.dylib (compatibility version 0.0.0, current version 0.0.0)
#         @rpath/libarrow_boost_regex.dylib (compatibility version 0.0.0, current version 0.0.0)
#         /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 307.5.0)
#         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2)


otool -L /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow_flight.14.dylib
# /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow_flight.14.dylib:
#         @rpath/libarrow_flight.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         @rpath/libarrow.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 307.5.0)
#         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2)

otool -L /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow_python.14.dylib
# /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libarrow_python.14.dylib:
#         @rpath/libarrow_python.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2)
#         /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation (compatibility version 150.0.0, current version 1349.64.0)
#         @rpath/libarrow_flight.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         @rpath/libarrow.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 307.5.0)

otool -L /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libgandiva.14.dylib
# /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libgandiva.14.dylib:
#         @rpath/libgandiva.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         @rpath/libarrow.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.8)
#         /usr/lib/libncurses.5.4.dylib (compatibility version 5.4.0, current version 5.4.0)
#         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2)
#         /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 307.5.0)

otool -L /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libplasma.14.dylib
# /Users/manselmi/virtualenv/pyarrow-0.14.0/lib/python3.7/site-packages/pyarrow/libplasma.14.dylib:
#         @rpath/libplasma.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         @rpath/libarrow.14.dylib (compatibility version 14.0.0, current version 14.0.0)
#         /usr/local/opt/openssl/lib/libssl.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/local/opt/openssl/lib/libcrypto.1.0.0.dylib (compatibility version 1.0.0, current version 1.0.0)
#         /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 307.5.0)
#         /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.50.2)
{code}
 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)