[jira] [Created] (ARROW-6766) libarrow_python..dylib does not exist

["Tarek Allam (Jira)" <ji...@apache.org>]

Tarek Allam created ARROW-6766:
----------------------------------

             Summary: libarrow_python..dylib does not exist
                 Key: ARROW-6766
                 URL: https://issues.apache.org/jira/browse/ARROW-6766
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.14.0, 0.15.0
            Reporter: Tarek Allam


{{After following the instructions found on the developer guides for Python, I was}}
{{able to build fine by using:}}

{{# Assuming immediately prior one has run:}}
{{# $ git clone git@github.com:apache/arrow.git}}
{{# $ conda create -y -n pyarrow-dev -c conda-forge \}}
{{# --file arrow/ci/conda_env_unix.yml \}}
{{# --file arrow/ci/conda_env_cpp.yml \}}
{{# --file arrow/ci/conda_env_python.yml \}}
{{# compilers \}}
{{# python=3.7}}
{{# $ conda activate pyarrow-dev}}
{{# $ brew update && brew bundle --file=arrow/cpp/Brewfile}}{{export ARROW_HOME=$(pwd)/arrow/dist}}
{{export LD_LIBRARY_PATH=$(pwd)/arrow/dist/lib:$LD_LIBRARY_PATH}}{{export CC=`which clang`}}
{{export CXX=`which clang++`}}{{mkdir arrow/cpp/build}}
{{pushd arrow/cpp/build}}{{cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \}}
{{ -DCMAKE_INSTALL_LIBDIR=lib \}}
{{ -DARROW_FLIGHT=OFF \}}
{{ -DARROW_GANDIVA=OFF \}}
{{ -DARROW_ORC=ON \}}
{{ -DARROW_PARQUET=ON \}}
{{ -DARROW_PYTHON=ON \}}
{{ -DARROW_PLASMA=ON \}}
{{ -DARROW_BUILD_TESTS=ON \}}
{{ ..}}
{{make -j4}}
{{make install}}
{{popd}}

But when I run:


{{pushd arrow/python}}
{{export PYARROW_WITH_FLIGHT=1}}
{{export PYARROW_WITH_GANDIVA=1}}
{{export PYARROW_WITH_ORC=1}}
{{export PYARROW_WITH_PARQUET=1}}
{{python setup.py build_ext --inplace}}
{{popd}}

I get the following errors:


{{-- Build output directory: /Users/tallamjr/Github/arrow/python/build/temp.macosx-10.9-x86_64-3.7/release}}
{{-- Found the Arrow core library: /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow.dylib}}
{{-- Found the Arrow Python library: /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python.dylib}}
{{CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow..dylib does not exist.}}{{...}}{{CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow..dylib does not exist.}}
{{CMake Error at CMakeLists.txt:230 (configure_file):}}
{{ configure_file Problem configuring file}}
{{Call Stack (most recent call first):}}
{{ CMakeLists.txt:315 (bundle_arrow_lib)}}
{{CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python..dylib does not exist.}}
{{CMake Error at CMakeLists.txt:226 (configure_file):}}
{{ configure_file Problem configuring file}}
{{Call Stack (most recent call first):}}
{{ CMakeLists.txt:320 (bundle_arrow_lib)}}
{{CMake Error: File /usr/local/anaconda3/envs/pyarrow-dev/lib/libarrow_python..dylib does not exist.}}
{{CMake Error at CMakeLists.txt:230 (configure_file):}}
{{ configure_file Problem configuring file}}
{{Call Stack (most recent call first):}}
{{ CMakeLists.txt:320 (bundle_arrow_lib)}}

 

What is quite strange is that the libraries seem to indeed be there but they
have an addition component such as `libarrow.15.dylib` .e.g:


{{$ ls -l libarrow_python.15.dylib && echo $PWD}}
{{lrwxr-xr-x 1 tallamjr staff 28 Oct 2 14:02 libarrow_python.15.dylib ->}}
{{libarrow_python.15.0.0.dylib}}
{{/Users/tallamjr/github/arrow/dist/lib}}

I guess I am not exactly sure what the issue here is but it appears to be that
the version is not captured as a variable that is used by CMAKE? I have run the
same setup on `master` (`7d18c1c`) and on `apache-arrow-0.14.0` (`a591d76`)
which both seem to produce same errors.

Apologies if this is not quite the format for JIRA issues here or perhaps if
it's not the correct platform for this, I'm very new to the project and
contributing to apache in general. Thanks

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)