You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/10/02 13:29:54 UTC

[GitHub] [arrow] matteosantama opened a new issue, #14291: Help with building from source

matteosantama opened a new issue, #14291:
URL: https://github.com/apache/arrow/issues/14291

   There's a simple change I would like to make to `pyarrow` but before I open a PR I want to test it locally. To do so, I need to build the library from source -- but I am really struggling with the compilation process. 
   
   I tried following the instructions [here](https://github.com/apache/arrow/blob/master/docs/source/developers/python.rst), but kept running into problems at multiple stages. Likely, those instructions there are a bit stale. So I abandoned it in favor of the automatic build script [here](https://github.com/apache/arrow/blob/master/python/examples/minimal_build/build_venv.sh). With the script, the compilation process runs to completion but when I go to import the library I run into problems.
   
   ```python
   >>> import pyarrow as pa
   ImportError: dlopen(/Users/matteosantamaria/arrow/python/pyarrow/lib.cpython-310-darwin.so, 0x0002): Library not loaded: '@rpath/libarrow.1000.dylib'
     Referenced from: '/Users/matteosantamaria/arrow/python/pyarrow/lib.cpython-310-darwin.so'
     Reason: tried: '/Users/matteosantamaria/arrow/python/pyarrow/libarrow.1000.dylib' (no such file), '/Users/matteosantamaria/arrow/python/pyarrow/libarrow.1000.dylib' (no such file), '/usr/local/lib/libarrow.1000.dylib' (no such file), '/usr/lib/libarrow.1000.dylib' (no such file)
   ```
   
   Does anyone know what this error is complaining about? If it helps, I am on macOS M1.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] matteosantama commented on issue #14291: Help with building from source

Posted by GitBox <gi...@apache.org>.
matteosantama commented on issue #14291:
URL: https://github.com/apache/arrow/issues/14291#issuecomment-1265427239

   Woohoo, that worked!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] matteosantama closed issue #14291: Help with building from source

Posted by GitBox <gi...@apache.org>.
matteosantama closed issue #14291: Help with building from source
URL: https://github.com/apache/arrow/issues/14291


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] matteosantama commented on issue #14291: Help with building from source

Posted by GitBox <gi...@apache.org>.
matteosantama commented on issue #14291:
URL: https://github.com/apache/arrow/issues/14291#issuecomment-1264701546

   It is for pip. The script sets those variables [here](https://github.com/apache/arrow/blob/master/python/examples/minimal_build/build_venv.sh#L29-L30)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] wjones127 commented on issue #14291: Help with building from source

Posted by GitBox <gi...@apache.org>.
wjones127 commented on issue #14291:
URL: https://github.com/apache/arrow/issues/14291#issuecomment-1264673284

   Did you follow the instructions for Conda or for pip? If it was pip, you may have missed this step:
   
   ```bash
   export ARROW_HOME=$(pwd)/dist
   export LD_LIBRARY_PATH=$(pwd)/dist/lib:$LD_LIBRARY_PATH
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] wjones127 commented on issue #14291: Help with building from source

Posted by GitBox <gi...@apache.org>.
wjones127 commented on issue #14291:
URL: https://github.com/apache/arrow/issues/14291#issuecomment-1264883138

   On Mac OS, you may also need to pass this flag to 
   
   ```
   -DARROW_INSTALL_NAME_RPATH=OFF
   ```
   
   When you run cmake:
   
   ```bash
   cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
           -DCMAKE_INSTALL_LIBDIR=lib \
           -DCMAKE_BUILD_TYPE=Debug \
           -DARROW_INSTALL_NAME_RPATH=OFF \
           -DARROW_DATASET=ON \
           -DARROW_WITH_BZ2=ON \
           -DARROW_WITH_ZLIB=ON \
           -DARROW_WITH_ZSTD=ON \
           -DARROW_WITH_LZ4=ON \
           -DARROW_WITH_SNAPPY=ON \
           -DARROW_WITH_BROTLI=ON \
           -DARROW_PARQUET=ON \
           -DPARQUET_REQUIRE_ENCRYPTION=ON \
           -DARROW_PYTHON=ON \
           -DARROW_BUILD_TESTS=ON \
           ..
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org