[jira] [Created] (ARROW-10218) [Python] [C++] Errors when building pyarrow from source

["Andrew Wieteska (Jira)" <ji...@apache.org>]

Andrew Wieteska created ARROW-10218:
---------------------------------------

             Summary: [Python] [C++] Errors when building pyarrow from source
                 Key: ARROW-10218
                 URL: https://issues.apache.org/jira/browse/ARROW-10218
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: Andrew Wieteska


Not 100% sure this is the right place for this (maybe users/devs mailing lists would be better?)

In any case, I've recently been having trouble building pyarrow from source and I'm not sure where to debug. I use the following script (which worked fine until the last week or so):

 
{code:java}
export ARROW_HOME=$CONDA_PREFIX
cd cpp/build
cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
 -DCMAKE_INSTALL_LIBDIR=lib \
 -DARROW_WITH_BZ2=ON \
 -DARROW_WITH_ZLIB=ON \
 -DARROW_WITH_ZSTD=ON \
 -DARROW_WITH_LZ4=ON \
 -DARROW_WITH_SNAPPY=ON \
 -DARROW_WITH_BROTLI=ON \
 -DARROW_PARQUET=ON \
 -DARROW_PYTHON3=ON \
 -DARROW_IPC=ON \
 -DARROW_BUILD_TESTS=ON \
 ..
make -j4
sudo make install

cd ../../python
export PYARROW_WITH_PARQUET=1
python setup.py build_ext --inplace
cd ..
{code}
and on current master (Oct 7th '20) I get this error:

 
{code:java}
[ 5%] Compiling Cython CXX source for _fs...
[ 5%] Built target _fs_pyx
Scanning dependencies of target _fs
[ 11%] Building CXX object CMakeFiles/_fs.dir/_fs.cpp.o
/home/andrew/git_repo/arrow/python/build/temp.linux-x86_64-3.7/_fs.cpp:700:10: fatal error: arrow/python/ipc.h: No such file or directory
 #include "arrow/python/ipc.h"
 ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [CMakeFiles/_fs.dir/build.make:82: CMakeFiles/_fs.dir/_fs.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:138: CMakeFiles/_fs.dir/all] Error 2
make: *** [Makefile:103: all] Error 2
error: command 'cmake' failed with exit status 2
{code}
 

I'm pretty sure this is an issue with the local toolchain because I've pushed to a Python PR since this happened and CI is green. 

I appreciate any hints on how to go about solving this!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)