You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "vwbusguy (via GitHub)" <gi...@apache.org> on 2023/08/01 00:50:08 UTC
[GitHub] [arrow] vwbusguy opened a new issue, #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
vwbusguy opened a new issue, #36965:
URL: https://github.com/apache/arrow/issues/36965
### Describe the bug, including details regarding any error messages, version, and platform.
Pyarrow stopped building in our CI at some point a few hours ago (though was building this morning) with error `ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects`
Container source reference: https://github.com/ucsb-pstat/pstat-174-container-image
This is based on Jupyter upstream base images for Ubuntu 22.04.
I believe this is a duplicate of #36963 but was asked to file a separate issue since this isn't FreeBSD.
```
-- Running cmake for pyarrow
cmake -DPYTHON_EXECUTABLE=/opt/conda/bin/python3.11 -DPython3_EXECUTABLE=/opt/conda/bin/python3.11 "" -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PARQUET_ENCRYPTION=off -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /tmp/pip-install-pr092oko/pyarrow_c75dd9cd7746480bb33e6fef1767af9b
-- The C compiler identification is GNU 11.4.0
-- The CXX compiler identification is GNU 11.4.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- System processor: x86_64
-- Performing Test CXX_SUPPORTS_SSE4_2
-- Performing Test CXX_SUPPORTS_SSE4_2 - Success
-- Performing Test CXX_SUPPORTS_AVX2
-- Performing Test CXX_SUPPORTS_AVX2 - Success
-- Performing Test CXX_SUPPORTS_AVX512
-- Performing Test CXX_SUPPORTS_AVX512 - Success
-- Arrow build warning level: PRODUCTION
Using ld linker
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Generator: Unix Makefiles
-- Build output directory: /tmp/pip-install-pr092oko/pyarrow_c75dd9cd7746480bb33e6fef1767af9b/build/temp.linux-x86_64-cpython-311/release
-- Found Python3: /opt/conda/bin/python3.11 (found version "3.11.4") found components: Interpreter Development.Module NumPy
-- Found Python3Alt: /opt/conda/bin/python3.11
-- Found PkgConfig: /opt/conda/bin/pkg-config (found version "0.29.2")
-- Could NOT find Arrow (missing: Arrow_DIR)
-- Checking for module 'arrow'
-- No package 'arrow' found
CMake Error at /usr/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Could NOT find Arrow (missing: ARROW_INCLUDE_DIR ARROW_LIB_DIR
ARROW_FULL_SO_VERSION ARROW_SO_VERSION)
Call Stack (most recent call first):
/usr/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindArrow.cmake:450 (find_package_handle_standard_args)
cmake_modules/FindArrowPython.cmake:46 (find_package)
CMakeLists.txt:231 (find_package)
-- Configuring incomplete, errors occurred!
See also "/tmp/pip-install-pr092oko/pyarrow_c75dd9cd7746480bb33e6fef1767af9b/build/temp.linux-x86_64-cpython-311/CMakeFiles/CMakeOutput.log".
error: command '/usr/bin/cmake' failed with exit code 1
[end of output]
```
### Component(s)
C++, Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] vwbusguy commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "vwbusguy (via GitHub)" <gi...@apache.org>.
vwbusguy commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659434241
That's a very good point. Let me do some digging.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] vwbusguy commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "vwbusguy (via GitHub)" <gi...@apache.org>.
vwbusguy commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659407811
That is exactly what we're trying to install here wrt conda (and it's been working for the past four months on the same Containerfile). mamba is just just the `conda` installer shipped in Jupyter. Are you suggesting I should submit a bug about this with conda forge instead of this project?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] vwbusguy commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "vwbusguy (via GitHub)" <gi...@apache.org>.
vwbusguy commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659456877
I just noticed that gluonts is pulling in an older version (8.0) where standalone is pulling in a newer one (12.0). `pip install pyarrow~=8.0` appears to be the problem and I think I see why. Jupyter is now on Python 3.11 and the [newest binaries for 8.0 are for 3.10](https://pypi.org/project/pyarrow/8.0.0/#files). I guess the story here is that conda-forge has a 3.11 compatible binary for its gluonts package and PyPi does not, and pyarrow 8.0 appears to be incompatible with Python 3.11.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] vwbusguy commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "vwbusguy (via GitHub)" <gi...@apache.org>.
vwbusguy commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659441303
Looks like this error is actually happening when installing gluonts, which was bringing in pyarrow. Installing pyarrow standalone seems to work just fine with either pip or conda, but it seems installing gluonts from pip tries to *build* pyarrow even if pyarrow already exists where installing it through conda-forge is content to use the existing binary.
More curious, the build this morning pulled the wheel directly:
```
Collecting pyarrow~=8.0
Downloading pyarrow-8.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (29.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 29.4/29.4 MB 289.0 MB/s eta 0:00:00
```
Where the builds as of this afternoon started pulling pyarrow in as a tar.gz. Seems like perhaps something has happened in PyPi land today and now the source is being downloaded instead of the binary?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659405061
If you want to use conda, you should use https://anaconda.org/conda-forge/pyarrow .
If you don't want to use https://anaconda.org/conda-forge/pyarrow , you can use https://anaconda.org/conda-forge/libarrow to install Apache Arrow C++.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] vwbusguy commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "vwbusguy (via GitHub)" <gi...@apache.org>.
vwbusguy commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659415061
Installing via conda gets the same error as via pip:
```
-- No package 'arrow-python' found
CMake Error at /usr/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Could NOT find ArrowPython (missing: ARROW_PYTHON_INCLUDE_DIR
ARROW_PYTHON_LIB_DIR) (found version "12.0.1")
Call Stack (most recent call first):
/usr/share/cmake-3.22/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
cmake_modules/FindArrowPython.cmake:76 (find_package_handle_standard_args)
CMakeLists.txt:231 (find_package)
-- Configuring incomplete, errors occurred!
See also "/tmp/pip-install-re2qkyh5/pyarrow_d94b37a86fab4d5883549be9791b492c/build/temp.linux-x86_64-cpython-311/CMakeFiles/CMakeOutput.log".
error: command '/usr/bin/cmake' failed with exit code 1
[end of output]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659581170
OK. I close this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] assignUser commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "assignUser (via GitHub)" <gi...@apache.org>.
assignUser commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1661157284
Thanks for the thorough investigation on your end @vwbusguy !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou closed issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou closed issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
URL: https://github.com/apache/arrow/issues/36965
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on issue #36965: [Python] ERROR: Failed building wheel for pyarrow on Linux
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #36965:
URL: https://github.com/apache/arrow/issues/36965#issuecomment-1659429906
https://anaconda.org/conda-forge/pyarrow is a binary package.
So building pyarrow from source is strange. Are you really using https://anaconda.org/conda-forge/pyarrow ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org