You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Dragoș Moldovan-Grünfeld (Jira)" <ji...@apache.org> on 2021/10/27 12:51:01 UTC
[jira] [Comment Edited] (ARROW-14420) brew install apache-arrow
--HEAD fails due to not finding Python3 and NumPy
[ https://issues.apache.org/jira/browse/ARROW-14420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434847#comment-17434847 ]
Dragoș Moldovan-Grünfeld edited comment on ARROW-14420 at 10/27/21, 12:50 PM:
------------------------------------------------------------------------------
It doesn't seem to be working for me - I get a similar error message (below with traceback).
{code}
(base) dragos@Dragoss-MacBook-Pro dev % brew install --build-from-source ~/Documents/dev/homebrew-core/formula/apache-arrow.rb
Error: Failed to load cask: /Users/dragos/Documents/dev/homebrew-core/formula/apache-arrow.rb
Cask 'apache-arrow' is unreadable: wrong constant name #<Class:0x00007fe238283058>
Warning: Treating /Users/dragos/Documents/dev/homebrew-core/formula/apache-arrow.rb as a formula.
==> Downloading https://www.apache.org/dyn/closer.lua?path=arrow/arrow-5.0.0/apache-arrow-5.0.0.tar.gz
Already downloaded: /Users/dragos/Library/Caches/Homebrew/downloads/8ec06e04bb34c5e2d1fc05457f82a21df681be9289da4622b7ede6565e8b2c31--apache-arrow-5.0.0.tar.gz
==> cmake ../cpp -DCMAKE_FIND_PACKAGE_PREFER_CONFIG=TRUE -DARROW_FLIGHT=ON -DARROW_GANDIVA=ON -DARROW_JEMALLOC=ON -DARROW_ORC=ON -DARROW_PARQUET=O
Last 15 lines from /Users/dragos/Library/Logs/Homebrew/apache-arrow/01.cmake:
-- Checking support for TlsCredentialsOptions (gRPC >= 1.36)...
-- Found approximate gRPC version: 1.36 (ARROW_FLIGHT_REQUIRE_TLSCREDENTIALSOPTIONS=)
CMake Error at /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Could NOT find Python3 (missing: Python3_NumPy_INCLUDE_DIRS NumPy) (found
version "3.9.7")
Call Stack (most recent call first):
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython/Support.cmake:3166 (find_package_handle_standard_args)
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython3.cmake:485 (include)
cmake_modules/FindPython3Alt.cmake:54 (find_package)
src/arrow/python/CMakeLists.txt:22 (find_package)
-- Configuring incomplete, errors occurred!
See also "/tmp/apache-arrow-20211027-40699-1j1oc2z/apache-arrow-5.0.0/build/CMakeFiles/CMakeOutput.log".
Do not report this issue to Homebrew/brew or Homebrew/core!
Traceback (most recent call last):
32: from /usr/local/Homebrew/Library/Homebrew/build.rb:224:in `<main>'
31: from /usr/local/Homebrew/Library/Homebrew/build.rb:124:in `install'
30: from /usr/local/Homebrew/Library/Homebrew/utils.rb:550:in `with_env'
29: from /usr/local/Homebrew/Library/Homebrew/build.rb:129:in `block in install'
28: from /usr/local/Homebrew/Library/Homebrew/formula.rb:1284:in `brew'
27: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2442:in `stage'
26: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/forwardable.rb:230:in `stage'
25: from /usr/local/Homebrew/Library/Homebrew/resource.rb:96:in `stage'
24: from /usr/local/Homebrew/Library/Homebrew/resource.rb:121:in `unpack'
23: from /usr/local/Homebrew/Library/Homebrew/resource.rb:208:in `mktemp'
22: from /usr/local/Homebrew/Library/Homebrew/mktemp.rb:63:in `run'
21: from /usr/local/Homebrew/Library/Homebrew/mktemp.rb:63:in `chdir'
20: from /usr/local/Homebrew/Library/Homebrew/mktemp.rb:63:in `block in run'
19: from /usr/local/Homebrew/Library/Homebrew/resource.rb:122:in `block in unpack'
18: from /usr/local/Homebrew/Library/Homebrew/download_strategy.rb:102:in `stage'
17: from /usr/local/Homebrew/Library/Homebrew/download_strategy.rb:115:in `chdir'
16: from /usr/local/Homebrew/Library/Homebrew/download_strategy.rb:115:in `chdir'
15: from /usr/local/Homebrew/Library/Homebrew/resource.rb:126:in `block (2 levels) in unpack'
14: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2462:in `block in stage'
13: from /usr/local/Homebrew/Library/Homebrew/utils.rb:550:in `with_env'
12: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2463:in `block (2 levels) in stage'
11: from /usr/local/Homebrew/Library/Homebrew/formula.rb:1291:in `block in brew'
10: from /usr/local/Homebrew/Library/Homebrew/build.rb:134:in `block (2 levels) in install'
9: from /usr/local/Homebrew/Library/Homebrew/utils.rb:550:in `with_env'
8: from /usr/local/Homebrew/Library/Homebrew/build.rb:172:in `block (3 levels) in install'
7: from /Users/dragos/Documents/dev/homebrew-core/formula/apache-arrow.rb:66:in `install'
6: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2357:in `mkdir'
5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/fileutils.rb:128:in `cd'
4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/fileutils.rb:128:in `chdir'
3: from /Users/dragos/Documents/dev/homebrew-core/formula/apache-arrow.rb:67:in `block in install'
2: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2233:in `system'
1: from /usr/local/Homebrew/Library/Homebrew/formula.rb:2233:in `open'
/usr/local/Homebrew/Library/Homebrew/formula.rb:2297:in `block in system': Failed executing: cmake ../cpp -DCMAKE_INSTALL_PREFIX=/usr/local/Cellar/apache-arrow/5.0.0_4 -DCMAKE_INSTALL_LIBDIR=lib -DCMAKE_BUILD_TYPE=Release -DCMAKE_FIND_FRAMEWORK=LAST -DCMAKE_VERBOSE_MAKEFILE=ON -Wno-dev -DBUILD_TESTING=OFF -DCMAKE_OSX_SYSROOT=/Library/Developer/CommandLineTools/SDKs/MacOSX11.sdk -DCMAKE_FIND_PACKAGE_PREFER_CONFIG=TRUE -DARROW_FLIGHT=ON -DARROW_GANDIVA=ON -DARROW_JEMALLOC=ON -DARROW_ORC=ON -DARROW_PARQUET=ON -DARROW_PLASMA=ON -DARROW_PROTOBUF_USE_SHARED=ON -DARROW_PYTHON=ON -DARROW_WITH_BZ2=ON -DARROW_WITH_ZLIB=ON -DARROW_WITH_ZSTD=ON -DARROW_WITH_LZ4=ON -DARROW_WITH_SNAPPY=ON -DARROW_WITH_BROTLI=ON -DARROW_WITH_UTF8PROC=ON -DARROW_INSTALL_NAME_RPATH=OFF -DPython3_EXECUTABLE=/usr/local/opt/python@3.9/bin/python3 -DARROW_MIMALLOC=ON (BuildError)
5: from /usr/local/Homebrew/Library/Homebrew/brew.rb:143:in `<main>'
4: from /usr/local/Homebrew/Library/Homebrew/brew.rb:155:in `rescue in <main>'
3: from /usr/local/Homebrew/Library/Homebrew/exceptions.rb:539:in `dump'
2: from /usr/local/Homebrew/Library/Homebrew/exceptions.rb:485:in `issues'
1: from /usr/local/Homebrew/Library/Homebrew/exceptions.rb:489:in `fetch_issues'
/usr/local/Homebrew/Library/Homebrew/utils/github.rb:60:in `issues_for_formula': undefined method `full_name' for nil:NilClass (NoMethodError)
{code}
was (Author: dragosmg):
It doesn't seem to be working for me - I get a similar error message.
> brew install apache-arrow --HEAD fails due to not finding Python3 and NumPy
> ---------------------------------------------------------------------------
>
> Key: ARROW-14420
> URL: https://issues.apache.org/jira/browse/ARROW-14420
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Developer Tools, Python
> Reporter: Dragoș Moldovan-Grünfeld
> Priority: Major
>
> For me this fails both on Intel and Apple silicone Macs, with similar error messages. It appears that what is in the brew formula alone is not sufficient to get an environment setup and built (via brew). Do we need to declare the numpy dependency here so that brew knows to install it in the version of python that it will be using in the build process later? Or specify this elswhere? (note ARROW-8998 would remove this dependency I believe, but it's not yet done).
> {code}
> (base) dragos@Dragoss-MacBook-Pro r % brew install apache-arrow --HEAD
> ==> Cloning https://github.com/apache/arrow.git
> Updating /Users/dragos/Library/Caches/Homebrew/apache-arrow--git
> From https://github.com/apache/arrow
> 29892ba5c..65c131321 master -> origin/master
> ==> Checking out branch master
> Already on 'master'
> Your branch is behind 'origin/master' by 20 commits, and can be fast-forwarded.
> (use "git pull" to update your local branch)
> HEAD is now at 65c131321 ARROW-14417: [R] Joins ignore projection on left dataset
> Entering 'cpp/submodules/parquet-testing'
> Entering 'testing'
> /Users/dragos/Library/Caches/Homebrew/apache-arrow--git/cpp/submodules/parquet-testing
> /Users/dragos/Library/Caches/Homebrew/apache-arrow--git/testing
> ==> cmake ../cpp -DCMAKE_FIND_PACKAGE_PREFER_CONFIG=TRUE -DARROW_FLIGHT=ON -DARROW_GANDIVA=ON -DARROW_JEMALLOC=ON -DARROW_ORC=ON -DARROW_PARQUET=ON -DARROW_PLASMA=ON -DARROW_PROTOBUF_US
> Last 15 lines from /Users/dragos/Library/Logs/Homebrew/apache-arrow/01.cmake:
> -- Found approximate gRPC version: 1.36 (ARROW_FLIGHT_REQUIRE_TLSCREDENTIALSOPTIONS=)
> CMake Error at /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
> Could NOT find Python3 (missing: Python3_NumPy_INCLUDE_DIRS NumPy) (found
> version "3.9.7")
> Call Stack (most recent call first):
> /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
> /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython/Support.cmake:3166 (find_package_handle_standard_args)
> /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython3.cmake:485 (include)
> cmake_modules/FindPython3Alt.cmake:54 (find_package)
> src/arrow/python/CMakeLists.txt:22 (find_package)
> -- Configuring incomplete, errors occurred!
> See also "/tmp/apache-arrow-20211021-75909-1pqubs7/build/CMakeFiles/CMakeOutput.log".
> See also "/tmp/apache-arrow-20211021-75909-1pqubs7/build/CMakeFiles/CMakeError.log".
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)