You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Dragoș Moldovan-Grünfeld (Jira)" <ji...@apache.org> on 2021/10/20 10:18:00 UTC
[jira] [Commented] (ARROW-14371) [R] Improve the R-only development
guide
[ https://issues.apache.org/jira/browse/ARROW-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17431112#comment-17431112 ]
Dragoș Moldovan-Grünfeld commented on ARROW-14371:
--------------------------------------------------
This seems to have turned into a Python and Numpy affair:
{code}
(base) dragos@Dragoss-MacBook-Pro ~ % brew install apache-arrow --HEAD
Updating Homebrew...
==> Auto-updated Homebrew!
Updated 2 taps (homebrew/core and homebrew/cask).
==> New Formulae
goproxy iproute2
==> Updated Formulae
Updated 35 formulae.
==> Updated Casks
Updated 39 casks.
==> Deleted Casks
hands-off magic-launch vectr
==> Cloning https://github.com/apache/arrow.git
Updating /Users/dragos/Library/Caches/Homebrew/apache-arrow--git
From https://github.com/apache/arrow
54d2bd89c..98b0e99f0 master -> origin/master
==> Checking out branch master
Already on 'master'
Your branch is behind 'origin/master' by 5 commits, and can be fast-forwarded.
(use "git pull" to update your local branch)
HEAD is now at 98b0e99f0 ARROW-13784: [Python] Table.from_arrays should raise an error when array is empty but names is not
Entering 'cpp/submodules/parquet-testing'
Entering 'testing'
/Users/dragos/Library/Caches/Homebrew/apache-arrow--git/cpp/submodules/parquet-testing
/Users/dragos/Library/Caches/Homebrew/apache-arrow--git/testing
==> cmake ../cpp -DCMAKE_FIND_PACKAGE_PREFER_CONFIG=TRUE -DARROW_FLIGHT=ON -DARROW_GANDIVA=ON -DARROW_JEMALLOC=ON -DARROW_ORC=ON -DARROW_PARQUET=ON -DARROW_PLASMA=ON -DARROW_PROTOBUF_US
Last 15 lines from /Users/dragos/Library/Logs/Homebrew/apache-arrow/01.cmake:
-- Found approximate gRPC version: 1.36 (ARROW_FLIGHT_REQUIRE_TLSCREDENTIALSOPTIONS=)
CMake Error at /usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Could NOT find Python3 (missing: Python3_NumPy_INCLUDE_DIRS NumPy) (found
version "3.9.7")
Call Stack (most recent call first):
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:594 (_FPHSA_FAILURE_MESSAGE)
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython/Support.cmake:3166 (find_package_handle_standard_args)
/usr/local/Cellar/cmake/3.21.3_1/share/cmake/Modules/FindPython3.cmake:485 (include)
cmake_modules/FindPython3Alt.cmake:54 (find_package)
src/arrow/python/CMakeLists.txt:22 (find_package)
{code}
> [R] Improve the R-only development guide
> ----------------------------------------
>
> Key: ARROW-14371
> URL: https://issues.apache.org/jira/browse/ARROW-14371
> Project: Apache Arrow
> Issue Type: Improvement
> Components: R
> Environment: MacBook Pro (13-inch, 2018, Four Thunderbolt 3 Ports) running macOS BigSur (11.6)
> Reporter: Dragoș Moldovan-Grünfeld
> Priority: Major
> Labels: documentation
> Attachments: arrow_install_error
>
>
> There are a few ways we could make the R-only development guide better (this list isn't exhaustive, but are things that have come up in the discussion here):
> * A note that the brew-based method and the build-your-own methods are incompatible (mostly because of {{ARROW_HOME}}, but folks using brew shouldn't need to even think about that, so we should be careful how we phrase this)
> * A note about confirming that {{brew install apache-arrow --HEAD}} completes successfully and how to confirm it's being picked up in the install process
> * This might be part of the point above, but a description of what the difference/meaning of the following are: {{*** Using Homebrew ${PKG_BREW_NAME}}}, {{*** Arrow C++ libraries found via pkg-config}}, any mention of {{autobrew}}. Specifically, if one is trying to use homebrew for development, only the first one is ok, if someone sees something else that means that something isn't quite right.
> Original ticket description:
> I cannot get a working install using the [R-only development instructions|https://arrow.apache.org/docs/r/articles/developing.html#r-only-development].
> Steps I took:
> 1. run brew install apache-arrow --HEAD
> 2. run unset ARROW_HOME
> 3. clone arrow repo
> 4. navigate to arrow/r
> 5. run R CMD INSTALL .
> {code:r}
> (base) dragos@Dragoss-MacBook-Pro r % R CMD INSTALL .
> * installing to library ‘/Library/Frameworks/R.framework/Versions/4.1/Resources/library’
> * installing *source* package ‘arrow’ ...
> ** using staged installation
> *** Arrow C++ libraries found via pkg-config at
> **** Warning: library version mismatch
> **** C++ is 5.0.0 but R is 5.0.0.9000
> **** If installation fails, upgrade the C++ library to match
> **** or retry with ARROW_USE_PKG_CONFIG=false
> PKG_CFLAGS=-I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON
> PKG_LIBS=-L/usr/local/Cellar/apache-arrow/5.0.0_2/lib -larrow_dataset -lparquet -larrow
> ** libs
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c RTasks.cpp -o RTasks.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c altrep.cpp -o altrep.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c array.cpp -o array.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c array_to_vector.cpp -o array_to_vector.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c arraydata.cpp -o arraydata.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c arrowExports.cpp -o arrowExports.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c buffer.cpp -o buffer.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c chunkedarray.cpp -o chunkedarray.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c compression.cpp -o compression.o
> clang++ -mmacosx-version-min=10.13 -std=gnu++11 -I"/Library/Frameworks/R.framework/Resources/include" -DNDEBUG -I/usr/local/Cellar/apache-arrow/5.0.0_2/include -DARROW_R_WITH_ARROW -DARROW_R_WITH_PARQUET -DARROW_R_WITH_DATASET -DARROW_R_WITH_JSON -I../inst/include/ -I/usr/local/include -fPIC -Wall -g -O2 -c compute-exec.cpp -o compute-exec.o
> compute-exec.cpp:25:10: fatal error: 'arrow/compute/exec/options.h' file not found
> #include <arrow/compute/exec/options.h>
> ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> 1 error generated.
> make: *** [compute-exec.o] Error 1
> ERROR: compilation failed for package ‘arrow’
> * removing ‘/Library/Frameworks/R.framework/Versions/4.1/Resources/library/arrow’
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)