You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Alenka Frim (Jira)" <ji...@apache.org> on 2022/03/28 04:54:00 UTC

[jira] [Comment Edited] (ARROW-15459) [C++] Unable to build Arrow C++ on osx arm64 inside conda env because of Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized and arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory

    [ https://issues.apache.org/jira/browse/ARROW-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513137#comment-17513137 ] 

Alenka Frim edited comment on ARROW-15459 at 3/28/22, 4:53 AM:
---------------------------------------------------------------

C++ and PyArrow builds successfully on my M1 inside conda with :
{code:java}
export ARROW_HOME=$CONDA_PREFIX
export ARROW_BUILD_TYPE=debug
export PYARROW_WITH_FLIGHT=0
export PYARROW_WITH_GANDIVA=0
export PYARROW_WITH_ORC=0
export PYARROW_WITH_PARQUET=1
export PYARROW_WITH_DATASET=0
export PYARROW_WITH_S3=0
export PYARROW_PARALLEL=4
export PYARROW_WITH_PLASMA=0

cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
      -DCMAKE_BUILD_TYPE=debug \
      -DCMAKE_INSTALL_LIBDIR=lib \
      -DARROW_WITH_BZ2=ON \
      -DARROW_WITH_ZLIB=ON \
      -DARROW_WITH_ZSTD=ON \
      -DARROW_WITH_LZ4=ON \
      -DARROW_WITH_SNAPPY=ON \
      -DARROW_WITH_BROTLI=ON \
      -DARROW_PLASMA=OFF \
      -DARROW_PARQUET=ON \
      -DARROW_PYTHON=ON \
      -DARROW_JEMALLOC=OFF \
      -DARROW_MEMALLOC=OFF \
      -DARROW_BUILD_TESTS=ON \
      -DARROW_DEPENDENCY_SOURCE=CONDA \
      -DPython3_EXECUTABLE=/opt/anaconda3/envs/pyarrow-dev-conda/bin/python \
      -DARROW_INSTALL_NAME_RPATH=OFF \
      -GNinja \
      ..
{code}
 


was (Author: alenkaf):
C++ and PyArrow builds successfully on my M1 with :
{code:java}
export ARROW_HOME=$CONDA_PREFIX
export ARROW_BUILD_TYPE=debug
export PYARROW_WITH_FLIGHT=0
export PYARROW_WITH_GANDIVA=0
export PYARROW_WITH_ORC=0
export PYARROW_WITH_PARQUET=1
export PYARROW_WITH_DATASET=0
export PYARROW_WITH_S3=0
export PYARROW_PARALLEL=4
export PYARROW_WITH_PLASMA=0

cmake -DCMAKE_INSTALL_PREFIX=$ARROW_HOME \
      -DCMAKE_BUILD_TYPE=debug \
      -DCMAKE_INSTALL_LIBDIR=lib \
      -DARROW_WITH_BZ2=ON \
      -DARROW_WITH_ZLIB=ON \
      -DARROW_WITH_ZSTD=ON \
      -DARROW_WITH_LZ4=ON \
      -DARROW_WITH_SNAPPY=ON \
      -DARROW_WITH_BROTLI=ON \
      -DARROW_PLASMA=OFF \
      -DARROW_PARQUET=ON \
      -DARROW_PYTHON=ON \
      -DARROW_JEMALLOC=OFF \
      -DARROW_MEMALLOC=OFF \
      -DARROW_BUILD_TESTS=ON \
      -DARROW_DEPENDENCY_SOURCE=CONDA \
      -DPython3_EXECUTABLE=/opt/anaconda3/envs/pyarrow-dev-conda/bin/python \
      -DARROW_INSTALL_NAME_RPATH=OFF \
      -GNinja \
      ..
{code}
 

> [C++] Unable to build Arrow C++ on osx arm64 inside conda env because of Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized and arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-15459
>                 URL: https://issues.apache.org/jira/browse/ARROW-15459
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>            Reporter: Elena Henderson
>            Assignee: Elena Henderson
>            Priority: Critical
>              Labels: osx-arm64
>         Attachments: logs
>
>
> Steps to reproduce this issue on osx arm64:
> {code:bash}
> git clone https://github.com/apache/arrow.git
> cd arrow/cpp
> brew update && brew install node && brew bundle --file=Brewfile
> cd ..
> mamba create -y -n arrow-commit -c conda-forge \
>   --file ci/conda_env_unix.txt \
>   --file ci/conda_env_cpp.txt \
>   --file ci/conda_env_python.txt \
>   compilers \
>   python=3.8 \
>   pandas \
>   aws-sdk-cpp \
>   r
> mamba activate arrow-commit
> pip install -r python/requirements-build.txt -r python/requirements-test.txt
> export ARROW_BUILD_TESTS=OFF
> export ARROW_BUILD_TYPE=release
> export ARROW_DEPENDENCY_SOURCE=AUTO
> export ARROW_DATASET=ON
> export ARROW_DEFAULT_MEMORY_POOL=mimalloc
> export ARROW_ENABLE_UNSAFE_MEMORY_ACCESS=true
> export ARROW_ENABLE_NULL_CHECK_FOR_GET=false
> export ARROW_FLIGHT=OFF
> export ARROW_GANDIVA=OFF
> export ARROW_HDFS=ON
> export ARROW_HOME=$CONDA_PREFIX
> export ARROW_INSTALL_NAME_RPATH=OFF
> export ARROW_MIMALLOC=ON
> export ARROW_NO_DEPRECATED_API=ON
> export ARROW_ORC=ON
> export ARROW_PARQUET=ON
> export ARROW_PLASMA=ON
> export ARROW_PYTHON=ON
> export ARROW_S3=ON
> export ARROW_USE_ASAN=OFF
> export ARROW_USE_CCACHE=ON
> export ARROW_USE_UBSAN=OFF
> export ARROW_WITH_BROTLI=ON
> export ARROW_WITH_BZ2=ON
> export ARROW_WITH_LZ4=ON
> export ARROW_WITH_SNAPPY=ON
> export ARROW_WITH_ZLIB=ON
> export ARROW_WITH_ZSTD=ON
> export GTest_SOURCE=BUNDLED
> export ORC_SOURCE=BUNDLED
> export PARQUET_BUILD_EXAMPLES=ON
> export PARQUET_BUILD_EXECUTABLES=ON
> export PYTHON=python
> export LD_LIBRARY_PATH=$CONDA_PREFIX/lib:$LD_LIBRARY_PATH
> ci/scripts/cpp_build.sh $(pwd) $(pwd) 
> {code}
>  
> Error (full logs are attached):
> {code:java}
> ...
> checking size of void *... 8
> checking size of int... 4
> checking size of long... 8
> checking size of long long... 8
> checking size of intmax_t... 8
> checking build system type... 
> -- stderr output is:
> Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized
> configure: error: /bin/sh build-aux/config.sub arm64-apple-darwin20.0.0 failed
> CMake Error at /Users/voltrondata/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake:47 (message):
>   Stopping after outputting logs.
> [31/380] Performing configure step for 'orc_ep'
> ninja: build stopped: subcommand failed. {code}
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)