You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Elena Henderson (Jira)" <ji...@apache.org> on 2022/01/27 00:55:00 UTC
[jira] [Comment Edited] (ARROW-15459) [C++] Unable to build Arrow C++ on osx arm64 because of Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized and arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
[ https://issues.apache.org/jira/browse/ARROW-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482819#comment-17482819 ]
Elena Henderson edited comment on ARROW-15459 at 1/27/22, 12:54 AM:
--------------------------------------------------------------------
Is it some kind of compiler issues?
I am getting `Linking C static library ../bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory` errors.
When I disable jemalloc, I get this error for mimalloc:
{code:java}
$ export ARROW_JEMALLOC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)
...
[15/15] Linking C static library libmimalloc.a
FAILED: libmimalloc.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f libmimalloc.a && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc libmimalloc.a CMakeFiles/mimalloc-static.dir/src/stats.c.o CMakeFiles/mimalloc-static.dir/src/random.c.o CMakeFiles/mimalloc-static.dir/src/os.c.o CMakeFiles/mimalloc-static.dir/src/bitmap.c.o CMakeFiles/mimalloc-static.dir/src/arena.c.o CMakeFiles/mimalloc-static.dir/src/region.c.o CMakeFiles/mimalloc-static.dir/src/segment.c.o CMakeFiles/mimalloc-static.dir/src/page.c.o CMakeFiles/mimalloc-static.dir/src/alloc.c.o CMakeFiles/mimalloc-static.dir/src/alloc-aligned.c.o CMakeFiles/mimalloc-static.dir/src/alloc-posix.c.o CMakeFiles/mimalloc-static.dir/src/heap.c.o CMakeFiles/mimalloc-static.dir/src/options.c.o CMakeFiles/mimalloc-static.dir/src/init.c.o && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib libmimalloc.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch libmimalloc.a && :
/bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
ninja: build stopped: subcommand failed.{code}
When I disable mimalloc, I get this error for orc:
{code:java}
$ export ARROW_MIMALLOC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)
...
[1/1] Linking C static library libmimalloc.a
[40/40] Linking CXX static library c++/src/liborc.a
FAILED: c++/src/liborc.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f c++/src/liborc.a && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc c++/src/liborc.a c++/src/CMakeFiles/orc.dir/io/InputStream.cc.o c++/src/CMakeFiles/orc.dir/io/OutputStream.cc.o c++/src/CMakeFiles/orc.dir/sargs/ExpressionTree.cc.o c++/src/CMakeFiles/orc.dir/sargs/Literal.cc.o c++/src/CMakeFiles/orc.dir/sargs/PredicateLeaf.cc.o c++/src/CMakeFiles/orc.dir/sargs/SargsApplier.cc.o c++/src/CMakeFiles/orc.dir/sargs/SearchArgument.cc.o c++/src/CMakeFiles/orc.dir/sargs/TruthValue.cc.o c++/src/CMakeFiles/orc.dir/wrap/orc-proto-wrapper.cc.o c++/src/CMakeFiles/orc.dir/Adaptor.cc.o c++/src/CMakeFiles/orc.dir/BloomFilter.cc.o c++/src/CMakeFiles/orc.dir/ByteRLE.cc.o c++/src/CMakeFiles/orc.dir/ColumnPrinter.cc.o c++/src/CMakeFiles/orc.dir/ColumnReader.cc.o c++/src/CMakeFiles/orc.dir/ColumnWriter.cc.o c++/src/CMakeFiles/orc.dir/Common.cc.o c++/src/CMakeFiles/orc.dir/Compression.cc.o c++/src/CMakeFiles/orc.dir/Exceptions.cc.o c++/src/CMakeFiles/orc.dir/Int128.cc.o c++/src/CMakeFiles/orc.dir/LzoDecompressor.cc.o c++/src/CMakeFiles/orc.dir/MemoryPool.cc.o c++/src/CMakeFiles/orc.dir/Murmur3.cc.o c++/src/CMakeFiles/orc.dir/OrcFile.cc.o c++/src/CMakeFiles/orc.dir/Reader.cc.o c++/src/CMakeFiles/orc.dir/RLEv1.cc.o c++/src/CMakeFiles/orc.dir/RLEV2Util.cc.o c++/src/CMakeFiles/orc.dir/RleDecoderV2.cc.o c++/src/CMakeFiles/orc.dir/RleEncoderV2.cc.o c++/src/CMakeFiles/orc.dir/RLE.cc.o c++/src/CMakeFiles/orc.dir/Statistics.cc.o c++/src/CMakeFiles/orc.dir/StripeStream.cc.o c++/src/CMakeFiles/orc.dir/Timezone.cc.o c++/src/CMakeFiles/orc.dir/TypeImpl.cc.o c++/src/CMakeFiles/orc.dir/Vector.cc.o c++/src/CMakeFiles/orc.dir/Writer.cc.o && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib c++/src/liborc.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch c++/src/liborc.a && :
/bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
ninja: build stopped: subcommand failed.
... {code}
When I disable orc, I get similar error for arrow_python
{code:java}
$ export ARROW_ORC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)
...
[271/343] Linking CXX static library build/release/libarrow_python.a
FAILED: build/release/libarrow_python.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f build/release/libarrow_python.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc build/release/libarrow_python.a src/arrow/python/CMakeFiles/arrow_python_objlib.dir/arrow_to_pandas.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/benchmark.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/common.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/datetime.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/decimal.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/deserialize.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/extension_type.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/gdb.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/helpers.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/inference.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/init.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/io.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/ipc.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/numpy_convert.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/numpy_to_arrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/python_to_arrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/pyarrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/serialize.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/csv.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/filesystem.cc.o && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib build/release/libarrow_python.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch build/release/libarrow_python.a && :
ccache: error: execute_noreturn of /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar failed: No such file or directory
[279/343] Building CXX object src/arrow/CMakeFiles/arrow_objlib.dir/compute/kernels/vector_sort.cc.o
ninja: build stopped: subcommand failed {code}
was (Author: elena@ursacomputing.com):
Is it some kind of compiler issues?
I am getting `Linking C static library ../bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory` errors.
When I disable jemalloc, I get this error for mimalloc:
{code:java}
$ export ARROW_JEMALLOC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)
...
[15/15] Linking C static library libmimalloc.a
FAILED: libmimalloc.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f libmimalloc.a && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc libmimalloc.a CMakeFiles/mimalloc-static.dir/src/stats.c.o CMakeFiles/mimalloc-static.dir/src/random.c.o CMakeFiles/mimalloc-static.dir/src/os.c.o CMakeFiles/mimalloc-static.dir/src/bitmap.c.o CMakeFiles/mimalloc-static.dir/src/arena.c.o CMakeFiles/mimalloc-static.dir/src/region.c.o CMakeFiles/mimalloc-static.dir/src/segment.c.o CMakeFiles/mimalloc-static.dir/src/page.c.o CMakeFiles/mimalloc-static.dir/src/alloc.c.o CMakeFiles/mimalloc-static.dir/src/alloc-aligned.c.o CMakeFiles/mimalloc-static.dir/src/alloc-posix.c.o CMakeFiles/mimalloc-static.dir/src/heap.c.o CMakeFiles/mimalloc-static.dir/src/options.c.o CMakeFiles/mimalloc-static.dir/src/init.c.o && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib libmimalloc.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch libmimalloc.a && :
/bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
ninja: build stopped: subcommand failed.{code}
When I disable mimalloc, I get this error for orc:
{code:java}
$ export ARROW_MIMALLOC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)
...
[1/1] Linking C static library libmimalloc.a
[40/40] Linking CXX static library c++/src/liborc.a
FAILED: c++/src/liborc.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f c++/src/liborc.a && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc c++/src/liborc.a c++/src/CMakeFiles/orc.dir/io/InputStream.cc.o c++/src/CMakeFiles/orc.dir/io/OutputStream.cc.o c++/src/CMakeFiles/orc.dir/sargs/ExpressionTree.cc.o c++/src/CMakeFiles/orc.dir/sargs/Literal.cc.o c++/src/CMakeFiles/orc.dir/sargs/PredicateLeaf.cc.o c++/src/CMakeFiles/orc.dir/sargs/SargsApplier.cc.o c++/src/CMakeFiles/orc.dir/sargs/SearchArgument.cc.o c++/src/CMakeFiles/orc.dir/sargs/TruthValue.cc.o c++/src/CMakeFiles/orc.dir/wrap/orc-proto-wrapper.cc.o c++/src/CMakeFiles/orc.dir/Adaptor.cc.o c++/src/CMakeFiles/orc.dir/BloomFilter.cc.o c++/src/CMakeFiles/orc.dir/ByteRLE.cc.o c++/src/CMakeFiles/orc.dir/ColumnPrinter.cc.o c++/src/CMakeFiles/orc.dir/ColumnReader.cc.o c++/src/CMakeFiles/orc.dir/ColumnWriter.cc.o c++/src/CMakeFiles/orc.dir/Common.cc.o c++/src/CMakeFiles/orc.dir/Compression.cc.o c++/src/CMakeFiles/orc.dir/Exceptions.cc.o c++/src/CMakeFiles/orc.dir/Int128.cc.o c++/src/CMakeFiles/orc.dir/LzoDecompressor.cc.o c++/src/CMakeFiles/orc.dir/MemoryPool.cc.o c++/src/CMakeFiles/orc.dir/Murmur3.cc.o c++/src/CMakeFiles/orc.dir/OrcFile.cc.o c++/src/CMakeFiles/orc.dir/Reader.cc.o c++/src/CMakeFiles/orc.dir/RLEv1.cc.o c++/src/CMakeFiles/orc.dir/RLEV2Util.cc.o c++/src/CMakeFiles/orc.dir/RleDecoderV2.cc.o c++/src/CMakeFiles/orc.dir/RleEncoderV2.cc.o c++/src/CMakeFiles/orc.dir/RLE.cc.o c++/src/CMakeFiles/orc.dir/Statistics.cc.o c++/src/CMakeFiles/orc.dir/StripeStream.cc.o c++/src/CMakeFiles/orc.dir/Timezone.cc.o c++/src/CMakeFiles/orc.dir/TypeImpl.cc.o c++/src/CMakeFiles/orc.dir/Vector.cc.o c++/src/CMakeFiles/orc.dir/Writer.cc.o && /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib c++/src/liborc.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch c++/src/liborc.a && :
/bin/sh: /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
ninja: build stopped: subcommand failed.
... {code}
When I disable orc, I get similar error for arrow_python
{code:java}
$ export ARROW_ORC=OFF
$ ci/scripts/cpp_build.sh $(pwd) $(pwd)...
[271/343] Linking CXX static library build/release/libarrow_python.a
FAILED: build/release/libarrow_python.a
: && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E rm -f build/release/libarrow_python.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar qc build/release/libarrow_python.a src/arrow/python/CMakeFiles/arrow_python_objlib.dir/arrow_to_pandas.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/benchmark.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/common.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/datetime.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/decimal.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/deserialize.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/extension_type.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/gdb.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/helpers.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/inference.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/init.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/io.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/ipc.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/numpy_convert.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/numpy_to_arrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/python_to_arrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/pyarrow.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/serialize.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/csv.cc.o src/arrow/python/CMakeFiles/arrow_python_objlib.dir/filesystem.cc.o && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ranlib build/release/libarrow_python.a && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch build/release/libarrow_python.a && :
ccache: error: execute_noreturn of /Users/voltrondata/arrow/cpp/arm64-apple-darwin20.0.0-ar failed: No such file or directory
[279/343] Building CXX object src/arrow/CMakeFiles/arrow_objlib.dir/compute/kernels/vector_sort.cc.o
ninja: build stopped: subcommand failed {code}
> [C++] Unable to build Arrow C++ on osx arm64 because of Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized and arrow/cpp/arm64-apple-darwin20.0.0-ar: No such file or directory
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-15459
> URL: https://issues.apache.org/jira/browse/ARROW-15459
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Elena Henderson
> Priority: Critical
> Labels: osx-arm64
> Attachments: logs
>
>
> Steps to reproduce this issue on osx arm64:
> {code:bash}
> git clone https://github.com/apache/arrow.git
> cd arrow/cpp
> brew update && brew install node && brew bundle --file=Brewfile
> cd ..
> mamba create -y -n arrow-commit -c conda-forge \
> --file ci/conda_env_unix.txt \
> --file ci/conda_env_cpp.txt \
> --file ci/conda_env_python.txt \
> compilers \
> python=3.8 \
> pandas \
> aws-sdk-cpp \
> r
> mamba activate arrow-commit
> pip install -r python/requirements-build.txt -r python/requirements-test.txt
> export ARROW_BUILD_TESTS=OFF
> export ARROW_BUILD_TYPE=release
> export ARROW_DEPENDENCY_SOURCE=AUTO
> export ARROW_DATASET=ON
> export ARROW_DEFAULT_MEMORY_POOL=mimalloc
> export ARROW_ENABLE_UNSAFE_MEMORY_ACCESS=true
> export ARROW_ENABLE_NULL_CHECK_FOR_GET=false
> export ARROW_FLIGHT=OFF
> export ARROW_GANDIVA=OFF
> export ARROW_HDFS=ON
> export ARROW_HOME=$CONDA_PREFIX
> export ARROW_INSTALL_NAME_RPATH=OFF
> export ARROW_MIMALLOC=ON
> export ARROW_NO_DEPRECATED_API=ON
> export ARROW_ORC=ON
> export ARROW_PARQUET=ON
> export ARROW_PLASMA=ON
> export ARROW_PYTHON=ON
> export ARROW_S3=ON
> export ARROW_USE_ASAN=OFF
> export ARROW_USE_CCACHE=ON
> export ARROW_USE_UBSAN=OFF
> export ARROW_WITH_BROTLI=ON
> export ARROW_WITH_BZ2=ON
> export ARROW_WITH_LZ4=ON
> export ARROW_WITH_SNAPPY=ON
> export ARROW_WITH_ZLIB=ON
> export ARROW_WITH_ZSTD=ON
> export GTest_SOURCE=BUNDLED
> export ORC_SOURCE=BUNDLED
> export PARQUET_BUILD_EXAMPLES=ON
> export PARQUET_BUILD_EXECUTABLES=ON
> export PYTHON=python
> export LD_LIBRARY_PATH=$CONDA_PREFIX/lib:$LD_LIBRARY_PATH
> ci/scripts/cpp_build.sh $(pwd) $(pwd)
> {code}
>
> Error (full logs are attached):
> {code:java}
> ...
> checking size of void *... 8
> checking size of int... 4
> checking size of long... 8
> checking size of long long... 8
> checking size of intmax_t... 8
> checking build system type...
> -- stderr output is:
> Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized
> configure: error: /bin/sh build-aux/config.sub arm64-apple-darwin20.0.0 failed
> CMake Error at /Users/voltrondata/arrow/cpp/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake:47 (message):
> Stopping after outputting logs.
> [31/380] Performing configure step for 'orc_ep'
> ninja: build stopped: subcommand failed. {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)