You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Elena Henderson (Jira)" <ji...@apache.org> on 2022/02/03 00:39:00 UTC
[jira] [Created] (ARROW-15539) [C++] Archery cpp benchmarks ignore ARROW_JEMALLOC
Elena Henderson created ARROW-15539:
---------------------------------------
Summary: [C++] Archery cpp benchmarks ignore ARROW_JEMALLOC
Key: ARROW-15539
URL: https://issues.apache.org/jira/browse/ARROW-15539
Project: Apache Arrow
Issue Type: Bug
Components: Archery
Reporter: Elena Henderson
Assignee: Elena Henderson
Steps to reproduce:
{code:java}
$ export ARROW_JEMALLOC=OFF
$ archery benchmark run --repetitions 1
-- Building using CMake version: 3.21.3
-- The C compiler identification is Clang 11.1.0
-- The CXX compiler identification is Clang 11.1.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Arrow version: 7.0.0 (full: '7.0.0-SNAPSHOT')
-- Arrow SO version: 700 (full: 700.0.0)
-- clang-tidy 12 not found
-- clang-format 12 not found
-- Could NOT find ClangTools (missing: CLANG_FORMAT_BIN CLANG_TIDY_BIN)
-- infer not found
-- Found Python3: /Users/voltrondata/miniconda3/envs/arrow-commit/bin/python3.8 (found version "3.8.12") found components: Interpreter
-- Using ccache: /Users/voltrondata/miniconda3/envs/arrow-commit/bin/ccache
-- Found cpplint executable at /opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/cpp/build-support/cpplint.py
-- System processor: arm64
-- Performing Test CXX_SUPPORTS_ARMV8_ARCH
-- Performing Test CXX_SUPPORTS_ARMV8_ARCH - Success
-- Arrow build warning level: PRODUCTION
Configured for RELEASE build (set with cmake -DCMAKE_BUILD_TYPE={release,debug,...})
-- Build Type: RELEASE
-- Performing Test CXX_LINKER_SUPPORTS_VERSION_SCRIPT
-- Performing Test CXX_LINKER_SUPPORTS_VERSION_SCRIPT - Failed
-- Using CONDA approach to find dependencies
-- Using CONDA_PREFIX for ARROW_PACKAGE_PREFIX: /Users/voltrondata/miniconda3/envs/arrow-commit
-- Setting (unset) dependency *_ROOT variables: /Users/voltrondata/miniconda3/envs/arrow-commit
-- ARROW_ABSL_BUILD_VERSION: 20210324.2
-- ARROW_ABSL_BUILD_SHA256_CHECKSUM: 59b862f50e710277f8ede96f083a5bb8d7c9595376146838b9580be90374ee1f
-- ARROW_AWSSDK_BUILD_VERSION: 1.8.133
-- ARROW_AWSSDK_BUILD_SHA256_CHECKSUM: d6c495bc06be5e21dac716571305d77437e7cfd62a2226b8fe48d9ab5785a8d6
-- ARROW_AWS_CHECKSUMS_BUILD_VERSION: v0.1.12
-- ARROW_AWS_CHECKSUMS_BUILD_SHA256_CHECKSUM: 394723034b81cc7cd528401775bc7aca2b12c7471c92350c80a0e2fb9d2909fe
-- ARROW_AWS_C_COMMON_BUILD_VERSION: v0.6.9
-- ARROW_AWS_C_COMMON_BUILD_SHA256_CHECKSUM: 928a3e36f24d1ee46f9eec360ec5cebfe8b9b8994fe39d4fa74ff51aebb12717
-- ARROW_AWS_C_EVENT_STREAM_BUILD_VERSION: v0.1.5
-- ARROW_AWS_C_EVENT_STREAM_BUILD_SHA256_CHECKSUM: f1b423a487b5d6dca118bfc0d0c6cc596dc476b282258a3228e73a8f730422d4
-- ARROW_BOOST_BUILD_VERSION: 1.75.0
-- ARROW_BOOST_BUILD_SHA256_CHECKSUM: 267e04a7c0bfe85daf796dedc789c3a27a76707e1c968f0a2a87bb96331e2b61
-- ARROW_BROTLI_BUILD_VERSION: v1.0.9
-- ARROW_BROTLI_BUILD_SHA256_CHECKSUM: f9e8d81d0405ba66d181529af42a3354f838c939095ff99930da6aa9cdf6fe46
-- ARROW_BZIP2_BUILD_VERSION: 1.0.8
-- ARROW_BZIP2_BUILD_SHA256_CHECKSUM: ab5a03176ee106d3f0fa90e381da478ddae405918153cca248e682cd0c4a2269
-- ARROW_CARES_BUILD_VERSION: 1.17.2
-- ARROW_CARES_BUILD_SHA256_CHECKSUM: 4803c844ce20ce510ef0eb83f8ea41fa24ecaae9d280c468c582d2bb25b3913d
-- ARROW_CRC32C_BUILD_VERSION: 1.1.2
-- ARROW_CRC32C_BUILD_SHA256_CHECKSUM: ac07840513072b7fcebda6e821068aa04889018f24e10e46181068fb214d7e56
-- ARROW_GBENCHMARK_BUILD_VERSION: v1.6.0
-- ARROW_GBENCHMARK_BUILD_SHA256_CHECKSUM: 1f71c72ce08d2c1310011ea6436b31e39ccab8c2db94186d26657d41747c85d6
-- ARROW_GFLAGS_BUILD_VERSION: v2.2.2
-- ARROW_GFLAGS_BUILD_SHA256_CHECKSUM: 34af2f15cf7367513b352bdcd2493ab14ce43692d2dcd9dfc499492966c64dcf
-- ARROW_GLOG_BUILD_VERSION: v0.5.0
-- ARROW_GLOG_BUILD_SHA256_CHECKSUM: eede71f28371bf39aa69b45de23b329d37214016e2055269b3b5e7cfd40b59f5
-- ARROW_GOOGLE_CLOUD_CPP_BUILD_VERSION: v1.31.1
-- ARROW_GOOGLE_CLOUD_CPP_BUILD_SHA256_CHECKSUM: dc7cbf95b506a84b48cf71e0462985d262183edeaabdacaaee2109852394a609
-- ARROW_GRPC_BUILD_VERSION: v1.35.0
-- ARROW_GRPC_BUILD_SHA256_CHECKSUM: 27dd2fc5c9809ddcde8eb6fa1fa278a3486566dfc28335fca13eb8df8bd3b958
-- ARROW_GTEST_BUILD_VERSION: 1.11.0
-- ARROW_GTEST_BUILD_SHA256_CHECKSUM: b4870bf121ff7795ba20d20bcdd8627b8e088f2d1dab299a031c1034eddc93d5
-- ARROW_JEMALLOC_BUILD_VERSION: 5.2.1
-- ARROW_JEMALLOC_BUILD_SHA256_CHECKSUM: 34330e5ce276099e2e8950d9335db5a875689a4c6a56751ef3b1d8c537f887f6
-- ARROW_LZ4_BUILD_VERSION: 8f61d8eb7c6979769a484cde8df61ff7c4c77765
-- ARROW_LZ4_BUILD_SHA256_CHECKSUM: 5b072d848f2f93fddb97e1143e22c1bd7fa19fc8431ee69e21758190a88125b4
-- ARROW_MIMALLOC_BUILD_VERSION: v1.7.3
-- ARROW_MIMALLOC_BUILD_SHA256_CHECKSUM: 0f987bda01ca9df87ec90e9d98c63fa893ee61f3cca565e5ca5ed744fdcc5109
-- ARROW_NLOHMANN_JSON_BUILD_VERSION: v3.10.2
-- ARROW_NLOHMANN_JSON_BUILD_SHA256_CHECKSUM: 081ed0f9f89805c2d96335c3acfa993b39a0a5b4b4cef7edb68dd2210a13458c
-- ARROW_OPENTELEMETRY_BUILD_VERSION: v1.1.0
-- ARROW_OPENTELEMETRY_BUILD_SHA256_CHECKSUM: f8fd3adddd47be382dc79c19d7e7efcf86a0dfbb5a237db6e0618dbb7eb8e058
-- ARROW_OPENTELEMETRY_PROTO_BUILD_VERSION: v0.11.0
-- ARROW_OPENTELEMETRY_PROTO_BUILD_SHA256_CHECKSUM: 985367f8905e91018e636cbf0d83ab3f834b665c4f5899a27d10cae9657710e2
-- ARROW_ORC_BUILD_VERSION: 1.7.2
-- ARROW_ORC_BUILD_SHA256_CHECKSUM: ef39bae755116fecb07fb4334656f984ba8ce7cdb1c64de078d3ed186b286007
-- ARROW_PROTOBUF_BUILD_VERSION: v3.18.1
-- ARROW_PROTOBUF_BUILD_SHA256_CHECKSUM: b8ab9bbdf0c6968cf20060794bc61e231fae82aaf69d6e3577c154181991f576
-- ARROW_RAPIDJSON_BUILD_VERSION: 1a803826f1197b5e30703afe4b9c0e7dd48074f5
-- ARROW_RAPIDJSON_BUILD_SHA256_CHECKSUM: 0b6b780b6c534bfb0b23d29910bfe361e486bcfeaf106db8bc8995792072905a
-- ARROW_RE2_BUILD_VERSION: 2021-11-01
-- ARROW_RE2_BUILD_SHA256_CHECKSUM: 8c45f7fba029ab41f2a7e6545058d9eec94eef97ce70df58e92d85cfc08b4669
-- ARROW_SNAPPY_BUILD_VERSION: 1.1.9
-- ARROW_SNAPPY_BUILD_SHA256_CHECKSUM: 75c1fbb3d618dd3a0483bff0e26d0a92b495bbe5059c8b4f1c962b478b6e06e7
-- ARROW_SNAPPY_OLD_BUILD_VERSION: 1.1.8
-- ARROW_SNAPPY_OLD_BUILD_SHA256_CHECKSUM: 16b677f07832a612b0836178db7f374e414f94657c138e6993cbfc5dcc58651f
-- ARROW_THRIFT_BUILD_VERSION: 0.13.0
-- ARROW_THRIFT_BUILD_SHA256_CHECKSUM: 7ad348b88033af46ce49148097afe354d513c1fca7c607b59c33ebb6064b5179
-- ARROW_UTF8PROC_BUILD_VERSION: v2.7.0
-- ARROW_UTF8PROC_BUILD_SHA256_CHECKSUM: 4bb121e297293c0fd55f08f83afab6d35d48f0af4ecc07523ad8ec99aa2b12a1
-- ARROW_XSIMD_BUILD_VERSION: aeec9c872c8b475dedd7781336710f2dd2666cb2
-- ARROW_XSIMD_BUILD_SHA256_CHECKSUM: 0a841e6c8acf216150e4fc19fca8e29fbab9614b56ac7b96e56019264ca27b26
-- ARROW_ZLIB_BUILD_VERSION: 1.2.11
-- ARROW_ZLIB_BUILD_SHA256_CHECKSUM: c3e5e9fdd5004dcb542feda5ee4f0ff0744628baf8ed2dd5d66f8ca1197cb1a1
-- ARROW_ZSTD_BUILD_VERSION: v1.5.1
-- ARROW_ZSTD_BUILD_SHA256_CHECKSUM: dc05773342b28f11658604381afd22cb0a13e8ba17ff2bd7516df377060c18dd
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Looking for _M_ARM64
-- Looking for _M_ARM64 - not found
-- Looking for __SIZEOF_INT128__
-- Looking for __SIZEOF_INT128__ - found
-- Found Boost: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/cmake/Boost-1.77.0/BoostConfig.cmake (found suitable version "1.77.0", minimum required is "1.58") found components: system filesystem
-- Boost include dir: /Users/voltrondata/miniconda3/envs/arrow-commit/include
-- Boost libraries: Boost::system;Boost::filesystem
-- Found Snappy: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libsnappy.dylib
-- Providing CMake module for Snappy
-- Checking for modules 'libbrotlicommon;libbrotlienc;libbrotlidec'
-- Found libbrotlicommon, version 1.0.9
-- Found libbrotlienc, version 1.0.9
-- Found libbrotlidec, version 1.0.9
-- Found Brotli: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libbrotlicommon.dylib
-- Providing CMake module for Brotli
-- Building without OpenSSL support. Minimum OpenSSL version 1.0.2 required.
-- Found Thrift: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libthrift.dylib (found suitable version "0.15.0", minimum required is "0.11.0")
-- Providing CMake module for Thrift
-- Building (vendored) jemalloc from source
-- RapidJSON found. Headers: /Users/voltrondata/miniconda3/envs/arrow-commit/include
-- Building xsimd from source
-- Found ZLIB: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libz.dylib (found version "1.2.11")
-- Checking for module 'liblz4'
-- Found liblz4, version 1.9.3
-- Found Lz4: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/liblz4.dylib
-- Providing CMake module for Lz4
-- Checking for module 'libzstd'
-- Found libzstd, version 1.5.2
-- Found zstd: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libzstd.dylib (Required is at least version "1.4.0")
-- Providing CMake module for zstd
-- Providing CMake module for re2Alt
-- Found BZip2: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libbz2.dylib (found version "1.0.8")
-- Looking for BZ2_bzCompressInit
-- Looking for BZ2_bzCompressInit - found
-- Found utf8proc: /Users/voltrondata/miniconda3/envs/arrow-commit/lib/libutf8proc.dylib (found suitable version "2.7.0", minimum required is "2.2.0")
-- Providing CMake module for utf8proc
-- Found hdfs.h at: /opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/cpp/thirdparty/hadoop/include/hdfs.h
-- All bundled static libraries: jemalloc::jemalloc
-- CMAKE_C_FLAGS: -ftree-vectorize -fPIC -fPIE -fstack-protector-strong -O2 -pipe -isystem /Users/voltrondata/miniconda3/envs/arrow-commit/include -Qunused-arguments -O3 -DNDEBUG -Wall -Wno-unknown-warning-option -Wno-pass-failed -march=armv8-a
-- CMAKE_CXX_FLAGS: -ftree-vectorize -fPIC -fPIE -fstack-protector-strong -O2 -pipe -stdlib=libc++ -fvisibility-inlines-hidden -std=c++14 -fmessage-length=0 -isystem /Users/voltrondata/miniconda3/envs/arrow-commit/include -Qunused-arguments -fcolor-diagnostics -O3 -DNDEBUG -Wall -Wno-unknown-warning-option -Wno-pass-failed -march=armv8-a
-- Looking for backtrace
-- Looking for backtrace - found
-- backtrace facility detected in default set of libraries
-- Found Backtrace: /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include
-- ---------------------------------------------------------------------
-- Arrow version: 7.0.0-SNAPSHOT
--
-- Build configuration summary:
-- Generator: Ninja
-- Build type: RELEASE
-- Source directory: /opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/cpp
-- Install prefix: /Users/voltrondata/miniconda3/envs/arrow-commit
-- Compile commands: /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/compile_commands.json
--
-- Compile and link options:
--
-- ARROW_CXXFLAGS="" [default=""]
-- Compiler flags to append when compiling Arrow
-- ARROW_BUILD_STATIC=OFF [default=ON]
-- Build static libraries
-- ARROW_BUILD_SHARED=ON [default=ON]
-- Build shared libraries
-- ARROW_PACKAGE_KIND="" [default=""]
-- Arbitrary string that identifies the kind of package
-- (for informational purposes)
-- ARROW_GIT_ID=daa5c18e9697a6455a7a75fec19594543c17b21e [default=""]
-- The Arrow git commit id (if any)
-- ARROW_GIT_DESCRIPTION=apache-arrow-7.0.0.dev-572-gdaa5c18e9 [default=""]
-- The Arrow git commit description (if any)
-- ARROW_NO_DEPRECATED_API=OFF [default=OFF]
-- Exclude deprecated APIs from build
-- ARROW_USE_CCACHE=ON [default=ON]
-- Use ccache when compiling (if available)
-- ARROW_USE_LD_GOLD=ON [default=OFF]
-- Use ld.gold for linking on Linux (if available)
-- ARROW_USE_PRECOMPILED_HEADERS=OFF [default=OFF]
-- Use precompiled headers when compiling
-- ARROW_SIMD_LEVEL=NEON [default=NONE|SSE4_2|AVX2|AVX512|NEON|DEFAULT]
-- Compile-time SIMD optimization level
-- ARROW_RUNTIME_SIMD_LEVEL=MAX [default=NONE|SSE4_2|AVX2|AVX512|MAX]
-- Max runtime SIMD optimization level
-- ARROW_ARMV8_ARCH=armv8-a [default=armv8-a|armv8-a+crc+crypto]
-- Arm64 arch and extensions
-- ARROW_ALTIVEC=ON [default=ON]
-- Build with Altivec if compiler has support
-- ARROW_RPATH_ORIGIN=OFF [default=OFF]
-- Build Arrow libraries with RATH set to $ORIGIN
-- ARROW_INSTALL_NAME_RPATH=ON [default=ON]
-- Build Arrow libraries with install_name set to @rpath
-- ARROW_GGDB_DEBUG=ON [default=ON]
-- Pass -ggdb flag to debug builds
--
-- Test and benchmark options:
--
-- ARROW_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Arrow examples
-- ARROW_BUILD_TESTS=OFF [default=OFF]
-- Build the Arrow googletest unit tests
-- ARROW_ENABLE_TIMING_TESTS=ON [default=ON]
-- Enable timing-sensitive tests
-- ARROW_BUILD_INTEGRATION=OFF [default=OFF]
-- Build the Arrow integration test executables
-- ARROW_BUILD_BENCHMARKS=ON [default=OFF]
-- Build the Arrow micro benchmarks
-- ARROW_BUILD_BENCHMARKS_REFERENCE=OFF [default=OFF]
-- Build the Arrow micro reference benchmarks
-- ARROW_BUILD_OPENMP_BENCHMARKS=OFF [default=OFF]
-- Build the Arrow benchmarks that rely on OpenMP
-- ARROW_BUILD_DETAILED_BENCHMARKS=OFF [default=OFF]
-- Build benchmarks that do a longer exploration of performance
-- ARROW_TEST_LINKAGE=shared [default=shared|static]
-- Linkage of Arrow libraries with unit tests executables.
-- ARROW_FUZZING=OFF [default=OFF]
-- Build Arrow Fuzzing executables
-- ARROW_LARGE_MEMORY_TESTS=OFF [default=OFF]
-- Enable unit tests which use large memory
--
-- Lint options:
--
-- ARROW_ONLY_LINT=OFF [default=OFF]
-- Only define the lint and check-format targets
-- ARROW_VERBOSE_LINT=OFF [default=OFF]
-- If off, 'quiet' flags will be passed to linting tools
-- ARROW_GENERATE_COVERAGE=OFF [default=OFF]
-- Build with C++ code coverage enabled
--
-- Checks options:
--
-- ARROW_TEST_MEMCHECK=OFF [default=OFF]
-- Run the test suite using valgrind --tool=memcheck
-- ARROW_USE_ASAN=OFF [default=OFF]
-- Enable Address Sanitizer checks
-- ARROW_USE_TSAN=OFF [default=OFF]
-- Enable Thread Sanitizer checks
-- ARROW_USE_UBSAN=OFF [default=OFF]
-- Enable Undefined Behavior sanitizer checks
--
-- Project component options:
--
-- ARROW_BUILD_UTILITIES=OFF [default=OFF]
-- Build Arrow commandline utilities
-- ARROW_COMPUTE=ON [default=OFF]
-- Build the Arrow Compute Modules
-- ARROW_CSV=ON [default=OFF]
-- Build the Arrow CSV Parser Module
-- ARROW_CUDA=OFF [default=OFF]
-- Build the Arrow CUDA extensions (requires CUDA toolkit)
-- ARROW_DATASET=ON [default=OFF]
-- Build the Arrow Dataset Modules
-- ARROW_ENGINE=OFF [default=OFF]
-- Build the Arrow Execution Engine
-- ARROW_FILESYSTEM=ON [default=OFF]
-- Build the Arrow Filesystem Layer
-- ARROW_FLIGHT=OFF [default=OFF]
-- Build the Arrow Flight RPC System (requires GRPC, Protocol Buffers)
-- ARROW_FLIGHT_SQL=OFF [default=OFF]
-- Build the Arrow Flight SQL extension
-- ARROW_GANDIVA=OFF [default=OFF]
-- Build the Gandiva libraries
-- ARROW_GCS=OFF [default=OFF]
-- Build Arrow with GCS support (requires the GCloud SDK for C++)
-- ARROW_HDFS=OFF [default=OFF]
-- Build the Arrow HDFS bridge
-- ARROW_HIVESERVER2=OFF [default=OFF]
-- Build the HiveServer2 client and Arrow adapter
-- ARROW_IPC=ON [default=ON]
-- Build the Arrow IPC extensions
-- ARROW_JEMALLOC=ON [default=ON]
-- Build the Arrow jemalloc-based allocator
-- ARROW_JNI=OFF [default=OFF]
-- Build the Arrow JNI lib
-- ARROW_JSON=ON [default=OFF]
-- Build Arrow with JSON support (requires RapidJSON)
-- ARROW_MIMALLOC=OFF [default=OFF]
-- Build the Arrow mimalloc-based allocator
-- ARROW_PARQUET=ON [default=OFF]
-- Build the Parquet libraries
-- ARROW_ORC=OFF [default=OFF]
-- Build the Arrow ORC adapter
-- ARROW_PLASMA=OFF [default=OFF]
-- Build the plasma object store along with Arrow
-- ARROW_PLASMA_JAVA_CLIENT=OFF [default=OFF]
-- Build the plasma object store java client
-- ARROW_PYTHON=OFF [default=OFF]
-- Build the Arrow CPython extensions
-- ARROW_S3=OFF [default=OFF]
-- Build Arrow with S3 support (requires the AWS SDK for C++)
-- ARROW_SKYHOOK=OFF [default=OFF]
-- Build the Skyhook libraries
-- ARROW_TENSORFLOW=OFF [default=OFF]
-- Build Arrow with TensorFlow support enabled
-- ARROW_TESTING=ON [default=OFF]
-- Build the Arrow testing libraries
--
-- Thirdparty toolchain options:
--
-- ARROW_DEPENDENCY_SOURCE=CONDA [default=AUTO|BUNDLED|SYSTEM|CONDA|VCPKG|BREW]
-- Method to use for acquiring arrow's build dependencies
-- ARROW_VERBOSE_THIRDPARTY_BUILD=OFF [default=OFF]
-- Show output from ExternalProjects rather than just logging to files
-- ARROW_DEPENDENCY_USE_SHARED=ON [default=ON]
-- Link to shared libraries
-- ARROW_BOOST_USE_SHARED=ON [default=ON]
-- Rely on boost shared libraries where relevant
-- ARROW_BROTLI_USE_SHARED=ON [default=ON]
-- Rely on Brotli shared libraries where relevant
-- ARROW_BZ2_USE_SHARED=ON [default=ON]
-- Rely on Bz2 shared libraries where relevant
-- ARROW_GFLAGS_USE_SHARED=ON [default=ON]
-- Rely on GFlags shared libraries where relevant
-- ARROW_GRPC_USE_SHARED=ON [default=ON]
-- Rely on gRPC shared libraries where relevant
-- ARROW_LZ4_USE_SHARED=ON [default=ON]
-- Rely on lz4 shared libraries where relevant
-- ARROW_OPENSSL_USE_SHARED=ON [default=ON]
-- Rely on OpenSSL shared libraries where relevant
-- ARROW_PROTOBUF_USE_SHARED=ON [default=ON]
-- Rely on Protocol Buffers shared libraries where relevant
-- ARROW_THRIFT_USE_SHARED=ON [default=ON]
-- Rely on thrift shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_SNAPPY_USE_SHARED=ON [default=ON]
-- Rely on snappy shared libraries where relevant
-- ARROW_UTF8PROC_USE_SHARED=ON [default=ON]
-- Rely on utf8proc shared libraries where relevant
-- ARROW_ZSTD_USE_SHARED=ON [default=ON]
-- Rely on zstd shared libraries where relevant
-- ARROW_USE_GLOG=OFF [default=OFF]
-- Build libraries with glog support for pluggable logging
-- ARROW_WITH_BACKTRACE=ON [default=ON]
-- Build with backtrace support
-- ARROW_WITH_OPENTELEMETRY=OFF [default=OFF]
-- Build libraries with OpenTelemetry support for distributed tracing
-- ARROW_WITH_BROTLI=ON [default=OFF]
-- Build with Brotli compression
-- ARROW_WITH_BZ2=ON [default=OFF]
-- Build with BZ2 compression
-- ARROW_WITH_LZ4=ON [default=OFF]
-- Build with lz4 compression
-- ARROW_WITH_SNAPPY=ON [default=OFF]
-- Build with Snappy compression
-- ARROW_WITH_ZLIB=ON [default=OFF]
-- Build with zlib compression
-- ARROW_WITH_ZSTD=ON [default=OFF]
-- Build with zstd compression
-- ARROW_WITH_UTF8PROC=ON [default=ON]
-- Build with support for Unicode properties using the utf8proc library
-- (only used if ARROW_COMPUTE is ON or ARROW_GANDIVA is ON)
-- ARROW_WITH_RE2=ON [default=ON]
-- Build with support for regular expressions using the re2 library
-- (only used if ARROW_COMPUTE or ARROW_GANDIVA is ON)
--
-- Parquet options:
--
-- PARQUET_MINIMAL_DEPENDENCY=OFF [default=OFF]
-- Depend only on Thirdparty headers to build libparquet.
-- Always OFF if building binaries
-- PARQUET_BUILD_EXECUTABLES=OFF [default=OFF]
-- Build the Parquet executable CLI tools. Requires static libraries to be built.
-- PARQUET_BUILD_EXAMPLES=OFF [default=OFF]
-- Build the Parquet examples. Requires static libraries to be built.
-- PARQUET_REQUIRE_ENCRYPTION=OFF [default=OFF]
-- Build support for encryption. Fail if OpenSSL is not found
--
-- Gandiva options:
--
-- ARROW_GANDIVA_JAVA=OFF [default=OFF]
-- Build the Gandiva JNI wrappers
-- ARROW_GANDIVA_STATIC_LIBSTDCPP=OFF [default=OFF]
-- Include -static-libstdc++ -static-libgcc when linking with
-- Gandiva static libraries
-- ARROW_GANDIVA_PC_CXX_FLAGS="" [default=""]
-- Compiler flags to append when pre-compiling Gandiva operations
--
-- Advanced developer options:
--
-- ARROW_EXTRA_ERROR_CONTEXT=OFF [default=OFF]
-- Compile with extra error context (line numbers, code)
-- ARROW_OPTIONAL_INSTALL=OFF [default=OFF]
-- If enabled install ONLY targets that have already been built. Please be
-- advised that if this is enabled 'install' will fail silently on components
-- that have not been built
-- Outputting build configuration summary to /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/cmake_summary.json
-- Configuring done
-- Generating done
-- Build files have been written to: /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build
[13/168] Performing configure step for 'jemalloc_ep'
FAILED: jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure
cd /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -P /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake && /Users/voltrondata/miniconda3/envs/arrow-commit/bin/cmake -E touch /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure
CMake Error at /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake:37 (message):
Command failed: 1 './configure' 'AR=/Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-ar' 'CC=/Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang' 'SDKROOT=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk' '--prefix=/private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep/dist/' '--libdir=/private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep/dist//lib' '--with-jemalloc-prefix=je_arrow_' '--with-private-namespace=je_arrow_private_' '--without-export' '--disable-shared' '--disable-cxx' '--disable-libdl' '--disable-initial-exec-tls' See also /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-*.log
-- stdout output is:
checking for xsltproc... /usr/bin/xsltproc
checking for arm64-apple-darwin20.0.0-gcc... /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang accepts -g... yes
checking for /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang option to accept ISO C89... none needed
checking whether compiler is cray... no
checking whether compiler supports -std=gnu11... yes
checking whether compiler supports -Wall... yes
checking whether compiler supports -Wextra... yes
checking whether compiler supports -Wshorten-64-to-32... yes
checking whether compiler supports -Wsign-compare... yes
checking whether compiler supports -Wundef... yes
checking whether compiler supports -Wno-format-zero-length... yes
checking whether compiler supports -pipe... yes
checking whether compiler supports -g3... yes
checking how to run the C preprocessor... /Users/voltrondata/miniconda3/envs/arrow-commit/bin/arm64-apple-darwin20.0.0-clang -E
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking whether byte ordering is bigendian... no
checking size of void *... 8
checking size of int... 4
checking size of long... 8
checking size of long long... 8
checking size of intmax_t... 8
checking build system type...
-- stderr output is:
Invalid configuration `arm64-apple-darwin20.0.0': machine `arm64-apple' not recognized
configure: error: /bin/sh build-aux/config.sub arm64-apple-darwin20.0.0 failedCMake Error at /private/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-RELEASE.cmake:47 (message):
Stopping after outputting logs.
[22/168] Building CXX object src/arrow/CMakeFiles/arrow_objlib.dir/Unity/unity_20_cxx.cxx.o
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/Users/voltrondata/miniconda3/envs/arrow-commit/bin/archery", line 33, in <module>
sys.exit(load_entry_point('archery', 'console_scripts', 'archery')())
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
return self.main(*args, **kwargs)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 1053, in main
rv = self.invoke(ctx)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/core.py", line 754, in invoke
return __callback(*args, **kwargs)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/site-packages/click/decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/cli.py", line 500, in benchmark_run
json_out = json.dumps(runner_base, cls=JsonEncoder)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/json/__init__.py", line 234, in dumps
return cls(
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/json/encoder.py", line 199, in encode
chunks = self.iterencode(o, _one_shot=True)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/json/encoder.py", line 257, in iterencode
return _iterencode(o, 0)
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/benchmark/codec.py", line 35, in default
return BenchmarkRunnerCodec.encode(o)
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/benchmark/codec.py", line 79, in encode
return {"suites": [BenchmarkSuiteCodec.encode(s) for s in br.suites]}
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/benchmark/codec.py", line 79, in <listcomp>
return {"suites": [BenchmarkSuiteCodec.encode(s) for s in br.suites]}
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/benchmark/runner.py", line 169, in suites
suite_and_binaries = self.suites_binaries
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/benchmark/runner.py", line 138, in suites_binaries
self.build()
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/utils/command.py", line 89, in __call__
return self.run(*argv, **kwargs)
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/utils/cmake.py", line 160, in run
return super().run(*cmake_args, *extra,
File "/opt/homebrew/var/buildkite-agent/builds/test-mac-arm/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/arrow/dev/archery/archery/utils/command.py", line 78, in run
return subprocess.run(invocation, **kwargs)
File "/Users/voltrondata/miniconda3/envs/arrow-commit/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '--build', '/var/folders/d9/n0lbzbf16nvgt7b83xhcssm80000gn/T/arrow-archery-69dlw34c/WORKSPACE/build', '--']' returned non-zero exit status 1.
{code}
Actual Result: Arrow C++ is built with ARROW_JEMALLOC=ON (printed in the logs)
Expected Result: Arrow C++ is build with ARROW_JEMALLOC=OFF
I need to be able to set ARROW_JEMALLOC=OFF to avoid the issue with jemalloc (printed in the logs).
Jemalloc issue is fixed by [~uwe] in [https://github.com/jemalloc/jemalloc/pull/2012|https://github.com/jemalloc/jemalloc/pull/2012/files]
Arrow is using latest jemalloc release version = 5.2.1 (created in 2019) but jemalloc issue is fixed after last release.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)