You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Jakub Smid (Jira)" <ji...@apache.org> on 2020/03/08 17:23:00 UTC
[jira] [Commented] (ARROW-7968) [C++] orc_ep build fails on 64-bit
Raspbian
[ https://issues.apache.org/jira/browse/ARROW-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054476#comment-17054476 ]
Jakub Smid commented on ARROW-7968:
-----------------------------------
Thanks, [~wesm] for the suggestion. It partially helped.
Now I am getting an error further in the process. Is there any other flag I can try turning off? Or is the safest mode turn off everything?
{code:java}
[ 22%] No update step for 'grpc_ep'
[ 22%] No patch step for 'grpc_ep'
[ 22%] Performing configure step for 'grpc_ep'
-- grpc_ep configure command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-configure-*.log
[ 22%] Performing build step for 'grpc_ep'
CMake Error at /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build-RELEASE.cmake:16 (message):
Command failed: 2
'make'
See also
/home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build-*.log
make[2]: *** [CMakeFiles/grpc_ep.dir/build.make:112: grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build] Error 1
make[1]: *** [CMakeFiles/Makefile2:208: CMakeFiles/grpc_ep.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
{code}
Detailed log from the suggested file:
{code:java}
cat /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build-*.log{code}
{code:java}
/usr/bin/ld: /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/protobuf_ep-install/lib/libprotobuf.a(arena.o): in function `google::protobuf::internal::ArenaImpl::Init()': arena.cc:(.text+0x4ac): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[5]: *** [CMakeFiles/grpc_ruby_plugin.dir/build.make:89: grpc_ruby_plugin] Error 1 make[4]: *** [CMakeFiles/Makefile2:73: CMakeFiles/grpc_ruby_plugin.dir/all] Error 2 make[4]: *** Waiting for unfinished jobs.... /usr/bin/ld: /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/protobuf_ep-install/lib/libprotobuf.a(arena.o): in function `google::protobuf::internal::ArenaImpl::Init()': arena.cc:(.text+0x4ac): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[5]: *** [CMakeFiles/grpc_python_plugin.dir/build.make:89: grpc_python_plugin] Error 1 make[4]: *** [CMakeFiles/Makefile2:110: CMakeFiles/grpc_python_plugin.dir/all] Error 2 /usr/bin/ld: /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/protobuf_ep-install/lib/libprotobuf.a(arena.o): in function `google::protobuf::internal::ArenaImpl::Init()': arena.cc:(.text+0x4ac): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[5]: *** [CMakeFiles/grpc_node_plugin.dir/build.make:89: grpc_node_plugin] Error 1 make[4]: *** [CMakeFiles/Makefile2:184: CMakeFiles/grpc_node_plugin.dir/all] Error 2 /usr/bin/ld: /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/protobuf_ep-install/lib/libprotobuf.a(arena.o): in function `google::protobuf::internal::ArenaImpl::Init()': arena.cc:(.text+0x4ac): undefined reference to `__atomic_fetch_add_8' collect2: error: ld returned 1 exit status make[5]: *** [CMakeFiles/grpc_objective_c_plugin.dir/build.make:89: grpc_objective_c_plugin] Error 1 make[4]: *** [CMakeFiles/Makefile2:147: CMakeFiles/grpc_objective_c_plugin.dir/all] Error 2 make[3]: *** [Makefile:130: all] Error 2 Scanning dependencies of target gen_legal_metadata_characters Scanning dependencies of target address_sorting [ 0%] Building CXX object CMakeFiles/gen_legal_metadata_characters.dir/tools/codegen/core/gen_legal_metadata_characters.cc.o [ 0%] Building C object CMakeFiles/address_sorting.dir/third_party/address_sorting/address_sorting.c.o Scanning dependencies of target gpr Scanning dependencies of target grpc_plugin_support [ 1%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/alloc.cc.o [ 1%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/cpp_generator.cc.o [ 1%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/atm.cc.o [ 1%] Linking CXX executable gen_legal_metadata_characters [ 1%] Building C object CMakeFiles/address_sorting.dir/third_party/address_sorting/address_sorting_posix.c.o [ 1%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/cpu_iphone.cc.o [ 1%] Built target gen_legal_metadata_characters [ 1%] Building C object CMakeFiles/address_sorting.dir/third_party/address_sorting/address_sorting_windows.c.o Scanning dependencies of target gen_percent_encoding_tables [ 1%] Building CXX object CMakeFiles/gen_percent_encoding_tables.dir/tools/codegen/core/gen_percent_encoding_tables.cc.o [ 1%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/cpu_linux.cc.o [ 1%] Linking C static library libaddress_sorting.a [ 1%] Linking CXX executable gen_percent_encoding_tables [ 1%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/cpu_posix.cc.o [ 1%] Built target address_sorting [ 2%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/csharp_generator.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/cpu_windows.cc.o [ 2%] Built target gen_percent_encoding_tables [ 2%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/node_generator.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/env_linux.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/env_posix.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/env_windows.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/log.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/log_android.cc.o [ 2%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/log_linux.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/log_posix.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/log_windows.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/murmur_hash.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/string.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/string_posix.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/string_util_windows.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/string_windows.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/sync.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/sync_posix.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/sync_windows.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/time.cc.o [ 3%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/objective_c_generator.cc.o [ 3%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/time_posix.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/time_precise.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/time_windows.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/tls_pthread.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/tmpfile_msys.cc.o [ 4%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/python_generator.cc.o [ 4%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/php_generator.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/tmpfile_posix.cc.o [ 4%] Building CXX object CMakeFiles/grpc_plugin_support.dir/src/compiler/ruby_generator.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/tmpfile_windows.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gpr/wrap_memcpy.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/fork.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/global_config_env.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/arena.cc.o [ 4%] Linking CXX static library libgrpc_plugin_support.a [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/host_port.cc.o [ 4%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/mpscq.cc.o [ 5%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/thd_posix.cc.o [ 5%] Built target grpc_plugin_support [ 5%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/gprpp/thd_windows.cc.o [ 5%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/profiling/basic_timers.cc.o Scanning dependencies of target grpc_ruby_plugin [ 6%] Building CXX object CMakeFiles/grpc_ruby_plugin.dir/src/compiler/ruby_plugin.cc.o Scanning dependencies of target grpc_python_plugin [ 6%] Building CXX object CMakeFiles/grpc_python_plugin.dir/src/compiler/python_plugin.cc.o Scanning dependencies of target grpc_objective_c_plugin [ 6%] Building CXX object CMakeFiles/grpc_objective_c_plugin.dir/src/compiler/objective_c_plugin.cc.o [ 6%] Building CXX object CMakeFiles/gpr.dir/src/core/lib/profiling/stap_timers.cc.o [ 6%] Linking CXX static library libgpr.a [ 6%] Built target gpr Scanning dependencies of target grpc_node_plugin [ 6%] Building CXX object CMakeFiles/grpc_node_plugin.dir/src/compiler/node_plugin.cc.o [ 6%] Linking CXX executable grpc_ruby_plugin [ 6%] Linking CXX executable grpc_python_plugin [ 6%] Linking CXX executable grpc_node_plugin [ 6%] Linking CXX executable grpc_objective_c_plugin
{code}
> [C++] orc_ep build fails on 64-bit Raspbian
> -------------------------------------------
>
> Key: ARROW-7968
> URL: https://issues.apache.org/jira/browse/ARROW-7968
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Python
> Affects Versions: 0.16.0
> Environment: Rasberry PI 4, 4GB Ram, 64 bit, Raspbian
> Reporter: Jakub Smid
> Priority: Major
>
> Hello,
> I am building PyArrow on Rasberry Pi 4 running 64bit Raspbian.
> A am following this guide to build from sources - [https://gist.github.com/heavyinfo/04e1326bb9bed9cecb19c2d603c8d521.]
> I am using the 16.0 version of arrow.
> Also, as I do not have Cuda, I removed the Cuda instructions.
> During the
> {code:java}
> make -j4{code}
> I get error:
>
> {code:java}
> [ 16%] Creating directories for 'orc_ep'
> Scanning dependencies of target grpc_ep
> [ 16%] Creating directories for 'grpc_ep'
> [ 16%] Performing download step (download, verify and extract) for 'orc_ep'
> [ 16%] Performing download step (download, verify and extract) for 'grpc_ep'
> -- orc_ep download command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-stamp/orc_ep-download-*.log
> [ 16%] No patch step for 'orc_ep'
> [ 16%] No update step for 'orc_ep'
> [ 17%] Performing configure step for 'orc_ep'
> -- grpc_ep download command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-download-*.log
> [ 17%] No patch step for 'grpc_ep'
> [ 17%] No update step for 'grpc_ep'
> [ 17%] Performing configure step for 'grpc_ep'
> -- grpc_ep configure command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-configure-*.log
> [ 18%] Performing build step for 'grpc_ep'
> -- orc_ep configure command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-stamp/orc_ep-configure-*.log
> [ 18%] Performing build step for 'orc_ep'
> CMake Error at /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-RELEASE.cmake:16 (message):
> Command failed: 2
> 'make'
> See also
> /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-*.log
> make[2]: *** [CMakeFiles/orc_ep.dir/build.make:112: orc_ep-prefix/src/orc_ep-stamp/orc_ep-build] Error 1
> make[1]: *** [CMakeFiles/Makefile2:211: CMakeFiles/orc_ep.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs....
> CMake Error at /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build-RELEASE.cmake:16 (message):
> Command failed: 2
> 'make'
> See also
> /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build-*.log
> make[2]: *** [CMakeFiles/grpc_ep.dir/build.make:112: grpc_ep-prefix/src/grpc_ep-stamp/grpc_ep-build] Error 1
> make[1]: *** [CMakeFiles/Makefile2:248: CMakeFiles/grpc_ep.dir/all] Error 2
> make: *** [Makefile:141: all] Error 2
> {code}
>
> When I inspect the logs
> {code:java}
> cat /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-stamp/orc_ep-build-*.log{code}
> I see:
> {code:java}
> /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep/c++/src/io/OutputStream.cc: In member function 'virtual uint64_t orc::BufferedOutputStream::flush()':
> /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep/c++/src/io/OutputStream.cc:95:61: error: conversion from 'uint64_t' {aka 'long long unsigned int'} to 'size_t' {aka 'unsigned int'} may change value [-Werror=conversion]
> outputStream->write(dataBuffer->data(), dataBuffer->size());
> ~~~~~~~~~~~~~~~^
> cc1plus: all warnings being treated as errors
> make[5]: *** [c++/src/CMakeFiles/orc.dir/build.make:83: c++/src/CMakeFiles/orc.dir/io/OutputStream.cc.o] Error 1
> make[5]: *** Waiting for unfinished jobs....
> make[4]: *** [CMakeFiles/Makefile2:205: c++/src/CMakeFiles/orc.dir/all] Error 2
> make[3]: *** [Makefile:163: all] Error 2
> Scanning dependencies of target lz4_ep
> [ 2%] Creating directories for 'lz4_ep'
> [ 4%] Performing download step (download, verify and extract) for 'lz4_ep'
> - lz4_ep download command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/lz4_ep-prefix/src/lz4_ep-stamp/lz4_ep-download-*.log
> [ 6%] No patch step for 'lz4_ep'
> [ 9%] No update step for 'lz4_ep'
> [ 11%] Performing configure step for 'lz4_ep'
> Scanning dependencies of target zlib_ep
> [ 13%] Creating directories for 'zlib_ep'
> [ 16%] Performing download step (download, verify and extract) for 'zlib_ep'
> - zlib_ep download command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-download-*.log
> [ 18%] No patch step for 'zlib_ep'
> [ 20%] No update step for 'zlib_ep'
> [ 23%] Performing configure step for 'zlib_ep'
> - lz4_ep configure command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/lz4_ep-prefix/src/lz4_ep-stamp/lz4_ep-configure-*.log
> [ 25%] Performing build step for 'lz4_ep'
> - zlib_ep configure command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-configure-*.log
> [ 27%] Performing build step for 'zlib_ep'
> - lz4_ep build command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/lz4_ep-prefix/src/lz4_ep-stamp/lz4_ep-build-*.log
> [ 30%] Performing install step for 'lz4_ep'
> - lz4_ep install command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/lz4_ep-prefix/src/lz4_ep-stamp/lz4_ep-install-*.log
> [ 32%] Completed 'lz4_ep'
> [ 32%] Built target lz4_ep
> - zlib_ep build command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-build-*.log
> [ 34%] Performing install step for 'zlib_ep'
> - zlib_ep install command succeeded. See also /home/pi/Repositories/arrow-build/build_16/arrow-apache-arrow-0.16.0/cpp/release/orc_ep-prefix/src/orc_ep-build/zlib_ep-prefix/src/zlib_ep-stamp/zlib_ep-install-*.log
> [ 37%] Completed 'zlib_ep'
> [ 37%] Built target zlib_ep
> [ 39%] Generating orc_proto.pb.h, orc_proto.pb.cc
> Scanning dependencies of target orc
> [ 41%] Building CXX object c++/src/CMakeFiles/orc.dir/io/InputStream.cc.o
> [ 44%] Building CXX object c++/src/CMakeFiles/orc.dir/io/OutputStream.cc.o
> [ 46%] Building CXX object c++/src/CMakeFiles/orc.dir/wrap/orc-proto-wrapper.cc.o{code}
> Could you please advise?
> Thanks,
> Jakub
--
This message was sent by Atlassian Jira
(v8.3.4#803005)