You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Benson Muite (Jira)" <ji...@apache.org> on 2021/09/29 11:19:00 UTC
[jira] [Comment Edited] (ARROW-14160) [C++][Build] Cannot build
with Parquet/Thrift support on CentOS 7
[ https://issues.apache.org/jira/browse/ARROW-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422064#comment-17422064 ]
Benson Muite edited comment on ARROW-14160 at 9/29/21, 11:18 AM:
-----------------------------------------------------------------
Need to get submodules and export paths:
{code:java}
yum update
yum install gcc-c++ gcc bison flex git python3 make openssl-devel wget
yum groupinstall "Development tools"
yum install centos-release-scl
yum install yum-config-manager
yum install devtoolset-10
scl enable devtoolset-10 bash
wget https://github.com/Kitware/CMake/releases/download/v3.21.3/cmake-3.21.3.tar.gz
tar -xf cmake-3.21.3.tar.gz
cd cmake-3.21.3
mkdir build
cd build/
../bootstrap --prefix=$HOME/cmake-3.21.3-install
make
make install
cd ..
cd ..
git clone https://github.com/bkmgit/arrow.git
cd arrow
git checkout bkmgit-update-download-link-maint-3.0.x
git submodule init
git submodule update
export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data"
export ARROW_TEST_DATA="${PWD}/testing/data"
mkdir cpp/build
cd cpp/build
$HOME/cmake-3.21.3-install/bin/cmake .. -DARROW_PARQUET=ON \
-DARROW_WITH_LZ4=ON -DARROW_WITH_ZLIB=ON -DCMAKE_BUILD_TYPE=Debug \
-DARROW_BUILD_TESTS=ON -DARROW_COMPUTE=ON
export PATH=$HOME/cmake-3.21.3-install/bin:$PATH
make
make unittest
{code}
Then get the following failing tests:
{color:#000000} {color}{color:#b21818} 31 - parquet-internals-test (Failed){color}
{color:#b21818} 32 - parquet-reader-test (Failed){color}
{color:#b21818} 34 - parquet-arrow-test (Failed){color}
was (Author: baksmj):
Need to get submodules and export paths:
{code:java}
yum update
yum install gcc-c++ gcc bison flex git python3 make openssl-devel wget
yum groupinstall "Development tools"
yum install centos-release-scl
yum install yum-config-manager
yum install devtoolset-10
scl enable devtoolset-10 bash
wget https://github.com/Kitware/CMake/releases/download/v3.21.3/cmake-3.21.3.tar.gz
tar -xf cmake-3.21.3.tar.gz
cd cmake-3.21.3
mkdir build
cd build/
../bootstrap --prefix=$HOME/cmake-3.21.3-install
make
make install
cd ..
cd ..
git clone https://github.com/bkmgit/arrow.git
cd arrow
git checkout bkmgit-update-download-link-maint-3.0.x
git submodule init
git submodule update
export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data"
export ARROW_TEST_DATA="${PWD}/testing/data"
mkdir cpp/build
cd cpp/build
$HOME/cmake-3.21.3-install/bin/cmake .. -DARROW_PARQUET=ON -DARROW_WITH_LZ4=ON -DARROW_WITH_ZLIB=ON -DCMAKE_BUILD_TYPE=Debug -DARROW_BUILD_TESTS=ON -DARROW_COMPUTE=ONexport PATH=$HOME/cmake-3.21.3-install/bin:$PATH
make
make unittest
{code}
Then get the following failing tests:
{color:#000000} {color}{color:#b21818} 31 - parquet-internals-test (Failed){color}
{color:#b21818} 32 - parquet-reader-test (Failed){color}
{color:#b21818} 34 - parquet-arrow-test (Failed){color}
> [C++][Build] Cannot build with Parquet/Thrift support on CentOS 7
> -----------------------------------------------------------------
>
> Key: ARROW-14160
> URL: https://issues.apache.org/jira/browse/ARROW-14160
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Parquet
> Affects Versions: 3.0.0
> Reporter: Rares Vernica
> Assignee: Benson Muite
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Cannot compile the C++ library for Arrow 3.0.0 in CentOS 7. It breaks if I set {{ARROW_PARQUET=ON}}. It stops while trying to build {{thrift_ep}}
>
> {code:java}
> > scl enable devtoolset-3 "cmake3 .. \
> -DARROW_PARQUET=ON \
> -DARROW_WITH_LZ4=ON \
> -DARROW_WITH_ZLIB=ON \
> -DARROW_COMPUTE=ON \
> -DCMAKE_CXX_COMPILER=/opt/rh/devtoolset-3/root/usr/bin/g++ \
> -DCMAKE_C_COMPILER=/opt/rh/devtoolset-3/root/usr/bin/gcc \
> -DCMAKE_INSTALL_PREFIX=/opt/apache-arrow"
> ...
> apache-arrow-3.0.0/cpp/build> make
> Scanning dependencies of target jemalloc_ep
> [ 1%] Creating directories for 'jemalloc_ep'
> [ 1%] Performing download step (download, verify and extract) for
> 'jemalloc_ep'
> -- jemalloc_ep download command succeeded. See also
> apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-download-*.log
> [ 2%] Performing patch step for 'jemalloc_ep'
> [ 2%] No update step for 'jemalloc_ep'
> [ 2%] Performing configure step for 'jemalloc_ep'
> -- jemalloc_ep configure command succeeded. See also
> apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-configure-*.log
> [ 3%] Performing build step for 'jemalloc_ep'
> -- jemalloc_ep build command succeeded. See also
> apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-build-*.log
> [ 3%] Performing install step for 'jemalloc_ep'
> -- jemalloc_ep install command succeeded. See also
> apache-arrow-3.0.0/cpp/build/jemalloc_ep-prefix/src/jemalloc_ep-stamp/jemalloc_ep-install-*.log
> [ 4%] Completed 'jemalloc_ep'
> [ 4%] Built target jemalloc_ep
> Scanning dependencies of target boost_ep
> [ 4%] Creating directories for 'boost_ep'
> [ 5%] Performing download step (download, verify and extract) for
> 'boost_ep'
> -- boost_ep download command succeeded. See also
> apache-arrow-3.0.0/cpp/build/boost_ep-prefix/src/boost_ep-stamp/boost_ep-download-*.log
> [ 5%] No patch step for 'boost_ep'
> [ 5%] No update step for 'boost_ep'
> [ 6%] No configure step for 'boost_ep'
> [ 6%] No build step for 'boost_ep'
> [ 7%] No install step for 'boost_ep'
> [ 7%] Completed 'boost_ep'
> [ 7%] Built target boost_ep
> Scanning dependencies of target thrift_ep
> [ 7%] Creating directories for 'thrift_ep'
> [ 7%] Performing download step (download, verify and extract) for
> 'thrift_ep'
> -- thrift_ep download command succeeded. See also
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-download-*.log
> [ 7%] No patch step for 'thrift_ep'
> [ 8%] No update step for 'thrift_ep'
> [ 9%] Performing configure step for 'thrift_ep'
> -- thrift_ep configure command succeeded. See also
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-configure-*.log
> [ 9%] Performing build step for 'thrift_ep'
> -- thrift_ep build command succeeded. See also
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-*.log
> [ 10%] Performing install step for 'thrift_ep'
> CMake Error at
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-RELEASE.cmake:37
> (message):
> Command failed: 2
> 'make' 'install'
> See also
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-*.log
> -- stdout output is:
> -- stderr output is:
> make[3]: *** No rule to make target `install'. Stop.
> CMake Error at
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-RELEASE.cmake:47
> (message):
> Stopping after outputting logs.
> make[2]: *** [thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install] Error
> 1
> make[1]: *** [CMakeFiles/thrift_ep.dir/all] Error 2
> make: *** [all] Error 2
> > cat
> apache-arrow-3.0.0/cpp/build/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-install-*.log
> make[3]: *** No rule to make target `install'. Stop.
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)