You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Brian Bowman <Br...@sas.com> on 2019/05/30 19:41:28 UTC
Arrow/Parquet make failing in the Thrift EP
Just started seeing the following ERROR when compiling Arrow/Parquet cpp after restaging my dev environment in RHEL 7.4.
Is something incorrect in my CMake setup where the installed libssl.so required by thrift cannot be found.
<hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
make[5]: *** No rule to make target `/usr/lib/x86_64-linux-gnu/libssl.so', needed by `lib/libthriftd.so.0.11.0'. Stop.
Any ideas what’s going on?
-Brian
Re: Arrow/Parquet make failing in the Thrift EP
Posted by Brian Bowman <Br...@sas.com>.
Removing Thrift 0.11 solved the problem.
Thanks Wes!
-Brian
On 5/30/19, 4:47 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
OK, it looks like you have Thrift 0.11 installed somewhere on your
system which is wreaking havoc
<hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
make[5]: *** No rule to make target
`/usr/lib/x86_64-linux-gnu/libssl.so', needed by
`lib/libthriftd.so.0.11.0'. Stop.
Our thirdparty build should be building Thrift 0.12
https://github.com/apache/arrow/blob/master/cpp/thirdparty/versions.txt#L47
On Thu, May 30, 2019 at 3:40 PM Brian Bowman <Br...@sas.com> wrote:
>
> Thanks Wes,
>
> openssl-devel is installed.
>
> yum info openssl-devel
> Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
> Installed Packages
> Name : openssl-devel
> Arch : x86_64
> Epoch : 1
> Version : 1.0.2k
> Release : 8.el7
> Size : 3.1 M
> Repo : installed
> From repo : anaconda
> . . .
>
> Available Packages
> Name : openssl-devel
> Arch : i686
> Epoch : 1
> Version : 1.0.2k
> Release : 8.el7
> Size : 1.5 M
> Repo : RHEL74
> . . .
>
> I also downloaded and successfully built Thrift.
>
> ll /usr/local/lib/libth*
> -rwxr-xr-x 1 root root 8394200 May 30 14:03 /usr/local/lib/libthrift-0.12.0.so
> -rw-r--r-- 1 root root 20996002 May 30 14:03 /usr/local/lib/libthrift.a
> -rw-r--r-- 1 root root 1224764 May 30 14:05 /usr/local/lib/libthrift_c_glib.a
> -rwxr-xr-x 1 root root 1049 May 30 14:05 /usr/local/lib/libthrift_c_glib.la
> lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so -> libthrift_c_glib.so.0.0.0
> lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0 -> libthrift_c_glib.so.0.0.0
> -rwxr-xr-x 1 root root 669136 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0.0.0
> -rwxr-xr-x 1 root root 999 May 30 14:03 /usr/local/lib/libthrift.la
> -rwxr-xr-x 1 root root 716944 May 30 14:03 /usr/local/lib/libthriftqt-0.12.0.so
> -rw-r--r-- 1 root root 1580088 May 30 14:03 /usr/local/lib/libthriftqt.a
> -rwxr-xr-x 1 root root 1019 May 30 14:03 /usr/local/lib/libthriftqt.la
> lrwxrwxrwx 1 root root 21 May 30 14:03 /usr/local/lib/libthriftqt.so -> libthriftqt-0.12.0.so
> lrwxrwxrwx 1 root root 19 May 30 14:03 /usr/local/lib/libthrift.so -> libthrift-0.12.0.so
> -rwxr-xr-x 1 root root 1175424 May 30 14:03 /usr/local/lib/libthriftz-0.12.0.so
> -rw-r--r-- 1 root root 2631910 May 30 14:03 /usr/local/lib/libthriftz.a
> -rwxr-xr-x 1 root root 995 May 30 14:03 /usr/local/lib/libthriftz.la
> lrwxrwxrwx 1 root root 20 May 30 14:03 /usr/local/lib/libthriftz.so -> libthriftz-0.12.0.so
>
> I'll keep digging.
>
>
> -Brian
>
>
> On 5/30/19, 4:32 PM, "Wes McKinney" <we...@gmail.com> wrote:
>
> EXTERNAL
>
> hi Brian,
>
> Is openssl-devel installed on this system? We don't have any
> OpenSSL-specific code for the Thrift EP build in the Arrow build
> system so you might try to see if you can build Thrift directly from
> source on the system to see if the problem persists
>
> It appears that Thrift tries to build against OpenSSL if CMake can
> detect it on the system
>
> https://github.com/apache/thrift/blob/master/build/cmake/DefineOptions.cmake#L76
>
> - Wes
>
> On Thu, May 30, 2019 at 2:41 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > Just started seeing the following ERROR when compiling Arrow/Parquet cpp after restaging my dev environment in RHEL 7.4.
> >
> > Is something incorrect in my CMake setup where the installed libssl.so required by thrift cannot be found.
> >
> > <hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
> > make[5]: *** No rule to make target `/usr/lib/x86_64-linux-gnu/libssl.so', needed by `lib/libthriftd.so.0.11.0'. Stop.
> >
> > Any ideas what’s going on?
> >
> > -Brian
>
>
Re: Arrow/Parquet make failing in the Thrift EP
Posted by Wes McKinney <we...@gmail.com>.
OK, it looks like you have Thrift 0.11 installed somewhere on your
system which is wreaking havoc
<hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
make[5]: *** No rule to make target
`/usr/lib/x86_64-linux-gnu/libssl.so', needed by
`lib/libthriftd.so.0.11.0'. Stop.
Our thirdparty build should be building Thrift 0.12
https://github.com/apache/arrow/blob/master/cpp/thirdparty/versions.txt#L47
On Thu, May 30, 2019 at 3:40 PM Brian Bowman <Br...@sas.com> wrote:
>
> Thanks Wes,
>
> openssl-devel is installed.
>
> yum info openssl-devel
> Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
> Installed Packages
> Name : openssl-devel
> Arch : x86_64
> Epoch : 1
> Version : 1.0.2k
> Release : 8.el7
> Size : 3.1 M
> Repo : installed
> From repo : anaconda
> . . .
>
> Available Packages
> Name : openssl-devel
> Arch : i686
> Epoch : 1
> Version : 1.0.2k
> Release : 8.el7
> Size : 1.5 M
> Repo : RHEL74
> . . .
>
> I also downloaded and successfully built Thrift.
>
> ll /usr/local/lib/libth*
> -rwxr-xr-x 1 root root 8394200 May 30 14:03 /usr/local/lib/libthrift-0.12.0.so
> -rw-r--r-- 1 root root 20996002 May 30 14:03 /usr/local/lib/libthrift.a
> -rw-r--r-- 1 root root 1224764 May 30 14:05 /usr/local/lib/libthrift_c_glib.a
> -rwxr-xr-x 1 root root 1049 May 30 14:05 /usr/local/lib/libthrift_c_glib.la
> lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so -> libthrift_c_glib.so.0.0.0
> lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0 -> libthrift_c_glib.so.0.0.0
> -rwxr-xr-x 1 root root 669136 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0.0.0
> -rwxr-xr-x 1 root root 999 May 30 14:03 /usr/local/lib/libthrift.la
> -rwxr-xr-x 1 root root 716944 May 30 14:03 /usr/local/lib/libthriftqt-0.12.0.so
> -rw-r--r-- 1 root root 1580088 May 30 14:03 /usr/local/lib/libthriftqt.a
> -rwxr-xr-x 1 root root 1019 May 30 14:03 /usr/local/lib/libthriftqt.la
> lrwxrwxrwx 1 root root 21 May 30 14:03 /usr/local/lib/libthriftqt.so -> libthriftqt-0.12.0.so
> lrwxrwxrwx 1 root root 19 May 30 14:03 /usr/local/lib/libthrift.so -> libthrift-0.12.0.so
> -rwxr-xr-x 1 root root 1175424 May 30 14:03 /usr/local/lib/libthriftz-0.12.0.so
> -rw-r--r-- 1 root root 2631910 May 30 14:03 /usr/local/lib/libthriftz.a
> -rwxr-xr-x 1 root root 995 May 30 14:03 /usr/local/lib/libthriftz.la
> lrwxrwxrwx 1 root root 20 May 30 14:03 /usr/local/lib/libthriftz.so -> libthriftz-0.12.0.so
>
> I'll keep digging.
>
>
> -Brian
>
>
> On 5/30/19, 4:32 PM, "Wes McKinney" <we...@gmail.com> wrote:
>
> EXTERNAL
>
> hi Brian,
>
> Is openssl-devel installed on this system? We don't have any
> OpenSSL-specific code for the Thrift EP build in the Arrow build
> system so you might try to see if you can build Thrift directly from
> source on the system to see if the problem persists
>
> It appears that Thrift tries to build against OpenSSL if CMake can
> detect it on the system
>
> https://github.com/apache/thrift/blob/master/build/cmake/DefineOptions.cmake#L76
>
> - Wes
>
> On Thu, May 30, 2019 at 2:41 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > Just started seeing the following ERROR when compiling Arrow/Parquet cpp after restaging my dev environment in RHEL 7.4.
> >
> > Is something incorrect in my CMake setup where the installed libssl.so required by thrift cannot be found.
> >
> > <hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
> > make[5]: *** No rule to make target `/usr/lib/x86_64-linux-gnu/libssl.so', needed by `lib/libthriftd.so.0.11.0'. Stop.
> >
> > Any ideas what’s going on?
> >
> > -Brian
>
>
Re: Arrow/Parquet make failing in the Thrift EP
Posted by Brian Bowman <Br...@sas.com>.
Thanks Wes,
openssl-devel is installed.
yum info openssl-devel
Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
Installed Packages
Name : openssl-devel
Arch : x86_64
Epoch : 1
Version : 1.0.2k
Release : 8.el7
Size : 3.1 M
Repo : installed
From repo : anaconda
. . .
Available Packages
Name : openssl-devel
Arch : i686
Epoch : 1
Version : 1.0.2k
Release : 8.el7
Size : 1.5 M
Repo : RHEL74
. . .
I also downloaded and successfully built Thrift.
ll /usr/local/lib/libth*
-rwxr-xr-x 1 root root 8394200 May 30 14:03 /usr/local/lib/libthrift-0.12.0.so
-rw-r--r-- 1 root root 20996002 May 30 14:03 /usr/local/lib/libthrift.a
-rw-r--r-- 1 root root 1224764 May 30 14:05 /usr/local/lib/libthrift_c_glib.a
-rwxr-xr-x 1 root root 1049 May 30 14:05 /usr/local/lib/libthrift_c_glib.la
lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so -> libthrift_c_glib.so.0.0.0
lrwxrwxrwx 1 root root 25 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0 -> libthrift_c_glib.so.0.0.0
-rwxr-xr-x 1 root root 669136 May 30 14:05 /usr/local/lib/libthrift_c_glib.so.0.0.0
-rwxr-xr-x 1 root root 999 May 30 14:03 /usr/local/lib/libthrift.la
-rwxr-xr-x 1 root root 716944 May 30 14:03 /usr/local/lib/libthriftqt-0.12.0.so
-rw-r--r-- 1 root root 1580088 May 30 14:03 /usr/local/lib/libthriftqt.a
-rwxr-xr-x 1 root root 1019 May 30 14:03 /usr/local/lib/libthriftqt.la
lrwxrwxrwx 1 root root 21 May 30 14:03 /usr/local/lib/libthriftqt.so -> libthriftqt-0.12.0.so
lrwxrwxrwx 1 root root 19 May 30 14:03 /usr/local/lib/libthrift.so -> libthrift-0.12.0.so
-rwxr-xr-x 1 root root 1175424 May 30 14:03 /usr/local/lib/libthriftz-0.12.0.so
-rw-r--r-- 1 root root 2631910 May 30 14:03 /usr/local/lib/libthriftz.a
-rwxr-xr-x 1 root root 995 May 30 14:03 /usr/local/lib/libthriftz.la
lrwxrwxrwx 1 root root 20 May 30 14:03 /usr/local/lib/libthriftz.so -> libthriftz-0.12.0.so
I'll keep digging.
-Brian
On 5/30/19, 4:32 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
hi Brian,
Is openssl-devel installed on this system? We don't have any
OpenSSL-specific code for the Thrift EP build in the Arrow build
system so you might try to see if you can build Thrift directly from
source on the system to see if the problem persists
It appears that Thrift tries to build against OpenSSL if CMake can
detect it on the system
https://github.com/apache/thrift/blob/master/build/cmake/DefineOptions.cmake#L76
- Wes
On Thu, May 30, 2019 at 2:41 PM Brian Bowman <Br...@sas.com> wrote:
>
> Just started seeing the following ERROR when compiling Arrow/Parquet cpp after restaging my dev environment in RHEL 7.4.
>
> Is something incorrect in my CMake setup where the installed libssl.so required by thrift cannot be found.
>
> <hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
> make[5]: *** No rule to make target `/usr/lib/x86_64-linux-gnu/libssl.so', needed by `lib/libthriftd.so.0.11.0'. Stop.
>
> Any ideas what’s going on?
>
> -Brian
Re: Arrow/Parquet make failing in the Thrift EP
Posted by Wes McKinney <we...@gmail.com>.
hi Brian,
Is openssl-devel installed on this system? We don't have any
OpenSSL-specific code for the Thrift EP build in the Arrow build
system so you might try to see if you can build Thrift directly from
source on the system to see if the problem persists
It appears that Thrift tries to build against OpenSSL if CMake can
detect it on the system
https://github.com/apache/thrift/blob/master/build/cmake/DefineOptions.cmake#L76
- Wes
On Thu, May 30, 2019 at 2:41 PM Brian Bowman <Br...@sas.com> wrote:
>
> Just started seeing the following ERROR when compiling Arrow/Parquet cpp after restaging my dev environment in RHEL 7.4.
>
> Is something incorrect in my CMake setup where the installed libssl.so required by thrift cannot be found.
>
> <hostName> cat ../Arrow/cpp/cmake-build-debug/thrift_ep-prefix/src/thrift_ep-stamp/thrift_ep-build-err.log
> make[5]: *** No rule to make target `/usr/lib/x86_64-linux-gnu/libssl.so', needed by `lib/libthriftd.so.0.11.0'. Stop.
>
> Any ideas what’s going on?
>
> -Brian