You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@impala.apache.org by Bikramjeet Vig <bi...@cloudera.com> on 2017/07/19 23:56:49 UTC

Problem running Impala built with dynamic linking

After fetching latest from asf-gerrit (that has the toolchain commit
related to gflags) and doing a manual toolchain refresh, I am unable to run
impala when I build with "make_debug" or "buildall -so", both statestore
and catalogd show the following error:

ERROR: something wrong with flag 'flagfile' in file
'/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/gflags-2.2.0-p1/src/gflags.cc'.
One possibility: file
'/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/gflags-2.2.0-p1/src/gflags.cc'
is being linked both statically and dynamically into this executable.

I am only able to make it work if I go with static linking by building it
with "buildall" without the "-so"

Anyone facing the same issue?

Re: Problem running Impala built with dynamic linking

Posted by Bikramjeet Vig <bi...@cloudera.com>.

Henry is looking into it. Meanwhile I am working impala statically linked.

On Fri, Jul 21, 2017 at 11:54 AM, Matthew Jacobs <mj...@cloudera.com> wrote:

> Did you ever come to a conclusion on this?
>
> On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> <bi...@cloudera.com> wrote:
> > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> >
> >
> > -- Setup toolchain link flags
> > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -- Build type is DEBUG
> > -- ENABLE_CODE_COVERAGE: false
> > -- Boost version: 1.57.0
> > -- Found the following Boost libraries:
> > --   thread
> > --   regex
> > --   filesystem
> > --   system
> > --   date_time
> > -- Boost include dir:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > -- Boost libraries:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> p3/lib/libboost_date_time.a
> > -- Found OpenSSL:
> > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> linux-gnu/libcrypto.so
> > (found version "1.0.2g")
> > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency openssl_ssl:
> > /usr/lib/x86_64-linux-gnu/libssl.so
> > -- ----------> Adding thirdparty library openssl_crypto. <----------
> > -- Added shared library dependency openssl_crypto:
> > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > -- ----------> Adding thirdparty library bzip2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> include
> > -- Added static library dependency bzip2:
> > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- ----------> Adding thirdparty library zlib. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- Added static library dependency zlib:
> > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > -- ----------> Adding thirdparty library hdfs. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/include
> > -- Added static library dependency hdfs:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/lib/native/libhdfs.a
> > -- ----------> Adding thirdparty library glog. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> > -- Added static library dependency glog:
> > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > -- ----------> Adding thirdparty library gflags. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> include
> > -- Added static library dependency gflags:
> > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > -- ----------> Adding thirdparty library pprof. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> include
> > -- Added static library dependency pprof:
> > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > -- ----------> Adding thirdparty library gtest. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > -- Added static library dependency gtest:
> > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > -- LLVM clang++ found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > -- LLVM opt found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> > -- LLVM include dir:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/lib
> > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency cyrus_sasl:
> > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > -- ----------> Adding thirdparty library ldap. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> include
> > -- Added static library dependency ldap:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > -- ----------> Adding thirdparty library lber. <----------
> > -- Added static library dependency lber:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > -- ----------> Adding thirdparty library thrift. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/
> include
> > -- Added static library dependency thrift:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > -- Thrift version: Thrift version 0.9.0
> > -- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
> > -- Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > -- Found FLATBUFFERS:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > -- ----------> Adding thirdparty library flatbuffers. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> include
> > -- Added static library dependency flatbuffers:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
> > -- FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > -- ----------> Adding thirdparty library snappy. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
> > -- Added static library dependency snappy:
> > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > -- ----------> Adding thirdparty library lz4. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> > -- Added static library dependency lz4:
> > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > -- ----------> Adding thirdparty library re2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/
> include
> > -- Added static library dependency re2:
> > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > -- RapidJson include dir:
> > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > -- ----------> Adding thirdparty library avro. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
> > -- Added static library dependency avro:
> > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > -- Found PROTOBUF:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> > -- ----------> Adding thirdparty library protobuf. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protobuf:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > -- ----------> Adding thirdparty library protoc. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protoc:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> libev.so
> > -- ----------> Adding thirdparty library libev. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> > -- Added static library dependency libev:
> > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > -- Found CRCUTIL:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.so
> >
> > -- ----------> Adding thirdparty library crcutil. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/include
> > -- Added static library dependency crcutil:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.a
> > -- Found JNI:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> 7.0_80/jre/lib/amd64/server/libjvm.so
> >
> > -- ----------> Adding thirdparty library java_jvm. <----------
> > -- Header files:
> > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > -- Added static library dependency java_jvm:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > -- ----------> Adding thirdparty library breakpad. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > -- Added static library dependency breakpad:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> librt.so
> > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> libdl.so
> > Using Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > Found output dir: /home/bikram/dev/Impala/shell/
> > Using FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > -- WARNING: Doxygen not found - Docs will not be created
> > -- Looking for sched_getcpu
> > -- Looking for sched_getcpu - found
> > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
> > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
> > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
> > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > -D__STDC_LIMIT_MACROS
> > -- Common /home/bikram/dev/Impala/be/build/debug/
> > -- Configuring done
> > -- Generating done
> > -- Build files have been written to: /home/bikram/dev/Impala
> >
> >
> > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com
> >> wrote:
> >
> >> Thanks, lemme try it real quick and I'll get back to you
> >>
> >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org>
> wrote:
> >>
> >>> Can you try:
> >>>
> >>> cd $IMPALA_HOME
> >>> rm CMakeCache.txt
> >>> cmake .
> >>> <make impala, however you usually do it>
> >>>
> >>> If that doesn't work, can you send me the output of rm CMakeCache.txt
> &&
> >>> cmake . from IMPALA_HOME?
> >>>
> >>> Thanks,
> >>> Henry
> >>>
> >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
> >>>
> >>> > Sorry, I read too quickly - you've done that already! Let me take a
> >>> look.
> >>> >
> >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
> >>> >
> >>> >> Yep, you need to remove the downloaded version of gflags and
> replace it
> >>> >> with a recent toolchain version. See my mail from yesterday for
> >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> >>> >> impala.apache.org%3E
> >>> >>
> >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com>
> >>> >> wrote:
> >>> >>
> >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> commit
> >>> >>> related to gflags) and doing a manual toolchain refresh, I am
> unable
> >>> to
> >>> >>> run
> >>> >>> impala when I build with "make_debug" or "buildall -so", both
> >>> statestore
> >>> >>> and catalogd show the following error:
> >>> >>>
> >>> >>> ERROR: something wrong with flag 'flagfile' in file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> >>> >>> One possibility: file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> >>> >>> is being linked both statically and dynamically into this
> executable.
> >>> >>>
> >>> >>> I am only able to make it work if I go with static linking by
> >>> building it
> >>> >>> with "buildall" without the "-so"
> >>> >>>
> >>> >>> Anyone facing the same issue?
> >>> >>>
> >>> >>
> >>> >>
> >>> >
> >>> >
> >>> > --
> >>> > Henry Robinson
> >>> > Software Engineer
> >>> > Cloudera
> >>> > 415-994-6679 <(415)%20994-6679>
> >>> >
> >>>
> >>
> >>
>

Re: Problem running Impala built with dynamic linking

Posted by Bikramjeet Vig <bi...@cloudera.com>.

Yup, I tried without ninja, still dosent work

On Wed, Jul 26, 2017 at 8:30 PM, Vincent Tran <vt...@cloudera.com> wrote:

> I ran it without -ninja and with -build_shared_libs option one time and it
> got fixed. Is that the same as -so? The -help menu wasn't clear about
> whether they are interchangeable or they are two opposite options.
>
> I just ran it again with -so. It still seems to work.
>
> On Wed, Jul 26, 2017 at 8:26 PM, Lars Volker <lv...@cloudera.com> wrote:
>
> > Vincent, did you build without ninja but with -so enabled? That still
> give
> > me the same error.
> >
> > On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran <vt...@cloudera.com>
> > wrote:
> >
> > > This happened to me last evening. I turned off ninja build and did a
> full
> > > build. Seems to have fixed it.
> > > Not sure if it's the exact same root cause here though (if you don't
> use
> > > ninja).
> > >
> > > On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs <mj...@cloudera.com>
> wrote:
> > >
> > > > Did you ever come to a conclusion on this?
> > > >
> > > > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> > > > <bi...@cloudera.com> wrote:
> > > > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > > > >
> > > > >
> > > > > -- Setup toolchain link flags
> > > > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > > -- Build type is DEBUG
> > > > > -- ENABLE_CODE_COVERAGE: false
> > > > > -- Boost version: 1.57.0
> > > > > -- Found the following Boost libraries:
> > > > > --   thread
> > > > > --   regex
> > > > > --   filesystem
> > > > > --   system
> > > > > --   date_time
> > > > > -- Boost include dir:
> > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > > > -- Boost libraries:
> > > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > > > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > > > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > > > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > > > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > > > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > > > p3/lib/libboost_date_time.a
> > > > > -- Found OpenSSL:
> > > > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > > > linux-gnu/libcrypto.so
> > > > > (found version "1.0.2g")
> > > > > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > > > > -- Header files: /usr/include
> > > > > -- Added shared library dependency openssl_ssl:
> > > > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > > > -- ----------> Adding thirdparty library openssl_crypto.
> <----------
> > > > > -- Added shared library dependency openssl_crypto:
> > > > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > > > -- ----------> Adding thirdparty library bzip2. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > > > include
> > > > > -- Added static library dependency bzip2:
> > > > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > > > -- ----------> Adding thirdparty library zlib. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/zlib-1.2.8/include
> > > > > -- Added static library dependency zlib:
> > > > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > > > -- ----------> Adding thirdparty library hdfs. <----------
> > > > > -- Header files:
> > > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > > hadoop-2.6.0-cdh5.13.0-
> > > > SNAPSHOT/include
> > > > > -- Added static library dependency hdfs:
> > > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > > hadoop-2.6.0-cdh5.13.0-
> > > > SNAPSHOT/lib/native/libhdfs.a
> > > > > -- ----------> Adding thirdparty library glog. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> > > include
> > > > > -- Added static library dependency glog:
> > > > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > > > -- ----------> Adding thirdparty library gflags. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/gflags-2.2.0-p1/
> > > > include
> > > > > -- Added static library dependency gflags:
> > > > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > > > -- ----------> Adding thirdparty library pprof. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > > > include
> > > > > -- Added static library dependency pprof:
> > > > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > > > -- ----------> Adding thirdparty library gtest. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/gtest-1.6.0/include
> > > > > -- Added static library dependency gtest:
> > > > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > > > > -- LLVM llvm-config found at:
> > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > > > > -- LLVM clang++ found at:
> > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > > > > -- LLVM opt found at:
> > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > > > > -- LLVM_ROOT: /home/bikram/dev/Impala/
> toolchain/llvm-3.8.0-asserts-
> > p1
> > > > > -- LLVM llvm-config found at:
> > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> > > p1/bin/llvm-config
> > > > > -- LLVM include dir:
> > > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > > > > -- LLVM lib dir: /home/bikram/dev/Impala/
> > toolchain/llvm-3.8.0-asserts-
> > > > p1/lib
> > > > > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > > > > -- Header files: /usr/include
> > > > > -- Added shared library dependency cyrus_sasl:
> > > > > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > > > > -- ----------> Adding thirdparty library ldap. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/openldap-2.4.25/
> > > > include
> > > > > -- Added static library dependency ldap:
> > > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > > > > -- ----------> Adding thirdparty library lber. <----------
> > > > > -- Added static library dependency lber:
> > > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > > > > -- ----------> Adding thirdparty library thrift. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/thrift-0.9.0-p9/
> > > > include
> > > > > -- Added static library dependency thrift:
> > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > > > > -- Thrift version: Thrift version 0.9.0
> > > > > -- Thrift contrib dir: /home/bikram/dev/Impala/
> > > toolchain/thrift-0.9.0-p9
> > > > > -- Thrift compiler:
> > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > > > -- Found FLATBUFFERS:
> > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > > > > -- ----------> Adding thirdparty library flatbuffers. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/flatbuffers-1.6.0/
> > > > include
> > > > > -- Added static library dependency flatbuffers:
> > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> > > lib/libflatbuffers.a
> > > > > -- FlatBuffers compiler:
> > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > > > -- ----------> Adding thirdparty library snappy. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> > > toolchain/snappy-1.1.4/include
> > > > > -- Added static library dependency snappy:
> > > > > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > > > > -- ----------> Adding thirdparty library lz4. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/lz4-1.7.5/include
> > > > > -- Added static library dependency lz4:
> > > > > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > > > > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > > > > -- ----------> Adding thirdparty library re2. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/re2-20130115-p1/
> > > > include
> > > > > -- Added static library dependency re2:
> > > > > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > > > > -- RapidJson include dir:
> > > > > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > > > > -- ----------> Adding thirdparty library avro. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/
> > > include
> > > > > -- Added static library dependency avro:
> > > > > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > > > > -- Found PROTOBUF:
> > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/
> libprotobuf.so
> > > > > -- ----------> Adding thirdparty library protobuf. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > > > include
> > > > > -- Added static library dependency protobuf:
> > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > > > > -- ----------> Adding thirdparty library protoc. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > > > include
> > > > > -- Added static library dependency protoc:
> > > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > > > > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> > > > libev.so
> > > > > -- ----------> Adding thirdparty library libev. <----------
> > > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/libev-4.20/include
> > > > > -- Added static library dependency libev:
> > > > > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > > > > -- Found CRCUTIL:
> > > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > > 440ba7babeff77ffad992df3a10c76
> > > > 7f184e946e-p1/lib/libcrcutil.so
> > > > >
> > > > > -- ----------> Adding thirdparty library crcutil. <----------
> > > > > -- Header files:
> > > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > > 440ba7babeff77ffad992df3a10c76
> > > > 7f184e946e-p1/include
> > > > > -- Added static library dependency crcutil:
> > > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > > 440ba7babeff77ffad992df3a10c76
> > > > 7f184e946e-p1/lib/libcrcutil.a
> > > > > -- Found JNI:
> > > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> > > > jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> > > > 7.0_80/jre/lib/amd64/server/libjvm.so
> > > > >
> > > > > -- ----------> Adding thirdparty library java_jvm. <----------
> > > > > -- Header files:
> > > > > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> > > > 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > > > > -- Added static library dependency java_jvm:
> > > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > > > > -- ----------> Adding thirdparty library breakpad. <----------
> > > > > -- Header files:
> > > > > /home/bikram/dev/Impala/toolchain/breakpad-
> > > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > > > > -- Added static library dependency breakpad:
> > > > > /home/bikram/dev/Impala/toolchain/breakpad-
> > > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > > > > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> > > > librt.so
> > > > > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> > > > libdl.so
> > > > > Using Thrift compiler:
> > > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > > > Found output dir: /home/bikram/dev/Impala/shell/
> > > > > Using FlatBuffers compiler:
> > > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > > > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > > > > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > > > > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > > > > -- WARNING: Doxygen not found - Docs will not be created
> > > > > -- Looking for sched_getcpu
> > > > > -- Looking for sched_getcpu - found
> > > > > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas
> > > -pthread
> > > > > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > > > > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG
> -DBOOST_SYSTEM_NO_DEPRECATED
> > > -B
> > > > > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/
> -fuse-ld=gold
> > > -g
> > > > > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > > > > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > > > > -D__STDC_LIMIT_MACROS
> > > > > -- Common /home/bikram/dev/Impala/be/build/debug/
> > > > > -- Configuring done
> > > > > -- Generating done
> > > > > -- Build files have been written to: /home/bikram/dev/Impala
> > > > >
> > > > >
> > > > > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> > > > bikramjeet.vig@cloudera.com
> > > > >> wrote:
> > > > >
> > > > >> Thanks, lemme try it real quick and I'll get back to you
> > > > >>
> > > > >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <henry@apache.org
> >
> > > > wrote:
> > > > >>
> > > > >>> Can you try:
> > > > >>>
> > > > >>> cd $IMPALA_HOME
> > > > >>> rm CMakeCache.txt
> > > > >>> cmake .
> > > > >>> <make impala, however you usually do it>
> > > > >>>
> > > > >>> If that doesn't work, can you send me the output of rm
> > CMakeCache.txt
> > > > &&
> > > > >>> cmake . from IMPALA_HOME?
> > > > >>>
> > > > >>> Thanks,
> > > > >>> Henry
> > > > >>>
> > > > >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com>
> > wrote:
> > > > >>>
> > > > >>> > Sorry, I read too quickly - you've done that already! Let me
> > take a
> > > > >>> look.
> > > > >>> >
> > > > >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org>
> > wrote:
> > > > >>> >
> > > > >>> >> Yep, you need to remove the downloaded version of gflags and
> > > > replace it
> > > > >>> >> with a recent toolchain version. See my mail from yesterday
> for
> > > > >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> > > > >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> > > > >>> >> impala.apache.org%3E
> > > > >>> >>
> > > > >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> > > > bikramjeet.vig@cloudera.com>
> > > > >>> >> wrote:
> > > > >>> >>
> > > > >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> > > > commit
> > > > >>> >>> related to gflags) and doing a manual toolchain refresh, I am
> > > > unable
> > > > >>> to
> > > > >>> >>> run
> > > > >>> >>> impala when I build with "make_debug" or "buildall -so", both
> > > > >>> statestore
> > > > >>> >>> and catalogd show the following error:
> > > > >>> >>>
> > > > >>> >>> ERROR: something wrong with flag 'flagfile' in file
> > > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > > > >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> > > > >>> >>> One possibility: file
> > > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > > > >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> > > > >>> >>> is being linked both statically and dynamically into this
> > > > executable.
> > > > >>> >>>
> > > > >>> >>> I am only able to make it work if I go with static linking by
> > > > >>> building it
> > > > >>> >>> with "buildall" without the "-so"
> > > > >>> >>>
> > > > >>> >>> Anyone facing the same issue?
> > > > >>> >>>
> > > > >>> >>
> > > > >>> >>
> > > > >>> >
> > > > >>> >
> > > > >>> > --
> > > > >>> > Henry Robinson
> > > > >>> > Software Engineer
> > > > >>> > Cloudera
> > > > >>> > 415-994-6679 <(415)%20994-6679>
> > > > >>> >
> > > > >>>
> > > > >>
> > > > >>
> > > >
> > >
> > >
> > >
> > > --
> > > Vincent T. Tran
> > > Customer Operations Engineer
> > > Cloudera, Inc.
> > >
> >
>
>
>
> --
> Vincent T. Tran
> Customer Operations Engineer
> Cloudera, Inc.
>

Re: Problem running Impala built with dynamic linking

Posted by Vincent Tran <vt...@cloudera.com>.

I ran it without -ninja and with -build_shared_libs option one time and it
got fixed. Is that the same as -so? The -help menu wasn't clear about
whether they are interchangeable or they are two opposite options.

I just ran it again with -so. It still seems to work.

On Wed, Jul 26, 2017 at 8:26 PM, Lars Volker <lv...@cloudera.com> wrote:

> Vincent, did you build without ninja but with -so enabled? That still give
> me the same error.
>
> On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran <vt...@cloudera.com>
> wrote:
>
> > This happened to me last evening. I turned off ninja build and did a full
> > build. Seems to have fixed it.
> > Not sure if it's the exact same root cause here though (if you don't use
> > ninja).
> >
> > On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs <mj...@cloudera.com> wrote:
> >
> > > Did you ever come to a conclusion on this?
> > >
> > > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> > > <bi...@cloudera.com> wrote:
> > > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > > >
> > > >
> > > > -- Setup toolchain link flags
> > > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > > -- Build type is DEBUG
> > > > -- ENABLE_CODE_COVERAGE: false
> > > > -- Boost version: 1.57.0
> > > > -- Found the following Boost libraries:
> > > > --   thread
> > > > --   regex
> > > > --   filesystem
> > > > --   system
> > > > --   date_time
> > > > -- Boost include dir:
> > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > > -- Boost libraries:
> > > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > > p3/lib/libboost_date_time.a
> > > > -- Found OpenSSL:
> > > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > > linux-gnu/libcrypto.so
> > > > (found version "1.0.2g")
> > > > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > > > -- Header files: /usr/include
> > > > -- Added shared library dependency openssl_ssl:
> > > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > > -- ----------> Adding thirdparty library openssl_crypto. <----------
> > > > -- Added shared library dependency openssl_crypto:
> > > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > > -- ----------> Adding thirdparty library bzip2. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > > include
> > > > -- Added static library dependency bzip2:
> > > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > > -- ----------> Adding thirdparty library zlib. <----------
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/zlib-1.2.8/include
> > > > -- Added static library dependency zlib:
> > > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > > -- ----------> Adding thirdparty library hdfs. <----------
> > > > -- Header files:
> > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > hadoop-2.6.0-cdh5.13.0-
> > > SNAPSHOT/include
> > > > -- Added static library dependency hdfs:
> > > > /home/bikram/dev/Impala/toolchain/cdh_components/
> > hadoop-2.6.0-cdh5.13.0-
> > > SNAPSHOT/lib/native/libhdfs.a
> > > > -- ----------> Adding thirdparty library glog. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> > include
> > > > -- Added static library dependency glog:
> > > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > > -- ----------> Adding thirdparty library gflags. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> > > include
> > > > -- Added static library dependency gflags:
> > > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > > -- ----------> Adding thirdparty library pprof. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > > include
> > > > -- Added static library dependency pprof:
> > > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > > -- ----------> Adding thirdparty library gtest. <----------
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/gtest-1.6.0/include
> > > > -- Added static library dependency gtest:
> > > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > > > -- LLVM llvm-config found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > > > -- LLVM clang++ found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > > > -- LLVM opt found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > > > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1
> > > > -- LLVM llvm-config found at:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> > p1/bin/llvm-config
> > > > -- LLVM include dir:
> > > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > > > -- LLVM lib dir: /home/bikram/dev/Impala/
> toolchain/llvm-3.8.0-asserts-
> > > p1/lib
> > > > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > > > -- Header files: /usr/include
> > > > -- Added shared library dependency cyrus_sasl:
> > > > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > > > -- ----------> Adding thirdparty library ldap. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> > > include
> > > > -- Added static library dependency ldap:
> > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > > > -- ----------> Adding thirdparty library lber. <----------
> > > > -- Added static library dependency lber:
> > > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > > > -- ----------> Adding thirdparty library thrift. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/
> > > include
> > > > -- Added static library dependency thrift:
> > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > > > -- Thrift version: Thrift version 0.9.0
> > > > -- Thrift contrib dir: /home/bikram/dev/Impala/
> > toolchain/thrift-0.9.0-p9
> > > > -- Thrift compiler:
> > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > > -- Found FLATBUFFERS:
> > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > > > -- ----------> Adding thirdparty library flatbuffers. <----------
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/flatbuffers-1.6.0/
> > > include
> > > > -- Added static library dependency flatbuffers:
> > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> > lib/libflatbuffers.a
> > > > -- FlatBuffers compiler:
> > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > > -- ----------> Adding thirdparty library snappy. <----------
> > > > -- Header files: /home/bikram/dev/Impala/
> > toolchain/snappy-1.1.4/include
> > > > -- Added static library dependency snappy:
> > > > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > > > -- ----------> Adding thirdparty library lz4. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> > > > -- Added static library dependency lz4:
> > > > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > > > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > > > -- ----------> Adding thirdparty library re2. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/
> > > include
> > > > -- Added static library dependency re2:
> > > > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > > > -- RapidJson include dir:
> > > > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > > > -- ----------> Adding thirdparty library avro. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/
> > include
> > > > -- Added static library dependency avro:
> > > > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > > > -- Found PROTOBUF:
> > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> > > > -- ----------> Adding thirdparty library protobuf. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > > include
> > > > -- Added static library dependency protobuf:
> > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > > > -- ----------> Adding thirdparty library protoc. <----------
> > > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > > include
> > > > -- Added static library dependency protoc:
> > > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > > > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> > > libev.so
> > > > -- ----------> Adding thirdparty library libev. <----------
> > > > -- Header files: /home/bikram/dev/Impala/
> toolchain/libev-4.20/include
> > > > -- Added static library dependency libev:
> > > > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > > > -- Found CRCUTIL:
> > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > 440ba7babeff77ffad992df3a10c76
> > > 7f184e946e-p1/lib/libcrcutil.so
> > > >
> > > > -- ----------> Adding thirdparty library crcutil. <----------
> > > > -- Header files:
> > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > 440ba7babeff77ffad992df3a10c76
> > > 7f184e946e-p1/include
> > > > -- Added static library dependency crcutil:
> > > > /home/bikram/dev/Impala/toolchain/crcutil-
> > 440ba7babeff77ffad992df3a10c76
> > > 7f184e946e-p1/lib/libcrcutil.a
> > > > -- Found JNI:
> > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> > > jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> > > 7.0_80/jre/lib/amd64/server/libjvm.so
> > > >
> > > > -- ----------> Adding thirdparty library java_jvm. <----------
> > > > -- Header files:
> > > > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> > > 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > > > -- Added static library dependency java_jvm:
> > > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > > > -- ----------> Adding thirdparty library breakpad. <----------
> > > > -- Header files:
> > > > /home/bikram/dev/Impala/toolchain/breakpad-
> > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > > > -- Added static library dependency breakpad:
> > > > /home/bikram/dev/Impala/toolchain/breakpad-
> > > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > > > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> > > librt.so
> > > > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> > > libdl.so
> > > > Using Thrift compiler:
> > > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > > Found output dir: /home/bikram/dev/Impala/shell/
> > > > Using FlatBuffers compiler:
> > > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > > > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > > > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > > > -- WARNING: Doxygen not found - Docs will not be created
> > > > -- Looking for sched_getcpu
> > > > -- Looking for sched_getcpu - found
> > > > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas
> > -pthread
> > > > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > > > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED
> > -B
> > > > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold
> > -g
> > > > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > > > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > > > -D__STDC_LIMIT_MACROS
> > > > -- Common /home/bikram/dev/Impala/be/build/debug/
> > > > -- Configuring done
> > > > -- Generating done
> > > > -- Build files have been written to: /home/bikram/dev/Impala
> > > >
> > > >
> > > > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> > > bikramjeet.vig@cloudera.com
> > > >> wrote:
> > > >
> > > >> Thanks, lemme try it real quick and I'll get back to you
> > > >>
> > > >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org>
> > > wrote:
> > > >>
> > > >>> Can you try:
> > > >>>
> > > >>> cd $IMPALA_HOME
> > > >>> rm CMakeCache.txt
> > > >>> cmake .
> > > >>> <make impala, however you usually do it>
> > > >>>
> > > >>> If that doesn't work, can you send me the output of rm
> CMakeCache.txt
> > > &&
> > > >>> cmake . from IMPALA_HOME?
> > > >>>
> > > >>> Thanks,
> > > >>> Henry
> > > >>>
> > > >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com>
> wrote:
> > > >>>
> > > >>> > Sorry, I read too quickly - you've done that already! Let me
> take a
> > > >>> look.
> > > >>> >
> > > >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org>
> wrote:
> > > >>> >
> > > >>> >> Yep, you need to remove the downloaded version of gflags and
> > > replace it
> > > >>> >> with a recent toolchain version. See my mail from yesterday for
> > > >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> > > >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> > > >>> >> impala.apache.org%3E
> > > >>> >>
> > > >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> > > bikramjeet.vig@cloudera.com>
> > > >>> >> wrote:
> > > >>> >>
> > > >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> > > commit
> > > >>> >>> related to gflags) and doing a manual toolchain refresh, I am
> > > unable
> > > >>> to
> > > >>> >>> run
> > > >>> >>> impala when I build with "make_debug" or "buildall -so", both
> > > >>> statestore
> > > >>> >>> and catalogd show the following error:
> > > >>> >>>
> > > >>> >>> ERROR: something wrong with flag 'flagfile' in file
> > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > > >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> > > >>> >>> One possibility: file
> > > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > > >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> > > >>> >>> is being linked both statically and dynamically into this
> > > executable.
> > > >>> >>>
> > > >>> >>> I am only able to make it work if I go with static linking by
> > > >>> building it
> > > >>> >>> with "buildall" without the "-so"
> > > >>> >>>
> > > >>> >>> Anyone facing the same issue?
> > > >>> >>>
> > > >>> >>
> > > >>> >>
> > > >>> >
> > > >>> >
> > > >>> > --
> > > >>> > Henry Robinson
> > > >>> > Software Engineer
> > > >>> > Cloudera
> > > >>> > 415-994-6679 <(415)%20994-6679>
> > > >>> >
> > > >>>
> > > >>
> > > >>
> > >
> >
> >
> >
> > --
> > Vincent T. Tran
> > Customer Operations Engineer
> > Cloudera, Inc.
> >
>



-- 
Vincent T. Tran
Customer Operations Engineer
Cloudera, Inc.

Re: Problem running Impala built with dynamic linking

Posted by Lars Volker <lv...@cloudera.com>.

Vincent, did you build without ninja but with -so enabled? That still give
me the same error.

On Fri, Jul 21, 2017 at 12:01 PM, Vincent Tran <vt...@cloudera.com> wrote:

> This happened to me last evening. I turned off ninja build and did a full
> build. Seems to have fixed it.
> Not sure if it's the exact same root cause here though (if you don't use
> ninja).
>
> On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs <mj...@cloudera.com> wrote:
>
> > Did you ever come to a conclusion on this?
> >
> > On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> > <bi...@cloudera.com> wrote:
> > > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> > >
> > >
> > > -- Setup toolchain link flags
> > > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > > -- Build type is DEBUG
> > > -- ENABLE_CODE_COVERAGE: false
> > > -- Boost version: 1.57.0
> > > -- Found the following Boost libraries:
> > > --   thread
> > > --   regex
> > > --   filesystem
> > > --   system
> > > --   date_time
> > > -- Boost include dir:
> > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > > -- Boost libraries:
> > > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> > libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> > 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> > toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> > bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> > system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> > p3/lib/libboost_date_time.a
> > > -- Found OpenSSL:
> > > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> > linux-gnu/libcrypto.so
> > > (found version "1.0.2g")
> > > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > > -- Header files: /usr/include
> > > -- Added shared library dependency openssl_ssl:
> > > /usr/lib/x86_64-linux-gnu/libssl.so
> > > -- ----------> Adding thirdparty library openssl_crypto. <----------
> > > -- Added shared library dependency openssl_crypto:
> > > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > > -- ----------> Adding thirdparty library bzip2. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> > include
> > > -- Added static library dependency bzip2:
> > > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > -- ----------> Adding thirdparty library zlib. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > > -- Added static library dependency zlib:
> > > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > > -- ----------> Adding thirdparty library hdfs. <----------
> > > -- Header files:
> > > /home/bikram/dev/Impala/toolchain/cdh_components/
> hadoop-2.6.0-cdh5.13.0-
> > SNAPSHOT/include
> > > -- Added static library dependency hdfs:
> > > /home/bikram/dev/Impala/toolchain/cdh_components/
> hadoop-2.6.0-cdh5.13.0-
> > SNAPSHOT/lib/native/libhdfs.a
> > > -- ----------> Adding thirdparty library glog. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/
> include
> > > -- Added static library dependency glog:
> > > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > > -- ----------> Adding thirdparty library gflags. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> > include
> > > -- Added static library dependency gflags:
> > > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > > -- ----------> Adding thirdparty library pprof. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> > include
> > > -- Added static library dependency pprof:
> > > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > > -- ----------> Adding thirdparty library gtest. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > > -- Added static library dependency gtest:
> > > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > > -- LLVM llvm-config found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > > -- LLVM clang++ found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > > -- LLVM opt found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > > -- LLVM llvm-config found at:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/bin/llvm-config
> > > -- LLVM include dir:
> > > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> > p1/lib
> > > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > > -- Header files: /usr/include
> > > -- Added shared library dependency cyrus_sasl:
> > > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > > -- ----------> Adding thirdparty library ldap. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> > include
> > > -- Added static library dependency ldap:
> > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > > -- ----------> Adding thirdparty library lber. <----------
> > > -- Added static library dependency lber:
> > > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > > -- ----------> Adding thirdparty library thrift. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/
> > include
> > > -- Added static library dependency thrift:
> > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > > -- Thrift version: Thrift version 0.9.0
> > > -- Thrift contrib dir: /home/bikram/dev/Impala/
> toolchain/thrift-0.9.0-p9
> > > -- Thrift compiler:
> > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > -- Found FLATBUFFERS:
> > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > > -- ----------> Adding thirdparty library flatbuffers. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> > include
> > > -- Added static library dependency flatbuffers:
> > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> lib/libflatbuffers.a
> > > -- FlatBuffers compiler:
> > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > -- ----------> Adding thirdparty library snappy. <----------
> > > -- Header files: /home/bikram/dev/Impala/
> toolchain/snappy-1.1.4/include
> > > -- Added static library dependency snappy:
> > > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > > -- ----------> Adding thirdparty library lz4. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> > > -- Added static library dependency lz4:
> > > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > > -- ----------> Adding thirdparty library re2. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/
> > include
> > > -- Added static library dependency re2:
> > > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > > -- RapidJson include dir:
> > > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > > -- ----------> Adding thirdparty library avro. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/
> include
> > > -- Added static library dependency avro:
> > > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > > -- Found PROTOBUF:
> > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> > > -- ----------> Adding thirdparty library protobuf. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > include
> > > -- Added static library dependency protobuf:
> > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > > -- ----------> Adding thirdparty library protoc. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> > include
> > > -- Added static library dependency protoc:
> > > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> > libev.so
> > > -- ----------> Adding thirdparty library libev. <----------
> > > -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> > > -- Added static library dependency libev:
> > > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > > -- Found CRCUTIL:
> > > /home/bikram/dev/Impala/toolchain/crcutil-
> 440ba7babeff77ffad992df3a10c76
> > 7f184e946e-p1/lib/libcrcutil.so
> > >
> > > -- ----------> Adding thirdparty library crcutil. <----------
> > > -- Header files:
> > > /home/bikram/dev/Impala/toolchain/crcutil-
> 440ba7babeff77ffad992df3a10c76
> > 7f184e946e-p1/include
> > > -- Added static library dependency crcutil:
> > > /home/bikram/dev/Impala/toolchain/crcutil-
> 440ba7babeff77ffad992df3a10c76
> > 7f184e946e-p1/lib/libcrcutil.a
> > > -- Found JNI:
> > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> > jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> > 7.0_80/jre/lib/amd64/server/libjvm.so
> > >
> > > -- ----------> Adding thirdparty library java_jvm. <----------
> > > -- Header files:
> > > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> > 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > > -- Added static library dependency java_jvm:
> > > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > > -- ----------> Adding thirdparty library breakpad. <----------
> > > -- Header files:
> > > /home/bikram/dev/Impala/toolchain/breakpad-
> > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > > -- Added static library dependency breakpad:
> > > /home/bikram/dev/Impala/toolchain/breakpad-
> > ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> > librt.so
> > > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> > libdl.so
> > > Using Thrift compiler:
> > > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > > Found output dir: /home/bikram/dev/Impala/shell/
> > > Using FlatBuffers compiler:
> > > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > > -- WARNING: Doxygen not found - Docs will not be created
> > > -- Looking for sched_getcpu
> > > -- Looking for sched_getcpu - found
> > > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas
> -pthread
> > > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED
> -B
> > > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold
> -g
> > > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > > -D__STDC_LIMIT_MACROS
> > > -- Common /home/bikram/dev/Impala/be/build/debug/
> > > -- Configuring done
> > > -- Generating done
> > > -- Build files have been written to: /home/bikram/dev/Impala
> > >
> > >
> > > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> > bikramjeet.vig@cloudera.com
> > >> wrote:
> > >
> > >> Thanks, lemme try it real quick and I'll get back to you
> > >>
> > >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org>
> > wrote:
> > >>
> > >>> Can you try:
> > >>>
> > >>> cd $IMPALA_HOME
> > >>> rm CMakeCache.txt
> > >>> cmake .
> > >>> <make impala, however you usually do it>
> > >>>
> > >>> If that doesn't work, can you send me the output of rm CMakeCache.txt
> > &&
> > >>> cmake . from IMPALA_HOME?
> > >>>
> > >>> Thanks,
> > >>> Henry
> > >>>
> > >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
> > >>>
> > >>> > Sorry, I read too quickly - you've done that already! Let me take a
> > >>> look.
> > >>> >
> > >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
> > >>> >
> > >>> >> Yep, you need to remove the downloaded version of gflags and
> > replace it
> > >>> >> with a recent toolchain version. See my mail from yesterday for
> > >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> > >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> > >>> >> impala.apache.org%3E
> > >>> >>
> > >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> > bikramjeet.vig@cloudera.com>
> > >>> >> wrote:
> > >>> >>
> > >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> > commit
> > >>> >>> related to gflags) and doing a manual toolchain refresh, I am
> > unable
> > >>> to
> > >>> >>> run
> > >>> >>> impala when I build with "make_debug" or "buildall -so", both
> > >>> statestore
> > >>> >>> and catalogd show the following error:
> > >>> >>>
> > >>> >>> ERROR: something wrong with flag 'flagfile' in file
> > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> > >>> >>> One possibility: file
> > >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> > >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> > >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> > >>> >>> is being linked both statically and dynamically into this
> > executable.
> > >>> >>>
> > >>> >>> I am only able to make it work if I go with static linking by
> > >>> building it
> > >>> >>> with "buildall" without the "-so"
> > >>> >>>
> > >>> >>> Anyone facing the same issue?
> > >>> >>>
> > >>> >>
> > >>> >>
> > >>> >
> > >>> >
> > >>> > --
> > >>> > Henry Robinson
> > >>> > Software Engineer
> > >>> > Cloudera
> > >>> > 415-994-6679 <(415)%20994-6679>
> > >>> >
> > >>>
> > >>
> > >>
> >
>
>
>
> --
> Vincent T. Tran
> Customer Operations Engineer
> Cloudera, Inc.
>

Re: Problem running Impala built with dynamic linking

Posted by Vincent Tran <vt...@cloudera.com>.

This happened to me last evening. I turned off ninja build and did a full
build. Seems to have fixed it.
Not sure if it's the exact same root cause here though (if you don't use
ninja).

On Fri, Jul 21, 2017 at 2:54 PM, Matthew Jacobs <mj...@cloudera.com> wrote:

> Did you ever come to a conclusion on this?
>
> On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
> <bi...@cloudera.com> wrote:
> > Didn't work, heres the output of rm CMakeCache.txt && cmake .
> >
> >
> > -- Setup toolchain link flags
> > -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> > -- Build type is DEBUG
> > -- ENABLE_CODE_COVERAGE: false
> > -- Boost version: 1.57.0
> > -- Found the following Boost libraries:
> > --   thread
> > --   regex
> > --   filesystem
> > --   system
> > --   date_time
> > -- Boost include dir:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> > -- Boost libraries:
> > /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/
> libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.
> 57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/
> toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/
> bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_
> system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-
> p3/lib/libboost_date_time.a
> > -- Found OpenSSL:
> > /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-
> linux-gnu/libcrypto.so
> > (found version "1.0.2g")
> > -- ----------> Adding thirdparty library openssl_ssl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency openssl_ssl:
> > /usr/lib/x86_64-linux-gnu/libssl.so
> > -- ----------> Adding thirdparty library openssl_crypto. <----------
> > -- Added shared library dependency openssl_crypto:
> > /usr/lib/x86_64-linux-gnu/libcrypto.so
> > -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> > -- ----------> Adding thirdparty library bzip2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/
> include
> > -- Added static library dependency bzip2:
> > /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> > -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- ----------> Adding thirdparty library zlib. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> > -- Added static library dependency zlib:
> > /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> > -- ----------> Adding thirdparty library hdfs. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/include
> > -- Added static library dependency hdfs:
> > /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-
> SNAPSHOT/lib/native/libhdfs.a
> > -- ----------> Adding thirdparty library glog. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> > -- Added static library dependency glog:
> > /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> > -- ----------> Adding thirdparty library gflags. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/
> include
> > -- Added static library dependency gflags:
> > /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> > -- ----------> Adding thirdparty library pprof. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/
> include
> > -- Added static library dependency pprof:
> > /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> > -- ----------> Adding thirdparty library gtest. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> > -- Added static library dependency gtest:
> > /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> > -- LLVM clang++ found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> > -- LLVM opt found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> > -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> > -- LLVM llvm-config found at:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> > -- LLVM include dir:
> > /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> > -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-
> p1/lib
> > -- ----------> Adding thirdparty library cyrus_sasl. <----------
> > -- Header files: /usr/include
> > -- Added shared library dependency cyrus_sasl:
> > /usr/lib/x86_64-linux-gnu/libsasl2.so
> > -- ----------> Adding thirdparty library ldap. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/
> include
> > -- Added static library dependency ldap:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> > -- ----------> Adding thirdparty library lber. <----------
> > -- Added static library dependency lber:
> > /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> > -- ----------> Adding thirdparty library thrift. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/
> include
> > -- Added static library dependency thrift:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> > -- Thrift version: Thrift version 0.9.0
> > -- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
> > -- Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > -- Found FLATBUFFERS:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> > -- ----------> Adding thirdparty library flatbuffers. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/
> include
> > -- Added static library dependency flatbuffers:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
> > -- FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > -- ----------> Adding thirdparty library snappy. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
> > -- Added static library dependency snappy:
> > /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> > -- ----------> Adding thirdparty library lz4. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> > -- Added static library dependency lz4:
> > /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> > -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> > -- ----------> Adding thirdparty library re2. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/
> include
> > -- Added static library dependency re2:
> > /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> > -- RapidJson include dir:
> > /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> > -- ----------> Adding thirdparty library avro. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
> > -- Added static library dependency avro:
> > /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> > -- Found PROTOBUF:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> > -- ----------> Adding thirdparty library protobuf. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protobuf:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> > -- ----------> Adding thirdparty library protoc. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/
> include
> > -- Added static library dependency protoc:
> > /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> > -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/
> libev.so
> > -- ----------> Adding thirdparty library libev. <----------
> > -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> > -- Added static library dependency libev:
> > /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> > -- Found CRCUTIL:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.so
> >
> > -- ----------> Adding thirdparty library crcutil. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/include
> > -- Added static library dependency crcutil:
> > /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c76
> 7f184e946e-p1/lib/libcrcutil.a
> > -- Found JNI:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/
> jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.
> 7.0_80/jre/lib/amd64/server/libjvm.so
> >
> > -- ----------> Adding thirdparty library java_jvm. <----------
> > -- Header files:
> > /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_
> 80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> > -- Added static library dependency java_jvm:
> > /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> > -- ----------> Adding thirdparty library breakpad. <----------
> > -- Header files:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> > -- Added static library dependency breakpad:
> > /home/bikram/dev/Impala/toolchain/breakpad-
> ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> > -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/
> librt.so
> > -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/
> libdl.so
> > Using Thrift compiler:
> > /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> > Found output dir: /home/bikram/dev/Impala/shell/
> > Using FlatBuffers compiler:
> > /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> > --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> > --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> > -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> > -- WARNING: Doxygen not found - Docs will not be created
> > -- Looking for sched_getcpu
> > -- Looking for sched_getcpu - found
> > -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
> > -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> > -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
> > /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
> > -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> > -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> > -D__STDC_LIMIT_MACROS
> > -- Common /home/bikram/dev/Impala/be/build/debug/
> > -- Configuring done
> > -- Generating done
> > -- Build files have been written to: /home/bikram/dev/Impala
> >
> >
> > On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com
> >> wrote:
> >
> >> Thanks, lemme try it real quick and I'll get back to you
> >>
> >> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org>
> wrote:
> >>
> >>> Can you try:
> >>>
> >>> cd $IMPALA_HOME
> >>> rm CMakeCache.txt
> >>> cmake .
> >>> <make impala, however you usually do it>
> >>>
> >>> If that doesn't work, can you send me the output of rm CMakeCache.txt
> &&
> >>> cmake . from IMPALA_HOME?
> >>>
> >>> Thanks,
> >>> Henry
> >>>
> >>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
> >>>
> >>> > Sorry, I read too quickly - you've done that already! Let me take a
> >>> look.
> >>> >
> >>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
> >>> >
> >>> >> Yep, you need to remove the downloaded version of gflags and
> replace it
> >>> >> with a recent toolchain version. See my mail from yesterday for
> >>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> >>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> >>> >> impala.apache.org%3E
> >>> >>
> >>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <
> bikramjeet.vig@cloudera.com>
> >>> >> wrote:
> >>> >>
> >>> >>> After fetching latest from asf-gerrit (that has the toolchain
> commit
> >>> >>> related to gflags) and doing a manual toolchain refresh, I am
> unable
> >>> to
> >>> >>> run
> >>> >>> impala when I build with "make_debug" or "buildall -so", both
> >>> statestore
> >>> >>> and catalogd show the following error:
> >>> >>>
> >>> >>> ERROR: something wrong with flag 'flagfile' in file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'.
> >>> >>> One possibility: file
> >>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> >>> gflags-2.2.0-p1/src/gflags.cc'
> >>> >>> is being linked both statically and dynamically into this
> executable.
> >>> >>>
> >>> >>> I am only able to make it work if I go with static linking by
> >>> building it
> >>> >>> with "buildall" without the "-so"
> >>> >>>
> >>> >>> Anyone facing the same issue?
> >>> >>>
> >>> >>
> >>> >>
> >>> >
> >>> >
> >>> > --
> >>> > Henry Robinson
> >>> > Software Engineer
> >>> > Cloudera
> >>> > 415-994-6679 <(415)%20994-6679>
> >>> >
> >>>
> >>
> >>
>



-- 
Vincent T. Tran
Customer Operations Engineer
Cloudera, Inc.

Re: Problem running Impala built with dynamic linking

Posted by Matthew Jacobs <mj...@cloudera.com>.

Did you ever come to a conclusion on this?

On Wed, Jul 19, 2017 at 5:14 PM, Bikramjeet Vig
<bi...@cloudera.com> wrote:
> Didn't work, heres the output of rm CMakeCache.txt && cmake .
>
>
> -- Setup toolchain link flags
> -Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
> -- Build type is DEBUG
> -- ENABLE_CODE_COVERAGE: false
> -- Boost version: 1.57.0
> -- Found the following Boost libraries:
> --   thread
> --   regex
> --   filesystem
> --   system
> --   date_time
> -- Boost include dir:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
> -- Boost libraries:
> /home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
> -- Found OpenSSL:
> /usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
> (found version "1.0.2g")
> -- ----------> Adding thirdparty library openssl_ssl. <----------
> -- Header files: /usr/include
> -- Added shared library dependency openssl_ssl:
> /usr/lib/x86_64-linux-gnu/libssl.so
> -- ----------> Adding thirdparty library openssl_crypto. <----------
> -- Added shared library dependency openssl_crypto:
> /usr/lib/x86_64-linux-gnu/libcrypto.so
> -- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- ----------> Adding thirdparty library bzip2. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
> -- Added static library dependency bzip2:
> /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
> -- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- ----------> Adding thirdparty library zlib. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
> -- Added static library dependency zlib:
> /home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
> -- ----------> Adding thirdparty library hdfs. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/include
> -- Added static library dependency hdfs:
> /home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/lib/native/libhdfs.a
> -- ----------> Adding thirdparty library glog. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
> -- Added static library dependency glog:
> /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
> -- ----------> Adding thirdparty library gflags. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
> -- Added static library dependency gflags:
> /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
> -- ----------> Adding thirdparty library pprof. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
> -- Added static library dependency pprof:
> /home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
> -- ----------> Adding thirdparty library gtest. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
> -- Added static library dependency gtest:
> /home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
> -- LLVM clang++ found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
> -- LLVM opt found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
> -- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
> -- LLVM llvm-config found at:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
> -- LLVM include dir:
> /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
> -- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/lib
> -- ----------> Adding thirdparty library cyrus_sasl. <----------
> -- Header files: /usr/include
> -- Added shared library dependency cyrus_sasl:
> /usr/lib/x86_64-linux-gnu/libsasl2.so
> -- ----------> Adding thirdparty library ldap. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
> -- Added static library dependency ldap:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
> -- ----------> Adding thirdparty library lber. <----------
> -- Added static library dependency lber:
> /home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
> -- ----------> Adding thirdparty library thrift. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
> -- Added static library dependency thrift:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
> -- Thrift version: Thrift version 0.9.0
> -- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
> -- Thrift compiler:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> -- Found FLATBUFFERS:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> -- ----------> Adding thirdparty library flatbuffers. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
> -- Added static library dependency flatbuffers:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
> -- FlatBuffers compiler:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> -- ----------> Adding thirdparty library snappy. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
> -- Added static library dependency snappy:
> /home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
> -- ----------> Adding thirdparty library lz4. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
> -- Added static library dependency lz4:
> /home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
> -- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> -- ----------> Adding thirdparty library re2. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
> -- Added static library dependency re2:
> /home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
> -- RapidJson include dir:
> /home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
> -- ----------> Adding thirdparty library avro. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
> -- Added static library dependency avro:
> /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
> -- Found PROTOBUF:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
> -- ----------> Adding thirdparty library protobuf. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
> -- Added static library dependency protobuf:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
> -- ----------> Adding thirdparty library protoc. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
> -- Added static library dependency protoc:
> /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
> -- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.so
> -- ----------> Adding thirdparty library libev. <----------
> -- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
> -- Added static library dependency libev:
> /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
> -- Found CRCUTIL:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.so
>
> -- ----------> Adding thirdparty library crcutil. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/include
> -- Added static library dependency crcutil:
> /home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.a
> -- Found JNI:
> /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
>
> -- ----------> Adding thirdparty library java_jvm. <----------
> -- Header files:
> /usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
> -- Added static library dependency java_jvm:
> /usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
> -- ----------> Adding thirdparty library breakpad. <----------
> -- Header files:
> /home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
> -- Added static library dependency breakpad:
> /home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
> -- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/librt.so
> -- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/libdl.so
> Using Thrift compiler:
> /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
> Found output dir: /home/bikram/dev/Impala/shell/
> Using FlatBuffers compiler:
> /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
> --java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
> --cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
> -- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
> -- WARNING: Doxygen not found - Docs will not be created
> -- Looking for sched_getcpu
> -- Looking for sched_getcpu - found
> -- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
> -fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
> -DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
> /home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
> -Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
> -D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
> -D__STDC_LIMIT_MACROS
> -- Common /home/bikram/dev/Impala/be/build/debug/
> -- Configuring done
> -- Generating done
> -- Build files have been written to: /home/bikram/dev/Impala
>
>
> On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <bikramjeet.vig@cloudera.com
>> wrote:
>
>> Thanks, lemme try it real quick and I'll get back to you
>>
>> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org> wrote:
>>
>>> Can you try:
>>>
>>> cd $IMPALA_HOME
>>> rm CMakeCache.txt
>>> cmake .
>>> <make impala, however you usually do it>
>>>
>>> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
>>> cmake . from IMPALA_HOME?
>>>
>>> Thanks,
>>> Henry
>>>
>>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
>>>
>>> > Sorry, I read too quickly - you've done that already! Let me take a
>>> look.
>>> >
>>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
>>> >
>>> >> Yep, you need to remove the downloaded version of gflags and replace it
>>> >> with a recent toolchain version. See my mail from yesterday for
>>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
>>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>>> >> impala.apache.org%3E
>>> >>
>>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
>>> >> wrote:
>>> >>
>>> >>> After fetching latest from asf-gerrit (that has the toolchain commit
>>> >>> related to gflags) and doing a manual toolchain refresh, I am unable
>>> to
>>> >>> run
>>> >>> impala when I build with "make_debug" or "buildall -so", both
>>> statestore
>>> >>> and catalogd show the following error:
>>> >>>
>>> >>> ERROR: something wrong with flag 'flagfile' in file
>>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> >>> gflags-2.2.0-p1/src/gflags.cc'.
>>> >>> One possibility: file
>>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> >>> gflags-2.2.0-p1/src/gflags.cc'
>>> >>> is being linked both statically and dynamically into this executable.
>>> >>>
>>> >>> I am only able to make it work if I go with static linking by
>>> building it
>>> >>> with "buildall" without the "-so"
>>> >>>
>>> >>> Anyone facing the same issue?
>>> >>>
>>> >>
>>> >>
>>> >
>>> >
>>> > --
>>> > Henry Robinson
>>> > Software Engineer
>>> > Cloudera
>>> > 415-994-6679 <(415)%20994-6679>
>>> >
>>>
>>
>>

Re: Problem running Impala built with dynamic linking

Posted by Bikramjeet Vig <bi...@cloudera.com>.

Didn't work, heres the output of rm CMakeCache.txt && cmake .


-- Setup toolchain link flags
-Wl,-rpath,/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-L/home/bikram/dev/Impala/toolchain/gcc-4.9.2/lib64
-- Build type is DEBUG
-- ENABLE_CODE_COVERAGE: false
-- Boost version: 1.57.0
-- Found the following Boost libraries:
--   thread
--   regex
--   filesystem
--   system
--   date_time
-- Boost include dir:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/include
-- Boost libraries:
/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_thread.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_regex.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_filesystem.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_system.a/home/bikram/dev/Impala/toolchain/boost-1.57.0-p3/lib/libboost_date_time.a
-- Found OpenSSL:
/usr/lib/x86_64-linux-gnu/libssl.so;/usr/lib/x86_64-linux-gnu/libcrypto.so
(found version "1.0.2g")
-- ----------> Adding thirdparty library openssl_ssl. <----------
-- Header files: /usr/include
-- Added shared library dependency openssl_ssl:
/usr/lib/x86_64-linux-gnu/libssl.so
-- ----------> Adding thirdparty library openssl_crypto. <----------
-- Added shared library dependency openssl_crypto:
/usr/lib/x86_64-linux-gnu/libcrypto.so
-- Bzip2: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- ----------> Adding thirdparty library bzip2. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/include
-- Added static library dependency bzip2:
/home/bikram/dev/Impala/toolchain/bzip2-1.0.6-p2/lib/libbz2.a
-- Zlib: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- ----------> Adding thirdparty library zlib. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/zlib-1.2.8/include
-- Added static library dependency zlib:
/home/bikram/dev/Impala/toolchain/zlib-1.2.8/lib/libz.a
-- ----------> Adding thirdparty library hdfs. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/include
-- Added static library dependency hdfs:
/home/bikram/dev/Impala/toolchain/cdh_components/hadoop-2.6.0-cdh5.13.0-SNAPSHOT/lib/native/libhdfs.a
-- ----------> Adding thirdparty library glog. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/include
-- Added static library dependency glog:
/home/bikram/dev/Impala/toolchain/glog-0.3.4-p2/lib/libglog.a
-- ----------> Adding thirdparty library gflags. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/include
-- Added static library dependency gflags:
/home/bikram/dev/Impala/toolchain/gflags-2.2.0-p1/lib/libgflags.a
-- ----------> Adding thirdparty library pprof. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gperftools-2.5/include
-- Added static library dependency pprof:
/home/bikram/dev/Impala/toolchain/gperftools-2.5/lib/libprofiler.a
-- ----------> Adding thirdparty library gtest. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/gtest-1.6.0/include
-- Added static library dependency gtest:
/home/bikram/dev/Impala/toolchain/gtest-1.6.0/lib/libgtest.a
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/llvm-config
-- LLVM clang++ found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/clang++
-- LLVM opt found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-p1/bin/opt
-- LLVM_ROOT: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1
-- LLVM llvm-config found at:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/bin/llvm-config
-- LLVM include dir:
/home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/include
-- LLVM lib dir: /home/bikram/dev/Impala/toolchain/llvm-3.8.0-asserts-p1/lib
-- ----------> Adding thirdparty library cyrus_sasl. <----------
-- Header files: /usr/include
-- Added shared library dependency cyrus_sasl:
/usr/lib/x86_64-linux-gnu/libsasl2.so
-- ----------> Adding thirdparty library ldap. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/openldap-2.4.25/include
-- Added static library dependency ldap:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/libldap.a
-- ----------> Adding thirdparty library lber. <----------
-- Added static library dependency lber:
/home/bikram/dev/Impala/toolchain/openldap-2.4.25/lib/liblber.a
-- ----------> Adding thirdparty library thrift. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/include
-- Added static library dependency thrift:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/lib/libthrift.a
-- Thrift version: Thrift version 0.9.0
-- Thrift contrib dir: /home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9
-- Thrift compiler:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
-- Found FLATBUFFERS:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
-- ----------> Adding thirdparty library flatbuffers. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/include
-- Added static library dependency flatbuffers:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/lib/libflatbuffers.a
-- FlatBuffers compiler:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
-- ----------> Adding thirdparty library snappy. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/snappy-1.1.4/include
-- Added static library dependency snappy:
/home/bikram/dev/Impala/toolchain/snappy-1.1.4/lib/libsnappy.a
-- ----------> Adding thirdparty library lz4. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/lz4-1.7.5/include
-- Added static library dependency lz4:
/home/bikram/dev/Impala/toolchain/lz4-1.7.5/lib/liblz4.a
-- /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
-- ----------> Adding thirdparty library re2. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/re2-20130115-p1/include
-- Added static library dependency re2:
/home/bikram/dev/Impala/toolchain/re2-20130115-p1/lib/libre2.a
-- RapidJson include dir:
/home/bikram/dev/Impala/toolchain/rapidjson-0.11/include
-- ----------> Adding thirdparty library avro. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/include
-- Added static library dependency avro:
/home/bikram/dev/Impala/toolchain/avro-1.7.4-p4/lib/libavro.a
-- Found PROTOBUF:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.so
-- ----------> Adding thirdparty library protobuf. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
-- Added static library dependency protobuf:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotobuf.a
-- ----------> Adding thirdparty library protoc. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/protobuf-2.6.1/include
-- Added static library dependency protoc:
/home/bikram/dev/Impala/toolchain/protobuf-2.6.1/lib/libprotoc.a
-- Found LIBEV: /home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.so
-- ----------> Adding thirdparty library libev. <----------
-- Header files: /home/bikram/dev/Impala/toolchain/libev-4.20/include
-- Added static library dependency libev:
/home/bikram/dev/Impala/toolchain/libev-4.20/lib/libev.a
-- Found CRCUTIL:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.so

-- ----------> Adding thirdparty library crcutil. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/include
-- Added static library dependency crcutil:
/home/bikram/dev/Impala/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1/lib/libcrcutil.a
-- Found JNI:
/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjawt.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/libjsig.so;/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so

-- ----------> Adding thirdparty library java_jvm. <----------
-- Header files:
/usr/lib/jvm/jdk1.7.0_80/include;/usr/lib/jvm/jdk1.7.0_80/include/linux;/usr/lib/jvm/jdk1.7.0_80/include
-- Added static library dependency java_jvm:
/usr/lib/jvm/jdk1.7.0_80/jre/lib/amd64/server/libjvm.so
-- ----------> Adding thirdparty library breakpad. <----------
-- Header files:
/home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/include/breakpad
-- Added static library dependency breakpad:
/home/bikram/dev/Impala/toolchain/breakpad-ffe3e478657dc7126fca6329dfcedc49f4c726d9-p2/lib/libbreakpad_client.a
-- Added shared library dependency rt: /usr/lib/x86_64-linux-gnu/librt.so
-- Added shared library dependency dl: /usr/lib/x86_64-linux-gnu/libdl.so
Using Thrift compiler:
/home/bikram/dev/Impala/toolchain/thrift-0.9.0-p9/bin/thrift
Found output dir: /home/bikram/dev/Impala/shell/
Using FlatBuffers compiler:
/home/bikram/dev/Impala/toolchain/flatbuffers-1.6.0/bin/flatc
--java-o/home/bikram/dev/Impala/fe/generated-sources/gen-java-b
--cpp-o/home/bikram/dev/Impala/be/generated-sources/gen-cpp-b
-- Could NOT find Doxygen (missing:  DOXYGEN_EXECUTABLE)
-- WARNING: Doxygen not found - Docs will not be created
-- Looking for sched_getcpu
-- Looking for sched_getcpu - found
-- Compiler Flags:  -Wall -Wno-sign-compare -Wno-unknown-pragmas -pthread
-fno-strict-aliasing -std=c++14 -Wno-deprecated -Wno-vla
-DBOOST_DATE_TIME_POSIX_TIME_STD_CONFIG -DBOOST_SYSTEM_NO_DEPRECATED -B
/home/bikram/dev/Impala/toolchain/binutils-2.26.1/bin/ -fuse-ld=gold -g
-Wno-unused-local-typedefs -ggdb -gdwarf-2 -Werror -fverbose-asm
-D_GNU_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS
-D__STDC_LIMIT_MACROS
-- Common /home/bikram/dev/Impala/be/build/debug/
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bikram/dev/Impala


On Wed, Jul 19, 2017 at 5:09 PM, Bikramjeet Vig <bikramjeet.vig@cloudera.com
> wrote:

> Thanks, lemme try it real quick and I'll get back to you
>
> On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org> wrote:
>
>> Can you try:
>>
>> cd $IMPALA_HOME
>> rm CMakeCache.txt
>> cmake .
>> <make impala, however you usually do it>
>>
>> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
>> cmake . from IMPALA_HOME?
>>
>> Thanks,
>> Henry
>>
>> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
>>
>> > Sorry, I read too quickly - you've done that already! Let me take a
>> look.
>> >
>> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
>> >
>> >> Yep, you need to remove the downloaded version of gflags and replace it
>> >> with a recent toolchain version. See my mail from yesterday for
>> >> instructions: https://lists.apache.org/api/source.lua/a154f4
>> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>> >> impala.apache.org%3E
>> >>
>> >> On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
>> >> wrote:
>> >>
>> >>> After fetching latest from asf-gerrit (that has the toolchain commit
>> >>> related to gflags) and doing a manual toolchain refresh, I am unable
>> to
>> >>> run
>> >>> impala when I build with "make_debug" or "buildall -so", both
>> statestore
>> >>> and catalogd show the following error:
>> >>>
>> >>> ERROR: something wrong with flag 'flagfile' in file
>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>> >>> gflags-2.2.0-p1/src/gflags.cc'.
>> >>> One possibility: file
>> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>> >>> gflags-2.2.0-p1/src/gflags.cc'
>> >>> is being linked both statically and dynamically into this executable.
>> >>>
>> >>> I am only able to make it work if I go with static linking by
>> building it
>> >>> with "buildall" without the "-so"
>> >>>
>> >>> Anyone facing the same issue?
>> >>>
>> >>
>> >>
>> >
>> >
>> > --
>> > Henry Robinson
>> > Software Engineer
>> > Cloudera
>> > 415-994-6679 <(415)%20994-6679>
>> >
>>
>
>

Re: Problem running Impala built with dynamic linking

Posted by Bikramjeet Vig <bi...@cloudera.com>.

Thanks, lemme try it real quick and I'll get back to you

On Wed, Jul 19, 2017 at 5:04 PM, Henry Robinson <he...@apache.org> wrote:

> Can you try:
>
> cd $IMPALA_HOME
> rm CMakeCache.txt
> cmake .
> <make impala, however you usually do it>
>
> If that doesn't work, can you send me the output of rm CMakeCache.txt &&
> cmake . from IMPALA_HOME?
>
> Thanks,
> Henry
>
> On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:
>
> > Sorry, I read too quickly - you've done that already! Let me take a look.
> >
> > On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
> >
> >> Yep, you need to remove the downloaded version of gflags and replace it
> >> with a recent toolchain version. See my mail from yesterday for
> >> instructions: https://lists.apache.org/api/source.lua/a154f4
> >> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
> >> impala.apache.org%3E
> >>
> >> On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
> >> wrote:
> >>
> >>> After fetching latest from asf-gerrit (that has the toolchain commit
> >>> related to gflags) and doing a manual toolchain refresh, I am unable to
> >>> run
> >>> impala when I build with "make_debug" or "buildall -so", both
> statestore
> >>> and catalogd show the following error:
> >>>
> >>> ERROR: something wrong with flag 'flagfile' in file
> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> gflags-2.2.0-p1/src/gflags.cc'.
> >>> One possibility: file
> >>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
> >>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
> >>> gflags-2.2.0-p1/src/gflags.cc'
> >>> is being linked both statically and dynamically into this executable.
> >>>
> >>> I am only able to make it work if I go with static linking by building
> it
> >>> with "buildall" without the "-so"
> >>>
> >>> Anyone facing the same issue?
> >>>
> >>
> >>
> >
> >
> > --
> > Henry Robinson
> > Software Engineer
> > Cloudera
> > 415-994-6679 <(415)%20994-6679>
> >
>

Re: Problem running Impala built with dynamic linking

Posted by Henry Robinson <he...@apache.org>.

Can you try:

cd $IMPALA_HOME
rm CMakeCache.txt
cmake .
<make impala, however you usually do it>

If that doesn't work, can you send me the output of rm CMakeCache.txt &&
cmake . from IMPALA_HOME?

Thanks,
Henry

On 19 July 2017 at 17:03, Henry Robinson <he...@cloudera.com> wrote:

> Sorry, I read too quickly - you've done that already! Let me take a look.
>
> On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:
>
>> Yep, you need to remove the downloaded version of gflags and replace it
>> with a recent toolchain version. See my mail from yesterday for
>> instructions: https://lists.apache.org/api/source.lua/a154f4
>> 3ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.
>> impala.apache.org%3E
>>
>> On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
>> wrote:
>>
>>> After fetching latest from asf-gerrit (that has the toolchain commit
>>> related to gflags) and doing a manual toolchain refresh, I am unable to
>>> run
>>> impala when I build with "make_debug" or "buildall -so", both statestore
>>> and catalogd show the following error:
>>>
>>> ERROR: something wrong with flag 'flagfile' in file
>>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> gflags-2.2.0-p1/src/gflags.cc'.
>>> One possibility: file
>>> '/data/jenkins/workspace/verify-impala-toolchain-package-bui
>>> ld/label/ec2-package-ubuntu-16-04/toolchain/source/gflags/
>>> gflags-2.2.0-p1/src/gflags.cc'
>>> is being linked both statically and dynamically into this executable.
>>>
>>> I am only able to make it work if I go with static linking by building it
>>> with "buildall" without the "-so"
>>>
>>> Anyone facing the same issue?
>>>
>>
>>
>
>
> --
> Henry Robinson
> Software Engineer
> Cloudera
> 415-994-6679 <(415)%20994-6679>
>

Re: Problem running Impala built with dynamic linking

Posted by Henry Robinson <he...@cloudera.com>.

Sorry, I read too quickly - you've done that already! Let me take a look.

On 19 July 2017 at 17:01, Henry Robinson <he...@apache.org> wrote:

> Yep, you need to remove the downloaded version of gflags and replace it
> with a recent toolchain version. See my mail from yesterday for
> instructions: https://lists.apache.org/api/source.lua/
> a154f43ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%
> 3Cdev.impala.apache.org%3E
>
> On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
> wrote:
>
>> After fetching latest from asf-gerrit (that has the toolchain commit
>> related to gflags) and doing a manual toolchain refresh, I am unable to
>> run
>> impala when I build with "make_debug" or "buildall -so", both statestore
>> and catalogd show the following error:
>>
>> ERROR: something wrong with flag 'flagfile' in file
>> '/data/jenkins/workspace/verify-impala-toolchain-package-
>> build/label/ec2-package-ubuntu-16-04/toolchain/source/
>> gflags/gflags-2.2.0-p1/src/gflags.cc'.
>> One possibility: file
>> '/data/jenkins/workspace/verify-impala-toolchain-package-
>> build/label/ec2-package-ubuntu-16-04/toolchain/source/
>> gflags/gflags-2.2.0-p1/src/gflags.cc'
>> is being linked both statically and dynamically into this executable.
>>
>> I am only able to make it work if I go with static linking by building it
>> with "buildall" without the "-so"
>>
>> Anyone facing the same issue?
>>
>
>


-- 
Henry Robinson
Software Engineer
Cloudera
415-994-6679

Re: Problem running Impala built with dynamic linking

Posted by Henry Robinson <he...@apache.org>.

Yep, you need to remove the downloaded version of gflags and replace it
with a recent toolchain version. See my mail from yesterday for
instructions:
https://lists.apache.org/api/source.lua/a154f43ef76e3da1271efed2740d447bbaeca09509156c7b728f2dd0@%3Cdev.impala.apache.org%3E

On 19 July 2017 at 16:56, Bikramjeet Vig <bi...@cloudera.com>
wrote:

> After fetching latest from asf-gerrit (that has the toolchain commit
> related to gflags) and doing a manual toolchain refresh, I am unable to run
> impala when I build with "make_debug" or "buildall -so", both statestore
> and catalogd show the following error:
>
> ERROR: something wrong with flag 'flagfile' in file
> '/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-
> package-ubuntu-16-04/toolchain/source/gflags/
> gflags-2.2.0-p1/src/gflags.cc'.
> One possibility: file
> '/data/jenkins/workspace/verify-impala-toolchain-package-build/label/ec2-
> package-ubuntu-16-04/toolchain/source/gflags/
> gflags-2.2.0-p1/src/gflags.cc'
> is being linked both statically and dynamically into this executable.
>
> I am only able to make it work if I go with static linking by building it
> with "buildall" without the "-so"
>
> Anyone facing the same issue?
>