You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@trafodion.apache.org by Nitin Lamba <ni...@ampool.io> on 2016/03/03 20:02:35 UTC
Re: Error building Trafodion
Thanks Steve,
Update #5: Still no luck.
Tried to do a clean setup and build but g++ failed at a different step now:
-----------------------------------------------------------------
/usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2 -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0 -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include -I/usr/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
Please submit a full bug report. ##(SQL)
See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1 ##(SQL)
make[4]: *** Waiting for unfinished jobs.... ##(SQL)
-----------------------------------------------------------------
The process hung for me. A quick web search on 'g++ segmentation fault' [1] suggests that maybe the stack size is limited. So I increased the limit 'ulimit -s 65532' with the same result. I then removed the limit completely 'ulimit -s unlimited' without any change in outcome. It seems I'm running into hardware or environment limitations. Does anyone know the minimum spec for the dev machine? I have an 8 GB VM that I'm running this on.
Not sure what else I can do at this point - running out of ideas and patience. Will keep trying to build trafodion in my free time...
Nitin
[1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
________________________________________
From: Steve Varnau <st...@esgyn.com>
Sent: Sunday, February 28, 2016 8:54 AM
To: Nitin Lamba; dev@trafodion.incubator.apache.org
Subject: RE: Error building Trafodion
I have seen this gcc internal error message before. It ended up to be
nothing in the code, but rather the OS decided the process was taking too
much memory and killed it. In my case, cgroups was misconfigured to limit
the user to 10% of memory. The dmesg command or /var/log messages showed
that the OS was doing it.
--Steve
> -----Original Message-----
> From: Nitin Lamba [mailto:nitin@ampool.io]
> Sent: Sunday, February 28, 2016 8:06 AM
> To: Steve Varnau <st...@esgyn.com>;
> dev@trafodion.incubator.apache.org
> Subject: Re: Error building Trafodion
>
> Thanks Steve. Glad that my buggy build journey is helping uncover new
issues.
>
> Update #4: Build is blocked for me - details below:
>
> Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
setup
> (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
the script
> uses '-without-qt' option anyway.
>
> So I installed qt-devel package AFTER the tools setup and re-ran 'make
all'.
> Now, the build fails on a different step - log excerpt below:
>
> -----------------------------------------------------------
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
> fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
-Wno-
> unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> -I../bin -I../executor -I../runtimestats -I../porting_layer
-I../qmscommon -
> I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
-I/usr/include -
> I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
> I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
> openjdk.x86_64/include
-I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
-I../sqlmsg -
> I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
-I../exp -
> I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
-I../arkfsindp2
> -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
-I../sqlshare -
> I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
-I../security -
> I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
-
> I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
> I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> MT,executor/linux/64bit/debug/stubs2.o -c -o
> executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> g++: Internal error: Killed (program cc1plus) ##(SQL)
> Please submit a full bug report. ##(SQL)
> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> make[4]: Leaving directory `/home/nitinlamba/incubator-
> trafodion/core/sql/nskgmake' ##(SQL)
> make[3]: *** [all] Error 2 ##(SQL)
> make[3]: Leaving directory `/home/nitinlamba/incubator-
> trafodion/core/sqf/sql' ##(SQL)
> make[2]: *** [make_sql] Error 2
> make[2]: Leaving directory
`/home/nitinlamba/incubator-trafodion/core/sqf'
> make[1]: *** [foundation] Error 2
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [all] Error 2
> -----------------------------------------------------------
>
> No idea why g++ doesn't like this. Any ideas?
>
> Nitin
> [1]
http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> 0-on-centos6-4
>
> ________________________________________
> From: Steve Varnau <st...@esgyn.com>
> Sent: Saturday, February 27, 2016 12:08 PM
> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> Subject: RE: Error building Trafodion
>
> The qt-devel package should be optional, just as the QT_TOOLKIT variable
> need not be pointing to anything. It is for a an optional query-debugger
> tool. I'd say that is a makefile bug that tries to call qmake
> unconditionally.
>
> Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> 4.8). That seems like a bug as well.
>
> --Steve
>
>
> > -----Original Message-----
> > From: Nitin Lamba [mailto:nitin@ampool.io]
> > Sent: Saturday, February 27, 2016 8:37 AM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau <st...@esgyn.com>
> > Subject: Re: Error building Trafodion
> >
> > Update #3:
> >
> > Tried with CentOS 6.6; gcc seems to be the correct version:
> > $ gcc --version
> > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> >
> > 'make all' moved further but failed due to 'qmake' not available - log
> excerpt
> > below:
> >
> > -----------------------------------------------------------------
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
-
> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-
> > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> > clitest/linux/64bit/debug/blobtest.o
> clitest/linux/64bit/debug/vers_libclitest.o
> > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> -llog4cxx
> > ##(SQL)
> > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> > cp -f $PWD/libSqlCompilerDebugger.so
> > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> > ./mk.sh: line 28: qmake: command not found ##(SQL)
> > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
> make
> > rule. ##(SQL)
> > make[5]: *** No targets specified and no makefile found.
> Stop. ##(SQL)
> > cp: cannot stat `/home/nitinlamba/incubator-
> > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
> such
> > file or directory ##(SQL)
> > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> >
> > -----------------------------------------------------------------
> > A quick check on the web suggests that package 'qt-devel' should be
> installed -
> > this is missing from the wiki page as a dependency [1].
> >
> > Frankly, this is too much of a trial and error for a new developer to
> get started.
> > The instructions should be updated for all of these gotchas (CentOS 6.
X,
> gcc,
> > qmake, ...).
> >
> > I'll keep digging...
> > Nitin
> > [1]
> >
>
https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > ment
> >
> > ________________________________________
> > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > Sent: Friday, February 26, 2016 9:27 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: Re: Error building Trafodion
> >
> > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> > So sorry for not clear before, you need CentOS 6.6 or older version.
The
> > problem is the GCC version. In the error message below, it seems the
GCC
> you
> > are using is 4.8.2, some Trafodion modules not compatible with GCC
4.8.
> You
> > have to use a lower version. GCC 4.4.7 is what I am using without
issue,
> and my
> > workstation is CentOS 6.6.
> >
> > It should be possible to install GCC 4.4 on newer CentOS versions, but
> maybe
> > need to change some C/C++ rumtime lib as well. You may need to build
the
> > toolchain from gcc source code in order to get a complete gcc 4.4. I
> will try it
> > asap.
> >
> > Thanks,
> > Ming
> >
> > -----邮件原件-----
> > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > 发送时间: 2016年2月27日 13:14
> > 收件人: dev@trafodion.incubator.apache.org
> > 抄送: Steve Varnau <st...@esgyn.com>
> > 主题: Re: Error building Trafodion
> >
> > Update:
> >
> > Started with CentOS 6.7 (Final) but ran into a different issue in the
> same
> > module (undefined reference to certain functions) - log excerpt below:
> >
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> `std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
> false,
> > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char>
>*>(std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::operator=(std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> > >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> > ##(Security)
> > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapcheck.o: In function
> > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> > /home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
reference
> to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > /home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
reference
> to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > collect2: ld returned 1 exit status ##(Security)
> >
> > Any ideas?
> >
> > Nitin
> >
> > ________________________________________
> > From: Nitin Lamba <ni...@ampool.io>
> > Sent: Friday, February 26, 2016 7:37 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: Re: Error building Trafodion
> >
> > Thanks Ming! Will try with CentOS 6.
> >
> > Nitin
> >
> > ________________________________________
> > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > Sent: Friday, February 26, 2016 7:32 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: 答复: Error building Trafodion
> >
> > Hi, Nitin,
> >
> > I run into same error last week when I tried to use CentOS 7 as my
> > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> > incompatible.
> > For this particular issue, I modified the Makefile under
> > incubator-trafodion/core/dbsecurity/auth/Makefile
> > to add '-llber' into LINK_OPTIONS
> > And pass this error.
> > I have no idea why current building workstation not meet this link
> error, I have
> > no theory here :-) I have another CentOS 6.5 workstation, same
codebase,
> but
> > not meet this build error. It is still a mystery for me. Need time to
> investigate
> > more.
> >
> > But if I you are using GCC 4.8, the building will meet few more errors
> after
> > solving this issue. I fixed a few, but still some more are there, and
> not able to
> > proceed too much up to now. So I think if you are using gcc 4.8,
please
> consider
> > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
> >
> > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> development
> > workstation will save you a lot of time, it is well tested.
> >
> > Thanks,
> > Ming
> >
> > -----邮件原件-----
> > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > 发送时间: 2016年2月27日 11:00
> > 收件人: dev@trafodion.incubator.apache.org
> > 抄送: Steve Varnau <st...@esgyn.com>
> > 主题: Error building Trafodion
> >
> > Hi,
> >
> >
> > I tried to build Trafodion by following the instructions on the wiki
> [1], [2] using
> > 'make all'. However, I ran into an error compiling 'auth' within
> dbsecurity - log
> > excerpt below:
> >
> >
> > [... SNIPPET ...]
> >
> > cd auth; make ##(Security)
> >
> > make[3]: Entering directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth' ##(Security)
> >
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> > DNA_64BIT -o /home/nitinlamba/incubator-
> > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
> -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> > ../../sql/common -L/home/nitinlamba/incubator-
> > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> Linux-
> > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> ##(Security)
> >
> > /usr/bin/ld:
> /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> > undefined reference to symbol 'ber_set_option' ##(Security)
> >
> > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> /lib64/liblber-2.4.so.2 so
> > try adding it to the linker command line ##(Security)
> >
> > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> ##(Security)
> >
> > collect2: error: ld returned 1 exit status ##(Security)
> >
> > make[3]: *** [/home/nitinlamba/incubator-
> > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> >
> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth' ##(Security)
> >
> > make[2]: *** [auth] Error 2 ##(Security)
> >
> > make[2]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity' ##(Security)
> >
> > make[1]: *** [dbsecurity] Error 2
> >
> >
> > Any ideas what I could be doing wrong?
> >
> >
> > Thanks,
> >
> > Nitin
> >
> >
> > [1]
> >
>
https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > ment
> >
> > [2] https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
Re: Error building Trafodion
Posted by Suresh Subbiah <su...@gmail.com>.
Hi Nitin,
Thank you.
I have added your confluence id nlamba to the list of users with write
access to our confluence wiki. If you are not able to edit please let me
know.
https://cwiki.apache.org/confluence/display/TRAFODION/Apache+Trafodion+Home
Thanks
Suresh
On Sat, Mar 5, 2016 at 2:24 PM, Nitin Lamba <ni...@ampool.io> wrote:
> Update #6: Build successful!! This is a long e-mail...
>
> Should have mentioned earlier that I've been trying to build a portable
> dev environment using docker using an 8 GB RAM, 2 CPU linux VM (boot2docker
> on my Mac OSX 10.11.3). Docker image is the official centos/centos6.6
>
> $ docker pull centos:centos6.6
>
> https://hub.docker.com/_/centos/
>
> @Gunnar
> Thanks for walking through the build process. Serializing make using '-j
> 1' did the trick! Not sure how much 'make concurrency' I'm sacrificing with
> this option. Following were the times recorded to do 'make package-all -j
> 1' after 'make cleanall' on my 8GB VM (this is without building Hadoop
> project from source):
>
> >------------------------------------------
> real 41m32.886s
> user 26m28.360s
> sys 7m34.200s
> ------------------------------------------<
>
> I also noticed the qt-devel and qt-config package changes on the wiki but
> by installing in that sequence, 'make all' fails to get thrift installed
> correctly. I found that last time I tried to fix qmake error. Did you get
> the same error/dependency?
> >------------------------------------------
> *** Error: THRIFT_LIB_DIR directory not found:
> /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/lib
> *** Error: THRIFT_INC_DIR directory not found:
> /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> make[1]: *** [sqroot] Error 1
> make[1]: *** Waiting for unfinished jobs....
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [cleanall] Error 2
>
> ------------------------------------------<
> The workaround is to install qt packages AFTER installing all the build
> tools, especially thrift.
>
> @Steve
>
> Checked dmesg but no unexpected error messages. Without make
> serialization, and increasing ulimit stack size to 10240, I'm not able to
> get the build working. What's puzzling is that my error messages are always
> different. Here's the third one I got last night (invalid argument):
>
> >------------------------------------------
>
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -D_DP2NT_
> -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT
> -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_
> -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_
> -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF
> -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> -I../bin -I../executor -I../runtimestats -I../porting_layer
> -I../qmscommon -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> -Wp,-MD,executor/linux/64bit/debug/depend/d_ExHbaseDDL.dep
> -Wp,-MT,executor/linux/64bit/debug/ExHbaseDDL.o -c -o
> executor/linux/64bit/debug/ExHbaseDDL.o ../executor/ExHbaseDDL.cpp ##(SQL)
> In file included from ../common/NAMemory.h:64, ##(SQL)
> from ../common/CollHeap.h:36, ##(SQL)
> from ../common/ComSpace.h:44, ##(SQL)
> from ../common/NAHeap.h:39, ##(SQL)
> from ../executor/ex_god.h:45, ##(SQL)
> from ../cli/cli_stdh.h:23, ##(SQL)
> from ../executor/ExHbaseDDL.cpp:26: ##(SQL)
> ../common/NAStringDefGlobals.h:54:33: error:
> ../common/SqlExportDllDefines.h: Invalid argument ##(SQL)
> make[4]: *** [executor/linux/64bit/debug/ExHbaseDDL.o] Error 1 ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> make[4]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sql/nskgmake' ##(SQL)
> make[3]: *** [all] Error 2 ##(SQL)
> make[3]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sqf/sql' ##(SQL)
> make[2]: *** [make_sql] Error 2
> make[2]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sqf'
> make[1]: *** [foundation] Error 2
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [all] Error 2
>
> ------------------------------------------<
>
> It appears that the concurrency in the make process isn't reliable; not
> sure if it is running into inter-job race conditions - one make job is
> expecting libs/ artifacts to be available or another job to be complete.
> I'm no expert but just a hunch...
>
> Anyway, I plan to contribute the docker scripts so will create a pull
> request soon.
> If someone gives me access to the project wiki, I could even create a page
> to explain the setup and capture detailed instructions.
>
> Thanks,
> Nitin
> ________________________________________
> From: Gunnar Tapper <ta...@gmail.com>
> Sent: Thursday, March 3, 2016 6:35 PM
> To: dev@trafodion.incubator.apache.org
> Cc: Hans Zeller
> Subject: Re: Error building Trafodion
>
> Hi Nitin:
>
> I followed the instructions in the Contributor Guide to the letter and ran
> into a bunch of problems. I've fixed up the documentation accordingly
> including installing qmake (temporary fix).
>
> It would help tremendously if I could use the same OS image as you're using
> to ensure that there are no more gotchas. For example, I ran make all -j 1
> to serialize my make and that worked fine but I'm not sure that such an
> approach would make any difference in your case.
>
> Thanks,
>
> Gunnar
>
> On Thu, Mar 3, 2016 at 3:54 PM, Gunnar Tapper <ta...@gmail.com>
> wrote:
>
> > Hi Nitin,
> >
> > I'm going through the instructions from scratch to see if I can recreate
> > what you're seeing.I'm using an OpenStack VM with 8 GB of memory. Ulimit
> -s
> > = 10240.
> >
> > Thanks,
> >
> > Gunnar
> >
> > On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com>
> > wrote:
> >
> >> Hi Nitin,
> >>
> >>
> >>
> >> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
> >> 2cpu, no swap space.
> >>
> >>
> >>
> >> $ ulimit -s
> >>
> >> 10240
> >>
> >>
> >>
> >> Trafodion built fine for me, no problems. Did you check dmesg to see if
> >> there were any kernel messages?
> >>
> >>
> >>
> >> --Steve
> >>
> >>
> >>
> >> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
> >> *Sent:* Thursday, March 3, 2016 11:21 AM
> >> *To:* dev <de...@trafodion.incubator.apache.org>
> >> *Cc:* Steve Varnau <st...@esgyn.com>
> >> *Subject:* Re: Error building Trafodion
> >>
> >>
> >>
> >> Hi Nitin, if you want to have an environment where the build is likely
> to
> >> succeed, you can try this Amazon AMI:
> >>
> >>
> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
> >>
> >>
> >>
> >> This has a full Trafodion source tree installed, you can make code
> >> changes,
> >> build and debug.
> >>
> >>
> >> Hans
> >>
> >>
> >>
> >> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
> >>
> >> Thanks Steve,
> >>
> >> Update #5: Still no luck.
> >>
> >> Tried to do a clean setup and build but g++ failed at a different step
> >> now:
> >>
> >> -----------------------------------------------------------------
> >>
> >> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> >> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> >> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat
> -Werror
> >> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
> >> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
> >> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED
> -D_TNS_R_TARGET
> >> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
> >> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
> >> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
> >> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
> >> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> >> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> >> -I/usr/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> >> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> >>
> >>
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> >> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> >> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> >> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> -I../exp
> >> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> >> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman
> -I../smdio
> >> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman
> >> -I../sqludr
> >> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> >> -I../porting_layer -include
> >> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> >> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> >>
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> >> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> >> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
> >> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
> >> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
> >> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
> >> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
> >> Please submit a full bug report. ##(SQL)
> >> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> >> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
> >> ##(SQL)
> >> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> >>
> >> -----------------------------------------------------------------
> >>
> >> The process hung for me. A quick web search on 'g++ segmentation fault'
> >> [1]
> >> suggests that maybe the stack size is limited. So I increased the limit
> >> 'ulimit -s 65532' with the same result. I then removed the limit
> >> completely
> >> 'ulimit -s unlimited' without any change in outcome. It seems I'm
> running
> >> into hardware or environment limitations. Does anyone know the minimum
> >> spec
> >> for the dev machine? I have an 8 GB VM that I'm running this on.
> >>
> >> Not sure what else I can do at this point - running out of ideas and
> >> patience. Will keep trying to build trafodion in my free time...
> >>
> >> Nitin
> >> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
> >>
> >> ________________________________________
> >> From: Steve Varnau <st...@esgyn.com>
> >> Sent: Sunday, February 28, 2016 8:54 AM
> >>
> >> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> >> Subject: RE: Error building Trafodion
> >>
> >> I have seen this gcc internal error message before. It ended up to be
> >> nothing in the code, but rather the OS decided the process was taking
> too
> >> much memory and killed it. In my case, cgroups was misconfigured to
> limit
> >> the user to 10% of memory. The dmesg command or /var/log messages showed
> >> that the OS was doing it.
> >>
> >> --Steve
> >>
> >>
> >> > -----Original Message-----
> >> > From: Nitin Lamba [mailto:nitin@ampool.io]
> >> > Sent: Sunday, February 28, 2016 8:06 AM
> >> > To: Steve Varnau <st...@esgyn.com>;
> >> > dev@trafodion.incubator.apache.org
> >> > Subject: Re: Error building Trafodion
> >> >
> >> > Thanks Steve. Glad that my buggy build journey is helping uncover new
> >> issues.
> >> >
> >> > Update #4: Build is blocked for me - details below:
> >> >
> >> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
> >> setup
> >> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
> >> the script
> >> > uses '-without-qt' option anyway.
> >> >
> >> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
> >> all'.
> >> > Now, the build fails on a different step - log excerpt below:
> >> >
> >> > -----------------------------------------------------------
> >> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -
> >> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> >> -Wno-
> >> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> >> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> >> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> >> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> >> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> >> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> >> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> >> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> >> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> >> -I../qmscommon -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> >> -I/usr/include -
> >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> -
> >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> >> > 0.10.0/include/log4cxx -I/usr/include
> -I/usr/lib/jvm/java-1.7.0-
> >> > openjdk.x86_64/include
> >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> >> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
> >> -I../sqlmsg -
> >> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> >> -I../exp -
> >> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common
> -I../dml
> >> -I../arkfsindp2
> >> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
> >> -I../sqlshare -
> >> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
> >> -I../security -
> >> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> >> >
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> >> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> >> >
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> >> -
> >> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> >> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> >> > MT,executor/linux/64bit/debug/stubs2.o -c -o
> >> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> >> > g++: Internal error: Killed (program cc1plus) ##(SQL)
> >> > Please submit a full bug report. ##(SQL)
> >> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> >> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> >> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> >> > make[4]: Leaving directory `/home/nitinlamba/incubator-
> >> > trafodion/core/sql/nskgmake' ##(SQL)
> >> > make[3]: *** [all] Error 2 ##(SQL)
> >> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> >> > trafodion/core/sqf/sql' ##(SQL)
> >> > make[2]: *** [make_sql] Error 2
> >> > make[2]: Leaving directory
> >> `/home/nitinlamba/incubator-trafodion/core/sqf'
> >> > make[1]: *** [foundation] Error 2
> >> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> >> > make: *** [all] Error 2
> >> > -----------------------------------------------------------
> >> >
> >> > No idea why g++ doesn't like this. Any ideas?
> >> >
> >> > Nitin
> >> > [1]
> >>
> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> >> > 0-on-centos6-4
> >> >
> >> > ________________________________________
> >> > From: Steve Varnau <st...@esgyn.com>
> >> > Sent: Saturday, February 27, 2016 12:08 PM
> >> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
> >> > Subject: RE: Error building Trafodion
> >> >
> >> > The qt-devel package should be optional, just as the QT_TOOLKIT
> variable
> >> > need not be pointing to anything. It is for a an optional
> query-debugger
> >> > tool. I'd say that is a makefile bug that tries to call qmake
> >> > unconditionally.
> >> >
> >> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> >> > 4.8). That seems like a bug as well.
> >> >
> >> > --Steve
> >> >
> >> >
> >> > > -----Original Message-----
> >> > > From: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > Sent: Saturday, February 27, 2016 8:37 AM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau <st...@esgyn.com>
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > Update #3:
> >> > >
> >> > > Tried with CentOS 6.6; gcc seems to be the correct version:
> >> > > $ gcc --version
> >> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> >> > >
> >> > > 'make all' moved further but failed due to 'qmake' not available -
> log
> >> > excerpt
> >> > > below:
> >> > >
> >> > > -----------------------------------------------------------------
> >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar
> -std=c++0x
> >> -
> >> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> -fPIC
> >> > -Wno-
> >> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> >> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> >> > > clitest/linux/64bit/debug/blobtest.o
> >> > clitest/linux/64bit/debug/vers_libclitest.o
> >> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> >> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> >> > -llog4cxx
> >> > > ##(SQL)
> >> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> >> > > cp -f
> $PWD/libSqlCompilerDebugger.so
> >> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> >> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
> >> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to
> parent
> >> > make
> >> > > rule. ##(SQL)
> >> > > make[5]: *** No targets specified and no makefile found.
> >> > Stop. ##(SQL)
> >> > > cp: cannot stat `/home/nitinlamba/incubator-
> >> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so':
> No
> >> > such
> >> > > file or directory ##(SQL)
> >> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> >> > >
> >> > > -----------------------------------------------------------------
> >> > > A quick check on the web suggests that package 'qt-devel' should be
> >> > installed -
> >> > > this is missing from the wiki page as a dependency [1].
> >> > >
> >> > > Frankly, this is too much of a trial and error for a new developer
> to
> >> > get started.
> >> > > The instructions should be updated for all of these gotchas (CentOS
> 6.
> >> X,
> >> > gcc,
> >> > > qmake, ...).
> >> > >
> >> > > I'll keep digging...
> >> > > Nitin
> >> > > [1]
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> >> > > ment
> >> > >
> >> > > ________________________________________
> >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> >> > > Sent: Friday, February 26, 2016 9:27 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> >> > > So sorry for not clear before, you need CentOS 6.6 or older version.
> >> The
> >> > > problem is the GCC version. In the error message below, it seems the
> >> GCC
> >> > you
> >> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
> >> 4.8.
> >> > You
> >> > > have to use a lower version. GCC 4.4.7 is what I am using without
> >> issue,
> >> > and my
> >> > > workstation is CentOS 6.6.
> >> > >
> >> > > It should be possible to install GCC 4.4 on newer CentOS versions,
> but
> >> > maybe
> >> > > need to change some C/C++ rumtime lib as well. You may need to build
> >> the
> >> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
> >> > will try it
> >> > > asap.
> >> > >
> >> > > Thanks,
> >> > > Ming
> >> > >
> >> > > -----????-----
> >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > ????: 2016?2?27? 13:14
> >> > > ???: dev@trafodion.incubator.apache.org
> >> > > ??: Steve Varnau <st...@esgyn.com>
> >> > > ??: Re: Error building Trafodion
> >> > >
> >> > > Update:
> >> > >
> >> > > Started with CentOS 6.7 (Final) but ran into a different issue in
> the
> >> > same
> >> > > module (undefined reference to certain functions) - log excerpt
> below:
> >> > >
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > `std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*
> std::__copy_move<true,
> >> > false,
> >> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char>
> >> >*>(std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> >> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::operator=(std::basic_string<char, std::char_traits<char>,
> >> > std::allocator<char>
> >> > > >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> >> > > ##(Security)
> >> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> >> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
> >> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> >> > > /home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> >> reference
> >> > to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > /home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> >> reference
> >> > to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > collect2: ld returned 1 exit status ##(Security)
> >> > >
> >> > > Any ideas?
> >> > >
> >> > > Nitin
> >> > >
> >> > > ________________________________________
> >> > > From: Nitin Lamba <ni...@ampool.io>
> >> > > Sent: Friday, February 26, 2016 7:37 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > Thanks Ming! Will try with CentOS 6.
> >> > >
> >> > > Nitin
> >> > >
> >> > > ________________________________________
> >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> >> > > Sent: Friday, February 26, 2016 7:32 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: ??: Error building Trafodion
> >> > >
> >> > > Hi, Nitin,
> >> > >
> >> > > I run into same error last week when I tried to use CentOS 7 as my
> >> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> >> > > incompatible.
> >> > > For this particular issue, I modified the Makefile under
> >> > > incubator-trafodion/core/dbsecurity/auth/Makefile
> >> > > to add '-llber' into LINK_OPTIONS
> >> > > And pass this error.
> >> > > I have no idea why current building workstation not meet this link
> >> > error, I have
> >> > > no theory here :-) I have another CentOS 6.5 workstation, same
> >> codebase,
> >> > but
> >> > > not meet this build error. It is still a mystery for me. Need time
> to
> >> > investigate
> >> > > more.
> >> > >
> >> > > But if I you are using GCC 4.8, the building will meet few more
> errors
> >> > after
> >> > > solving this issue. I fixed a few, but still some more are there,
> and
> >> > not able to
> >> > > proceed too much up to now. So I think if you are using gcc 4.8,
> >> please
> >> > consider
> >> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is
> fine.
> >> > >
> >> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> >> > development
> >> > > workstation will save you a lot of time, it is well tested.
> >> > >
> >> > > Thanks,
> >> > > Ming
> >> > >
> >> > > -----????-----
> >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > ????: 2016?2?27? 11:00
> >> > > ???: dev@trafodion.incubator.apache.org
> >> > > ??: Steve Varnau <st...@esgyn.com>
> >> > > ??: Error building Trafodion
> >> > >
> >> > > Hi,
> >> > >
> >> > >
> >> > > I tried to build Trafodion by following the instructions on the wiki
> >> > [1], [2] using
> >> > > 'make all'. However, I ran into an error compiling 'auth' within
> >> > dbsecurity - log
> >> > > excerpt below:
> >> > >
> >> > >
> >> > > [... SNIPPET ...]
> >> > >
> >> > > cd auth; make ##(Security)
> >> > >
> >> > > make[3]: Entering directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth' ##(Security)
> >> > >
> >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> >> > > DNA_64BIT -o /home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I
> ../shared/inc
> >> > -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer
> -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> >> > > ../../sql/common -L/home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> >> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> >> > Linux-
> >> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> >> > ##(Security)
> >> > >
> >> > > /usr/bin/ld:
> >> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> >> > > undefined reference to symbol 'ber_set_option' ##(Security)
> >> > >
> >> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> >> > /lib64/liblber-2.4.so.2 so
> >> > > try adding it to the linker command line ##(Security)
> >> > >
> >> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> >> > ##(Security)
> >> > >
> >> > > collect2: error: ld returned 1 exit status ##(Security)
> >> > >
> >> > > make[3]: *** [/home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> >> > >
> >> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth' ##(Security)
> >> > >
> >> > > make[2]: *** [auth] Error 2 ##(Security)
> >> > >
> >> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity' ##(Security)
> >> > >
> >> > > make[1]: *** [dbsecurity] Error 2
> >> > >
> >> > >
> >> > > Any ideas what I could be doing wrong?
> >> > >
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Nitin
> >> > >
> >> > >
> >> > > [1]
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> >> > > ment
> >> > >
> >> > > [2]
> >> https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
> >>
> >
> >
> >
> > --
> > Thanks,
> >
> > Gunnar
> > *If you think you can you can, if you think you can't you're right.*
> >
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
RE: Error building Trafodion
Posted by Steve Varnau <st...@esgyn.com>.
The change to remove the qmake dependency is in progress:
https://github.com/apache/incubator-trafodion/pull/355
--Steve
> -----Original Message-----
> From: Gunnar Tapper [mailto:tapper.gunnar@gmail.com]
> Sent: Saturday, March 5, 2016 6:42 PM
> To: dev@trafodion.incubator.apache.org
> Cc: Hans Zeller <ha...@esgyn.com>
> Subject: Re: Error building Trafodion
>
> Hi Nitin,
>
> I installed the qt packages separately and then just edited the wiki page.
> I'll change it based on what you found.
>
> Thanks,
>
> Gunnar
>
> On Sat, Mar 5, 2016 at 1:24 PM, Nitin Lamba <ni...@ampool.io> wrote:
>
> > Update #6: Build successful!! This is a long e-mail...
> >
> > Should have mentioned earlier that I've been trying to build a portable
> > dev environment using docker using an 8 GB RAM, 2 CPU linux VM
> (boot2docker
> > on my Mac OSX 10.11.3). Docker image is the official centos/centos6.6
> >
> > $ docker pull centos:centos6.6
> >
> > https://hub.docker.com/_/centos/
> >
> > @Gunnar
> > Thanks for walking through the build process. Serializing make using '-j
> > 1' did the trick! Not sure how much 'make concurrency' I'm sacrificing
> > with
> > this option. Following were the times recorded to do 'make
> > package-all -j
> > 1' after 'make cleanall' on my 8GB VM (this is without building Hadoop
> > project from source):
> >
> > >------------------------------------------
> > real 41m32.886s
> > user 26m28.360s
> > sys 7m34.200s
> > ------------------------------------------<
> >
> > I also noticed the qt-devel and qt-config package changes on the wiki
> > but
> > by installing in that sequence, 'make all' fails to get thrift installed
> > correctly. I found that last time I tried to fix qmake error. Did you
> > get
> > the same error/dependency?
> > >------------------------------------------
> > *** Error: THRIFT_LIB_DIR directory not found:
> > /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/lib
> > *** Error: THRIFT_INC_DIR directory not found:
> > /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> > make[1]: *** [sqroot] Error 1
> > make[1]: *** Waiting for unfinished jobs....
> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> > make: *** [cleanall] Error 2
> >
> > ------------------------------------------<
> > The workaround is to install qt packages AFTER installing all the build
> > tools, especially thrift.
> >
> > @Steve
> >
> > Checked dmesg but no unexpected error messages. Without make
> > serialization, and increasing ulimit stack size to 10240, I'm not able
> > to
> > get the build working. What's puzzling is that my error messages are
> > always
> > different. Here's the third one I got last night (invalid argument):
> >
> > >------------------------------------------
> >
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> > -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> > -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -
> DSQ_LINUX
> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> D_DP2NT_
> > -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -
> D_REENTRANT
> > -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_
> > -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -
> DNA_ITOA_NOT_SUPPORTED -DMPI_
> > -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -
> DSQ_CPP_INTF
> > -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -
> D_DEBUG
> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> > -I../qmscommon -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> > -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> > -I/usr/include
> > -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> > -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> > -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> > -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> 0.10.0/include/log4cxx
> > -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> > -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> > -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> > -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
> > -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> > -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
> > -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
> > -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> > -I../porting_layer -include
> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> > -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> > -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> > -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> > -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> > -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> > -Wp,-MD,executor/linux/64bit/debug/depend/d_ExHbaseDDL.dep
> > -Wp,-MT,executor/linux/64bit/debug/ExHbaseDDL.o -c -o
> > executor/linux/64bit/debug/ExHbaseDDL.o ../executor/ExHbaseDDL.cpp
> ##(SQL)
> > In file included from ../common/NAMemory.h:64, ##(SQL)
> > from ../common/CollHeap.h:36, ##(SQL)
> > from ../common/ComSpace.h:44, ##(SQL)
> > from ../common/NAHeap.h:39, ##(SQL)
> > from ../executor/ex_god.h:45, ##(SQL)
> > from ../cli/cli_stdh.h:23, ##(SQL)
> > from ../executor/ExHbaseDDL.cpp:26: ##(SQL)
> > ../common/NAStringDefGlobals.h:54:33: error:
> > ../common/SqlExportDllDefines.h: Invalid argument ##(SQL)
> > make[4]: *** [executor/linux/64bit/debug/ExHbaseDDL.o] Error 1 ##(SQL)
> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> > make[4]: Leaving directory
> > `/home/nitinlamba/incubator-trafodion/core/sql/nskgmake' ##(SQL)
> > make[3]: *** [all] Error 2 ##(SQL)
> > make[3]: Leaving directory
> > `/home/nitinlamba/incubator-trafodion/core/sqf/sql' ##(SQL)
> > make[2]: *** [make_sql] Error 2
> > make[2]: Leaving directory
> > `/home/nitinlamba/incubator-trafodion/core/sqf'
> > make[1]: *** [foundation] Error 2
> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> > make: *** [all] Error 2
> >
> > ------------------------------------------<
> >
> > It appears that the concurrency in the make process isn't reliable; not
> > sure if it is running into inter-job race conditions - one make job is
> > expecting libs/ artifacts to be available or another job to be complete.
> > I'm no expert but just a hunch...
> >
> > Anyway, I plan to contribute the docker scripts so will create a pull
> > request soon.
> > If someone gives me access to the project wiki, I could even create a
> > page
> > to explain the setup and capture detailed instructions.
> >
> > Thanks,
> > Nitin
> > ________________________________________
> > From: Gunnar Tapper <ta...@gmail.com>
> > Sent: Thursday, March 3, 2016 6:35 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Hans Zeller
> > Subject: Re: Error building Trafodion
> >
> > Hi Nitin:
> >
> > I followed the instructions in the Contributor Guide to the letter and
> > ran
> > into a bunch of problems. I've fixed up the documentation accordingly
> > including installing qmake (temporary fix).
> >
> > It would help tremendously if I could use the same OS image as you're
> > using
> > to ensure that there are no more gotchas. For example, I ran make all -j
> > 1
> > to serialize my make and that worked fine but I'm not sure that such an
> > approach would make any difference in your case.
> >
> > Thanks,
> >
> > Gunnar
> >
> > On Thu, Mar 3, 2016 at 3:54 PM, Gunnar Tapper
> <ta...@gmail.com>
> > wrote:
> >
> > > Hi Nitin,
> > >
> > > I'm going through the instructions from scratch to see if I can
> > > recreate
> > > what you're seeing.I'm using an OpenStack VM with 8 GB of memory.
> Ulimit
> > -s
> > > = 10240.
> > >
> > > Thanks,
> > >
> > > Gunnar
> > >
> > > On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com>
> > > wrote:
> > >
> > >> Hi Nitin,
> > >>
> > >>
> > >>
> > >> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB
> > >> memory,
> > >> 2cpu, no swap space.
> > >>
> > >>
> > >>
> > >> $ ulimit -s
> > >>
> > >> 10240
> > >>
> > >>
> > >>
> > >> Trafodion built fine for me, no problems. Did you check dmesg to see
> > >> if
> > >> there were any kernel messages?
> > >>
> > >>
> > >>
> > >> --Steve
> > >>
> > >>
> > >>
> > >> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
> > >> *Sent:* Thursday, March 3, 2016 11:21 AM
> > >> *To:* dev <de...@trafodion.incubator.apache.org>
> > >> *Cc:* Steve Varnau <st...@esgyn.com>
> > >> *Subject:* Re: Error building Trafodion
> > >>
> > >>
> > >>
> > >> Hi Nitin, if you want to have an environment where the build is
> > >> likely
> > to
> > >> succeed, you can try this Amazon AMI:
> > >>
> > >>
> >
> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_t
> itle?ie=UTF8&sr=0-3&qid=1457026427523
> > >>
> > >>
> > >>
> > >> This has a full Trafodion source tree installed, you can make code
> > >> changes,
> > >> build and debug.
> > >>
> > >>
> > >> Hans
> > >>
> > >>
> > >>
> > >> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
> > >>
> > >> Thanks Steve,
> > >>
> > >> Update #5: Still no luck.
> > >>
> > >> Tried to do a clean setup and build but g++ failed at a different
> > >> step
> > >> now:
> > >>
> > >> -----------------------------------------------------------------
> > >>
> > >> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -
> std=c++0x
> > >> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> > >> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -
> Wformat
> > -Werror
> > >> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
> > >> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -
> DARG_PRESENT_OMIT
> > >> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED
> > -D_TNS_R_TARGET
> > >> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> D_WIN32_WINNT=0x402
> > >> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -
> DHAVE_NETINET_IN_H
> > >> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -
> DUSE_NEW_PHANDLE -DSP_DIS
> > >> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
> > >> -DTRAF_SOFTWARE_VERS_MINOR=0 -
> DTRAF_SOFTWARE_VERS_UPDATE=0
> > >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> > >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> > >> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> > >> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> > >> -I/usr/include
> > >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> > >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> > >> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> > >>
> > >>
> > -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> 0.10.0/include/log4cxx
> > >> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> > >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> > >> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> > >> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> > -I../exp
> > >> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> > >> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman
> > -I../smdio
> > >> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman
> > >> -I../sqludr
> > >> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> > >> -I../porting_layer -include
> > >> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> > >> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> > >>
> > -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> > >> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> > >> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> > >> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> > >> -Wp,-
> MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
> > >> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
> > >> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
> > >> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
> > >> g++: Internal error: Segmentation fault (program cc1plus)
> > >> ##(SQL)
> > >> Please submit a full bug report. ##(SQL)
> > >> See <http://bugzilla.redhat.com/bugzilla> for instructions.
> > >> ##(SQL)
> > >> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
> > >> ##(SQL)
> > >> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> > >>
> > >> -----------------------------------------------------------------
> > >>
> > >> The process hung for me. A quick web search on 'g++ segmentation
> > >> fault'
> > >> [1]
> > >> suggests that maybe the stack size is limited. So I increased the
> > >> limit
> > >> 'ulimit -s 65532' with the same result. I then removed the limit
> > >> completely
> > >> 'ulimit -s unlimited' without any change in outcome. It seems I'm
> > running
> > >> into hardware or environment limitations. Does anyone know the
> minimum
> > >> spec
> > >> for the dev machine? I have an 8 GB VM that I'm running this on.
> > >>
> > >> Not sure what else I can do at this point - running out of ideas and
> > >> patience. Will keep trying to build trafodion in my free time...
> > >>
> > >> Nitin
> > >> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
> > >>
> > >> ________________________________________
> > >> From: Steve Varnau <st...@esgyn.com>
> > >> Sent: Sunday, February 28, 2016 8:54 AM
> > >>
> > >> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> > >> Subject: RE: Error building Trafodion
> > >>
> > >> I have seen this gcc internal error message before. It ended up to be
> > >> nothing in the code, but rather the OS decided the process was taking
> > too
> > >> much memory and killed it. In my case, cgroups was misconfigured to
> > limit
> > >> the user to 10% of memory. The dmesg command or /var/log messages
> showed
> > >> that the OS was doing it.
> > >>
> > >> --Steve
> > >>
> > >>
> > >> > -----Original Message-----
> > >> > From: Nitin Lamba [mailto:nitin@ampool.io]
> > >> > Sent: Sunday, February 28, 2016 8:06 AM
> > >> > To: Steve Varnau <st...@esgyn.com>;
> > >> > dev@trafodion.incubator.apache.org
> > >> > Subject: Re: Error building Trafodion
> > >> >
> > >> > Thanks Steve. Glad that my buggy build journey is helping uncover
> > >> > new
> > >> issues.
> > >> >
> > >> > Update #4: Build is blocked for me - details below:
> > >> >
> > >> > Tried to install qt-devel but it failed to build thrift-0.9.0 in
> > >> > tools
> > >> setup
> > >> > (traf_tools_setup.sh). It seems this is a known issue [1] and
> > >> > besides,
> > >> the script
> > >> > uses '-without-qt' option anyway.
> > >> >
> > >> > So I installed qt-devel package AFTER the tools setup and re-ran
> > >> > 'make
> > >> all'.
> > >> > Now, the build fails on a different step - log excerpt below:
> > >> >
> > >> > -----------------------------------------------------------
> > >> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -
> std=c++0x
> > -
> > >> >
> > >> > heck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> > >> -Wno-
> > >> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -
> DSQ_LINUX
> > >> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> > >> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> > >> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> > >> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> > >> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> > >> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -
> DSQ_CPP_INTF -
> > >> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -
> D_DEBUG
> > >> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> > >> -I../qmscommon -
> > >> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> > >> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> > >> -I/usr/include -
> > >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> > >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> > >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> > -
> > >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> > >> > 0.10.0/include/log4cxx -I/usr/include
> > -I/usr/lib/jvm/java-1.7.0-
> > >> > openjdk.x86_64/include
> > >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> > >> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
> > >> -I../sqlmsg -
> > >> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> > >> -I../exp -
> > >> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common
> > -I../dml
> > >> -I../arkfsindp2
> > >> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
> > >> -I../sqlshare -
> > >> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
> > >> -I../security -
> > >> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> > >> >
> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> > >> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> > >> >
> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> > >> -
> > >> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> > >> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> > -
> > >> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> > >> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> > >> > MT,executor/linux/64bit/debug/stubs2.o -c -o
> > >> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp
> > >> > ##(SQL)
> > >> > g++: Internal error: Killed (program cc1plus) ##(SQL)
> > >> > Please submit a full bug report. ##(SQL)
> > >> > See <http://bugzilla.redhat.com/bugzilla> for instructions.
> > >> > ##(SQL)
> > >> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1
> > >> > ##(SQL)
> > >> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> > >> > make[4]: Leaving directory `/home/nitinlamba/incubator-
> > >> > trafodion/core/sql/nskgmake' ##(SQL)
> > >> > make[3]: *** [all] Error 2 ##(SQL)
> > >> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > >> > trafodion/core/sqf/sql' ##(SQL)
> > >> > make[2]: *** [make_sql] Error 2
> > >> > make[2]: Leaving directory
> > >> `/home/nitinlamba/incubator-trafodion/core/sqf'
> > >> > make[1]: *** [foundation] Error 2
> > >> > make[1]: Leaving directory
> > >> > `/home/nitinlamba/incubator-trafodion/core'
> > >> > make: *** [all] Error 2
> > >> > -----------------------------------------------------------
> > >> >
> > >> > No idea why g++ doesn't like this. Any ideas?
> > >> >
> > >> > Nitin
> > >> > [1]
> > >>
> > http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> > >> > 0-on-centos6-4
> > >> >
> > >> > ________________________________________
> > >> > From: Steve Varnau <st...@esgyn.com>
> > >> > Sent: Saturday, February 27, 2016 12:08 PM
> > >> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
> > >> > Subject: RE: Error building Trafodion
> > >> >
> > >> > The qt-devel package should be optional, just as the QT_TOOLKIT
> > variable
> > >> > need not be pointing to anything. It is for a an optional
> > query-debugger
> > >> > tool. I'd say that is a makefile bug that tries to call qmake
> > >> > unconditionally.
> > >> >
> > >> > Likewise, it is news to me that build does not work on Centos 6.7
> > >> > (gcc
> > >> > 4.8). That seems like a bug as well.
> > >> >
> > >> > --Steve
> > >> >
> > >> >
> > >> > > -----Original Message-----
> > >> > > From: Nitin Lamba [mailto:nitin@ampool.io]
> > >> > > Sent: Saturday, February 27, 2016 8:37 AM
> > >> > > To: dev@trafodion.incubator.apache.org
> > >> > > Cc: Steve Varnau <st...@esgyn.com>
> > >> > > Subject: Re: Error building Trafodion
> > >> > >
> > >> > > Update #3:
> > >> > >
> > >> > > Tried with CentOS 6.6; gcc seems to be the correct version:
> > >> > > $ gcc --version
> > >> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> > >> > >
> > >> > > 'make all' moved further but failed due to 'qmake' not
> > >> > > available -
> > log
> > >> > excerpt
> > >> > > below:
> > >> > >
> > >> > > -----------------------------------------------------------------
> > >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar
> > -std=c++0x
> > >> -
> > >> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> > -fPIC
> > >> > -Wno-
> > >> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> > >> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> > >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> > >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> > >> > > clitest/linux/64bit/debug/blobtest.o
> > >> > clitest/linux/64bit/debug/vers_libclitest.o
> > >> > > clitest/linux/64bit/debug/mpisetup.o -L
> > >> > > /usr/lib/jvm/java-1.7.0-
> > >> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> > >> > -llog4cxx
> > >> > > ##(SQL)
> > >> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> > >> > > cp -f
> > $PWD/libSqlCompilerDebugger.so
> > >> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> > >> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
> > >> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to
> > parent
> > >> > make
> > >> > > rule. ##(SQL)
> > >> > > make[5]: *** No targets specified and no makefile found.
> > >> > Stop. ##(SQL)
> > >> > > cp: cannot stat `/home/nitinlamba/incubator-
> > >> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so':
> > No
> > >> > such
> > >> > > file or directory ##(SQL)
> > >> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> > >> > >
> > >> > > -----------------------------------------------------------------
> > >> > > A quick check on the web suggests that package 'qt-devel' should
> > >> > > be
> > >> > installed -
> > >> > > this is missing from the wiki page as a dependency [1].
> > >> > >
> > >> > > Frankly, this is too much of a trial and error for a new
> > >> > > developer
> > to
> > >> > get started.
> > >> > > The instructions should be updated for all of these gotchas
> > >> > > (CentOS
> > 6.
> > >> X,
> > >> > gcc,
> > >> > > qmake, ...).
> > >> > >
> > >> > > I'll keep digging...
> > >> > > Nitin
> > >> > > [1]
> > >> > >
> > >> >
> > >>
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > >> > > ment
> > >> > >
> > >> > > ________________________________________
> > >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > >> > > Sent: Friday, February 26, 2016 9:27 PM
> > >> > > To: dev@trafodion.incubator.apache.org
> > >> > > Cc: Steve Varnau
> > >> > > Subject: Re: Error building Trafodion
> > >> > >
> > >> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> > >> > > So sorry for not clear before, you need CentOS 6.6 or older
> > >> > > version.
> > >> The
> > >> > > problem is the GCC version. In the error message below, it seems
> > >> > > the
> > >> GCC
> > >> > you
> > >> > > are using is 4.8.2, some Trafodion modules not compatible with
> > >> > > GCC
> > >> 4.8.
> > >> > You
> > >> > > have to use a lower version. GCC 4.4.7 is what I am using without
> > >> issue,
> > >> > and my
> > >> > > workstation is CentOS 6.6.
> > >> > >
> > >> > > It should be possible to install GCC 4.4 on newer CentOS
> > >> > > versions,
> > but
> > >> > maybe
> > >> > > need to change some C/C++ rumtime lib as well. You may need to
> build
> > >> the
> > >> > > toolchain from gcc source code in order to get a complete gcc
> > >> > > 4.4. I
> > >> > will try it
> > >> > > asap.
> > >> > >
> > >> > > Thanks,
> > >> > > Ming
> > >> > >
> > >> > > -----????-----
> > >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> > >> > > ????: 2016?2?27? 13:14
> > >> > > ???: dev@trafodion.incubator.apache.org
> > >> > > ??: Steve Varnau <st...@esgyn.com>
> > >> > > ??: Re: Error building Trafodion
> > >> > >
> > >> > > Update:
> > >> > >
> > >> > > Started with CentOS 6.7 (Final) but ran into a different issue in
> > the
> > >> > same
> > >> > > module (undefined reference to certain functions) - log excerpt
> > below:
> > >> > >
> > >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > >> > `std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char> >*
> > std::__copy_move<true,
> > >> > false,
> > >> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char> >*,
> > >> std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char>
> > >> >*>(std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char> >*,
> > >> std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char> >*,
> > >> std::basic_string<char,
> > >> > > std::char_traits<char>, std::allocator<char> >*)':
> > >> > > ##(Security)
> > >> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined
> > >> > > reference
> > to
> > >> > > `std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > >> > > >::operator=(std::basic_string<char, std::char_traits<char>,
> > >> > std::allocator<char>
> > >> > > >&&)' ##(Security)
> > >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > >> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> > >> > > ##(Security)
> > >> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined
> > >> > > reference
> > to
> > >> > > `std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > >> > > std::allocator<char> >&&)' ##(Security)
> > >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > >> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> > >> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined
> > >> > > reference
> > to
> > >> > > `std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > >> > > std::allocator<char> >&&)' ##(Security)
> > >> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
> > >> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> > >> > > /home/nitinlamba/incubator-
> > >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> > >> reference
> > >> > to
> > >> > > `std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > >> > > std::allocator<char> >&&)' ##(Security)
> > >> > > /home/nitinlamba/incubator-
> > >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> > >> reference
> > >> > to
> > >> > > `std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > >> > > std::allocator<char> >&&)' ##(Security)
> > >> > > collect2: ld returned 1 exit status ##(Security)
> > >> > >
> > >> > > Any ideas?
> > >> > >
> > >> > > Nitin
> > >> > >
> > >> > > ________________________________________
> > >> > > From: Nitin Lamba <ni...@ampool.io>
> > >> > > Sent: Friday, February 26, 2016 7:37 PM
> > >> > > To: dev@trafodion.incubator.apache.org
> > >> > > Cc: Steve Varnau
> > >> > > Subject: Re: Error building Trafodion
> > >> > >
> > >> > > Thanks Ming! Will try with CentOS 6.
> > >> > >
> > >> > > Nitin
> > >> > >
> > >> > > ________________________________________
> > >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > >> > > Sent: Friday, February 26, 2016 7:32 PM
> > >> > > To: dev@trafodion.incubator.apache.org
> > >> > > Cc: Steve Varnau
> > >> > > Subject: ??: Error building Trafodion
> > >> > >
> > >> > > Hi, Nitin,
> > >> > >
> > >> > > I run into same error last week when I tried to use CentOS 7 as
> > >> > > my
> > >> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it
> seems
> > >> > > incompatible.
> > >> > > For this particular issue, I modified the Makefile under
> > >> > > incubator-trafodion/core/dbsecurity/auth/Makefile
> > >> > > to add '-llber' into LINK_OPTIONS
> > >> > > And pass this error.
> > >> > > I have no idea why current building workstation not meet this
> > >> > > link
> > >> > error, I have
> > >> > > no theory here :-) I have another CentOS 6.5 workstation, same
> > >> codebase,
> > >> > but
> > >> > > not meet this build error. It is still a mystery for me. Need
> > >> > > time
> > to
> > >> > investigate
> > >> > > more.
> > >> > >
> > >> > > But if I you are using GCC 4.8, the building will meet few more
> > errors
> > >> > after
> > >> > > solving this issue. I fixed a few, but still some more are there,
> > and
> > >> > not able to
> > >> > > proceed too much up to now. So I think if you are using gcc 4.8,
> > >> please
> > >> > consider
> > >> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is
> > fine.
> > >> > >
> > >> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> > >> > development
> > >> > > workstation will save you a lot of time, it is well tested.
> > >> > >
> > >> > > Thanks,
> > >> > > Ming
> > >> > >
> > >> > > -----????-----
> > >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> > >> > > ????: 2016?2?27? 11:00
> > >> > > ???: dev@trafodion.incubator.apache.org
> > >> > > ??: Steve Varnau <st...@esgyn.com>
> > >> > > ??: Error building Trafodion
> > >> > >
> > >> > > Hi,
> > >> > >
> > >> > >
> > >> > > I tried to build Trafodion by following the instructions on the
> > >> > > wiki
> > >> > [1], [2] using
> > >> > > 'make all'. However, I ran into an error compiling 'auth' within
> > >> > dbsecurity - log
> > >> > > excerpt below:
> > >> > >
> > >> > >
> > >> > > [... SNIPPET ...]
> > >> > >
> > >> > > cd auth; make ##(Security)
> > >> > >
> > >> > > make[3]: Entering directory `/home/nitinlamba/incubator-
> > >> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >> > >
> > >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> > >> > > DNA_64BIT -o /home/nitinlamba/incubator-
> > >> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I
> > ../shared/inc
> > >> > -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer
> > -I
> > >> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> > >> > > ../../sql/common -L/home/nitinlamba/incubator-
> > >> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> > >> > > x86_64/64/rls/ldapconfignode.o
> > >> > > Linux-x86_64/64/rls/versldapcheck.o
> > >> > Linux-
> > >> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> > >> > ##(Security)
> > >> > >
> > >> > > /usr/bin/ld:
> > >> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> > >> > > undefined reference to symbol 'ber_set_option' ##(Security)
> > >> > >
> > >> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> > >> > /lib64/liblber-2.4.so.2 so
> > >> > > try adding it to the linker command line ##(Security)
> > >> > >
> > >> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid
> > >> > > operation
> > >> > ##(Security)
> > >> > >
> > >> > > collect2: error: ld returned 1 exit status ##(Security)
> > >> > >
> > >> > > make[3]: *** [/home/nitinlamba/incubator-
> > >> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> > >> > >
> > >> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > >> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >> > >
> > >> > > make[2]: *** [auth] Error 2 ##(Security)
> > >> > >
> > >> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
> > >> > > trafodion/core/dbsecurity' ##(Security)
> > >> > >
> > >> > > make[1]: *** [dbsecurity] Error 2
> > >> > >
> > >> > >
> > >> > > Any ideas what I could be doing wrong?
> > >> > >
> > >> > >
> > >> > > Thanks,
> > >> > >
> > >> > > Nitin
> > >> > >
> > >> > >
> > >> > > [1]
> > >> > >
> > >> >
> > >>
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > >> > > ment
> > >> > >
> > >> > > [2]
> > >> https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
> > >>
> > >
> > >
> > >
> > > --
> > > Thanks,
> > >
> > > Gunnar
> > > *If you think you can you can, if you think you can't you're right.*
> > >
> >
> >
> >
> > --
> > Thanks,
> >
> > Gunnar
> > *If you think you can you can, if you think you can't you're right.*
>
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
Re: Error building Trafodion
Posted by Gunnar Tapper <ta...@gmail.com>.
Hi Nitin,
I installed the qt packages separately and then just edited the wiki page.
I'll change it based on what you found.
Thanks,
Gunnar
On Sat, Mar 5, 2016 at 1:24 PM, Nitin Lamba <ni...@ampool.io> wrote:
> Update #6: Build successful!! This is a long e-mail...
>
> Should have mentioned earlier that I've been trying to build a portable
> dev environment using docker using an 8 GB RAM, 2 CPU linux VM (boot2docker
> on my Mac OSX 10.11.3). Docker image is the official centos/centos6.6
>
> $ docker pull centos:centos6.6
>
> https://hub.docker.com/_/centos/
>
> @Gunnar
> Thanks for walking through the build process. Serializing make using '-j
> 1' did the trick! Not sure how much 'make concurrency' I'm sacrificing with
> this option. Following were the times recorded to do 'make package-all -j
> 1' after 'make cleanall' on my 8GB VM (this is without building Hadoop
> project from source):
>
> >------------------------------------------
> real 41m32.886s
> user 26m28.360s
> sys 7m34.200s
> ------------------------------------------<
>
> I also noticed the qt-devel and qt-config package changes on the wiki but
> by installing in that sequence, 'make all' fails to get thrift installed
> correctly. I found that last time I tried to fix qmake error. Did you get
> the same error/dependency?
> >------------------------------------------
> *** Error: THRIFT_LIB_DIR directory not found:
> /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/lib
> *** Error: THRIFT_INC_DIR directory not found:
> /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> make[1]: *** [sqroot] Error 1
> make[1]: *** Waiting for unfinished jobs....
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [cleanall] Error 2
>
> ------------------------------------------<
> The workaround is to install qt packages AFTER installing all the build
> tools, especially thrift.
>
> @Steve
>
> Checked dmesg but no unexpected error messages. Without make
> serialization, and increasing ulimit stack size to 10240, I'm not able to
> get the build working. What's puzzling is that my error messages are always
> different. Here's the third one I got last night (invalid argument):
>
> >------------------------------------------
>
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -D_DP2NT_
> -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT
> -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_
> -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_
> -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF
> -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> -I../bin -I../executor -I../runtimestats -I../porting_layer
> -I../qmscommon -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> -Wp,-MD,executor/linux/64bit/debug/depend/d_ExHbaseDDL.dep
> -Wp,-MT,executor/linux/64bit/debug/ExHbaseDDL.o -c -o
> executor/linux/64bit/debug/ExHbaseDDL.o ../executor/ExHbaseDDL.cpp ##(SQL)
> In file included from ../common/NAMemory.h:64, ##(SQL)
> from ../common/CollHeap.h:36, ##(SQL)
> from ../common/ComSpace.h:44, ##(SQL)
> from ../common/NAHeap.h:39, ##(SQL)
> from ../executor/ex_god.h:45, ##(SQL)
> from ../cli/cli_stdh.h:23, ##(SQL)
> from ../executor/ExHbaseDDL.cpp:26: ##(SQL)
> ../common/NAStringDefGlobals.h:54:33: error:
> ../common/SqlExportDllDefines.h: Invalid argument ##(SQL)
> make[4]: *** [executor/linux/64bit/debug/ExHbaseDDL.o] Error 1 ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> make[4]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sql/nskgmake' ##(SQL)
> make[3]: *** [all] Error 2 ##(SQL)
> make[3]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sqf/sql' ##(SQL)
> make[2]: *** [make_sql] Error 2
> make[2]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sqf'
> make[1]: *** [foundation] Error 2
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [all] Error 2
>
> ------------------------------------------<
>
> It appears that the concurrency in the make process isn't reliable; not
> sure if it is running into inter-job race conditions - one make job is
> expecting libs/ artifacts to be available or another job to be complete.
> I'm no expert but just a hunch...
>
> Anyway, I plan to contribute the docker scripts so will create a pull
> request soon.
> If someone gives me access to the project wiki, I could even create a page
> to explain the setup and capture detailed instructions.
>
> Thanks,
> Nitin
> ________________________________________
> From: Gunnar Tapper <ta...@gmail.com>
> Sent: Thursday, March 3, 2016 6:35 PM
> To: dev@trafodion.incubator.apache.org
> Cc: Hans Zeller
> Subject: Re: Error building Trafodion
>
> Hi Nitin:
>
> I followed the instructions in the Contributor Guide to the letter and ran
> into a bunch of problems. I've fixed up the documentation accordingly
> including installing qmake (temporary fix).
>
> It would help tremendously if I could use the same OS image as you're using
> to ensure that there are no more gotchas. For example, I ran make all -j 1
> to serialize my make and that worked fine but I'm not sure that such an
> approach would make any difference in your case.
>
> Thanks,
>
> Gunnar
>
> On Thu, Mar 3, 2016 at 3:54 PM, Gunnar Tapper <ta...@gmail.com>
> wrote:
>
> > Hi Nitin,
> >
> > I'm going through the instructions from scratch to see if I can recreate
> > what you're seeing.I'm using an OpenStack VM with 8 GB of memory. Ulimit
> -s
> > = 10240.
> >
> > Thanks,
> >
> > Gunnar
> >
> > On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com>
> > wrote:
> >
> >> Hi Nitin,
> >>
> >>
> >>
> >> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
> >> 2cpu, no swap space.
> >>
> >>
> >>
> >> $ ulimit -s
> >>
> >> 10240
> >>
> >>
> >>
> >> Trafodion built fine for me, no problems. Did you check dmesg to see if
> >> there were any kernel messages?
> >>
> >>
> >>
> >> --Steve
> >>
> >>
> >>
> >> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
> >> *Sent:* Thursday, March 3, 2016 11:21 AM
> >> *To:* dev <de...@trafodion.incubator.apache.org>
> >> *Cc:* Steve Varnau <st...@esgyn.com>
> >> *Subject:* Re: Error building Trafodion
> >>
> >>
> >>
> >> Hi Nitin, if you want to have an environment where the build is likely
> to
> >> succeed, you can try this Amazon AMI:
> >>
> >>
> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
> >>
> >>
> >>
> >> This has a full Trafodion source tree installed, you can make code
> >> changes,
> >> build and debug.
> >>
> >>
> >> Hans
> >>
> >>
> >>
> >> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
> >>
> >> Thanks Steve,
> >>
> >> Update #5: Still no luck.
> >>
> >> Tried to do a clean setup and build but g++ failed at a different step
> >> now:
> >>
> >> -----------------------------------------------------------------
> >>
> >> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> >> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> >> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat
> -Werror
> >> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
> >> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
> >> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED
> -D_TNS_R_TARGET
> >> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
> >> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
> >> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
> >> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
> >> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> >> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> >> -I/usr/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> >> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> >> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> >>
> >>
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> >> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> >> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> >> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> -I../exp
> >> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> >> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman
> -I../smdio
> >> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman
> >> -I../sqludr
> >> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> >> -I../porting_layer -include
> >> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> >> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> >>
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> >> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> >> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> >> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
> >> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
> >> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
> >> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
> >> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
> >> Please submit a full bug report. ##(SQL)
> >> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> >> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
> >> ##(SQL)
> >> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> >>
> >> -----------------------------------------------------------------
> >>
> >> The process hung for me. A quick web search on 'g++ segmentation fault'
> >> [1]
> >> suggests that maybe the stack size is limited. So I increased the limit
> >> 'ulimit -s 65532' with the same result. I then removed the limit
> >> completely
> >> 'ulimit -s unlimited' without any change in outcome. It seems I'm
> running
> >> into hardware or environment limitations. Does anyone know the minimum
> >> spec
> >> for the dev machine? I have an 8 GB VM that I'm running this on.
> >>
> >> Not sure what else I can do at this point - running out of ideas and
> >> patience. Will keep trying to build trafodion in my free time...
> >>
> >> Nitin
> >> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
> >>
> >> ________________________________________
> >> From: Steve Varnau <st...@esgyn.com>
> >> Sent: Sunday, February 28, 2016 8:54 AM
> >>
> >> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> >> Subject: RE: Error building Trafodion
> >>
> >> I have seen this gcc internal error message before. It ended up to be
> >> nothing in the code, but rather the OS decided the process was taking
> too
> >> much memory and killed it. In my case, cgroups was misconfigured to
> limit
> >> the user to 10% of memory. The dmesg command or /var/log messages showed
> >> that the OS was doing it.
> >>
> >> --Steve
> >>
> >>
> >> > -----Original Message-----
> >> > From: Nitin Lamba [mailto:nitin@ampool.io]
> >> > Sent: Sunday, February 28, 2016 8:06 AM
> >> > To: Steve Varnau <st...@esgyn.com>;
> >> > dev@trafodion.incubator.apache.org
> >> > Subject: Re: Error building Trafodion
> >> >
> >> > Thanks Steve. Glad that my buggy build journey is helping uncover new
> >> issues.
> >> >
> >> > Update #4: Build is blocked for me - details below:
> >> >
> >> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
> >> setup
> >> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
> >> the script
> >> > uses '-without-qt' option anyway.
> >> >
> >> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
> >> all'.
> >> > Now, the build fails on a different step - log excerpt below:
> >> >
> >> > -----------------------------------------------------------
> >> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -
> >> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> >> -Wno-
> >> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> >> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> >> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> >> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> >> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> >> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> >> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> >> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> >> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> >> -I../qmscommon -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> >> -I/usr/include -
> >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> >> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> -
> >> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> >> > 0.10.0/include/log4cxx -I/usr/include
> -I/usr/lib/jvm/java-1.7.0-
> >> > openjdk.x86_64/include
> >> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> >> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
> >> -I../sqlmsg -
> >> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> >> -I../exp -
> >> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common
> -I../dml
> >> -I../arkfsindp2
> >> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
> >> -I../sqlshare -
> >> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
> >> -I../security -
> >> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> >> >
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> >> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> >> >
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> >> -
> >> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -
> >> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> >> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> >> > MT,executor/linux/64bit/debug/stubs2.o -c -o
> >> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> >> > g++: Internal error: Killed (program cc1plus) ##(SQL)
> >> > Please submit a full bug report. ##(SQL)
> >> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> >> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> >> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> >> > make[4]: Leaving directory `/home/nitinlamba/incubator-
> >> > trafodion/core/sql/nskgmake' ##(SQL)
> >> > make[3]: *** [all] Error 2 ##(SQL)
> >> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> >> > trafodion/core/sqf/sql' ##(SQL)
> >> > make[2]: *** [make_sql] Error 2
> >> > make[2]: Leaving directory
> >> `/home/nitinlamba/incubator-trafodion/core/sqf'
> >> > make[1]: *** [foundation] Error 2
> >> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> >> > make: *** [all] Error 2
> >> > -----------------------------------------------------------
> >> >
> >> > No idea why g++ doesn't like this. Any ideas?
> >> >
> >> > Nitin
> >> > [1]
> >>
> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> >> > 0-on-centos6-4
> >> >
> >> > ________________________________________
> >> > From: Steve Varnau <st...@esgyn.com>
> >> > Sent: Saturday, February 27, 2016 12:08 PM
> >> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
> >> > Subject: RE: Error building Trafodion
> >> >
> >> > The qt-devel package should be optional, just as the QT_TOOLKIT
> variable
> >> > need not be pointing to anything. It is for a an optional
> query-debugger
> >> > tool. I'd say that is a makefile bug that tries to call qmake
> >> > unconditionally.
> >> >
> >> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> >> > 4.8). That seems like a bug as well.
> >> >
> >> > --Steve
> >> >
> >> >
> >> > > -----Original Message-----
> >> > > From: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > Sent: Saturday, February 27, 2016 8:37 AM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau <st...@esgyn.com>
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > Update #3:
> >> > >
> >> > > Tried with CentOS 6.6; gcc seems to be the correct version:
> >> > > $ gcc --version
> >> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> >> > >
> >> > > 'make all' moved further but failed due to 'qmake' not available -
> log
> >> > excerpt
> >> > > below:
> >> > >
> >> > > -----------------------------------------------------------------
> >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar
> -std=c++0x
> >> -
> >> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> -fPIC
> >> > -Wno-
> >> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> >> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> >> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> >> > > clitest/linux/64bit/debug/blobtest.o
> >> > clitest/linux/64bit/debug/vers_libclitest.o
> >> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> >> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> >> > -llog4cxx
> >> > > ##(SQL)
> >> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> >> > > cp -f
> $PWD/libSqlCompilerDebugger.so
> >> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> >> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
> >> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to
> parent
> >> > make
> >> > > rule. ##(SQL)
> >> > > make[5]: *** No targets specified and no makefile found.
> >> > Stop. ##(SQL)
> >> > > cp: cannot stat `/home/nitinlamba/incubator-
> >> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so':
> No
> >> > such
> >> > > file or directory ##(SQL)
> >> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> >> > >
> >> > > -----------------------------------------------------------------
> >> > > A quick check on the web suggests that package 'qt-devel' should be
> >> > installed -
> >> > > this is missing from the wiki page as a dependency [1].
> >> > >
> >> > > Frankly, this is too much of a trial and error for a new developer
> to
> >> > get started.
> >> > > The instructions should be updated for all of these gotchas (CentOS
> 6.
> >> X,
> >> > gcc,
> >> > > qmake, ...).
> >> > >
> >> > > I'll keep digging...
> >> > > Nitin
> >> > > [1]
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> >> > > ment
> >> > >
> >> > > ________________________________________
> >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> >> > > Sent: Friday, February 26, 2016 9:27 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> >> > > So sorry for not clear before, you need CentOS 6.6 or older version.
> >> The
> >> > > problem is the GCC version. In the error message below, it seems the
> >> GCC
> >> > you
> >> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
> >> 4.8.
> >> > You
> >> > > have to use a lower version. GCC 4.4.7 is what I am using without
> >> issue,
> >> > and my
> >> > > workstation is CentOS 6.6.
> >> > >
> >> > > It should be possible to install GCC 4.4 on newer CentOS versions,
> but
> >> > maybe
> >> > > need to change some C/C++ rumtime lib as well. You may need to build
> >> the
> >> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
> >> > will try it
> >> > > asap.
> >> > >
> >> > > Thanks,
> >> > > Ming
> >> > >
> >> > > -----????-----
> >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > ????: 2016?2?27? 13:14
> >> > > ???: dev@trafodion.incubator.apache.org
> >> > > ??: Steve Varnau <st...@esgyn.com>
> >> > > ??: Re: Error building Trafodion
> >> > >
> >> > > Update:
> >> > >
> >> > > Started with CentOS 6.7 (Final) but ran into a different issue in
> the
> >> > same
> >> > > module (undefined reference to certain functions) - log excerpt
> below:
> >> > >
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > `std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*
> std::__copy_move<true,
> >> > false,
> >> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char>
> >> >*>(std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*,
> >> std::basic_string<char,
> >> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> >> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::operator=(std::basic_string<char, std::char_traits<char>,
> >> > std::allocator<char>
> >> > > >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> >> > > ##(Security)
> >> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> >> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> >> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference
> to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
> >> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> >> > > /home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> >> reference
> >> > to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > /home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> >> reference
> >> > to
> >> > > `std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> >> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> >> > > std::allocator<char> >&&)' ##(Security)
> >> > > collect2: ld returned 1 exit status ##(Security)
> >> > >
> >> > > Any ideas?
> >> > >
> >> > > Nitin
> >> > >
> >> > > ________________________________________
> >> > > From: Nitin Lamba <ni...@ampool.io>
> >> > > Sent: Friday, February 26, 2016 7:37 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: Re: Error building Trafodion
> >> > >
> >> > > Thanks Ming! Will try with CentOS 6.
> >> > >
> >> > > Nitin
> >> > >
> >> > > ________________________________________
> >> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> >> > > Sent: Friday, February 26, 2016 7:32 PM
> >> > > To: dev@trafodion.incubator.apache.org
> >> > > Cc: Steve Varnau
> >> > > Subject: ??: Error building Trafodion
> >> > >
> >> > > Hi, Nitin,
> >> > >
> >> > > I run into same error last week when I tried to use CentOS 7 as my
> >> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> >> > > incompatible.
> >> > > For this particular issue, I modified the Makefile under
> >> > > incubator-trafodion/core/dbsecurity/auth/Makefile
> >> > > to add '-llber' into LINK_OPTIONS
> >> > > And pass this error.
> >> > > I have no idea why current building workstation not meet this link
> >> > error, I have
> >> > > no theory here :-) I have another CentOS 6.5 workstation, same
> >> codebase,
> >> > but
> >> > > not meet this build error. It is still a mystery for me. Need time
> to
> >> > investigate
> >> > > more.
> >> > >
> >> > > But if I you are using GCC 4.8, the building will meet few more
> errors
> >> > after
> >> > > solving this issue. I fixed a few, but still some more are there,
> and
> >> > not able to
> >> > > proceed too much up to now. So I think if you are using gcc 4.8,
> >> please
> >> > consider
> >> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is
> fine.
> >> > >
> >> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> >> > development
> >> > > workstation will save you a lot of time, it is well tested.
> >> > >
> >> > > Thanks,
> >> > > Ming
> >> > >
> >> > > -----????-----
> >> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
> >> > > ????: 2016?2?27? 11:00
> >> > > ???: dev@trafodion.incubator.apache.org
> >> > > ??: Steve Varnau <st...@esgyn.com>
> >> > > ??: Error building Trafodion
> >> > >
> >> > > Hi,
> >> > >
> >> > >
> >> > > I tried to build Trafodion by following the instructions on the wiki
> >> > [1], [2] using
> >> > > 'make all'. However, I ran into an error compiling 'auth' within
> >> > dbsecurity - log
> >> > > excerpt below:
> >> > >
> >> > >
> >> > > [... SNIPPET ...]
> >> > >
> >> > > cd auth; make ##(Security)
> >> > >
> >> > > make[3]: Entering directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth' ##(Security)
> >> > >
> >> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> >> > > DNA_64BIT -o /home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I
> ../shared/inc
> >> > -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer
> -I
> >> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> >> > > ../../sql/common -L/home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> >> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> >> > Linux-
> >> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> >> > ##(Security)
> >> > >
> >> > > /usr/bin/ld:
> >> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> >> > > undefined reference to symbol 'ber_set_option' ##(Security)
> >> > >
> >> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> >> > /lib64/liblber-2.4.so.2 so
> >> > > try adding it to the linker command line ##(Security)
> >> > >
> >> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> >> > ##(Security)
> >> > >
> >> > > collect2: error: ld returned 1 exit status ##(Security)
> >> > >
> >> > > make[3]: *** [/home/nitinlamba/incubator-
> >> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> >> > >
> >> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity/auth' ##(Security)
> >> > >
> >> > > make[2]: *** [auth] Error 2 ##(Security)
> >> > >
> >> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
> >> > > trafodion/core/dbsecurity' ##(Security)
> >> > >
> >> > > make[1]: *** [dbsecurity] Error 2
> >> > >
> >> > >
> >> > > Any ideas what I could be doing wrong?
> >> > >
> >> > >
> >> > > Thanks,
> >> > >
> >> > > Nitin
> >> > >
> >> > >
> >> > > [1]
> >> > >
> >> >
> >>
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> >> > > ment
> >> > >
> >> > > [2]
> >> https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
> >>
> >
> >
> >
> > --
> > Thanks,
> >
> > Gunnar
> > *If you think you can you can, if you think you can't you're right.*
> >
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
Re: Error building Trafodion
Posted by Nitin Lamba <ni...@ampool.io>.
Update #6: Build successful!! This is a long e-mail...
Should have mentioned earlier that I've been trying to build a portable dev environment using docker using an 8 GB RAM, 2 CPU linux VM (boot2docker on my Mac OSX 10.11.3). Docker image is the official centos/centos6.6
$ docker pull centos:centos6.6
https://hub.docker.com/_/centos/
@Gunnar
Thanks for walking through the build process. Serializing make using '-j 1' did the trick! Not sure how much 'make concurrency' I'm sacrificing with this option. Following were the times recorded to do 'make package-all -j 1' after 'make cleanall' on my 8GB VM (this is without building Hadoop project from source):
>------------------------------------------
real 41m32.886s
user 26m28.360s
sys 7m34.200s
------------------------------------------<
I also noticed the qt-devel and qt-config package changes on the wiki but by installing in that sequence, 'make all' fails to get thrift installed correctly. I found that last time I tried to fix qmake error. Did you get the same error/dependency?
>------------------------------------------
*** Error: THRIFT_LIB_DIR directory not found: /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/lib
*** Error: THRIFT_INC_DIR directory not found: /home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
make[1]: *** [sqroot] Error 1
make[1]: *** Waiting for unfinished jobs....
make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
make: *** [cleanall] Error 2
------------------------------------------<
The workaround is to install qt packages AFTER installing all the build tools, especially thrift.
@Steve
Checked dmesg but no unexpected error messages. Without make serialization, and increasing ulimit stack size to 10240, I'm not able to get the build working. What's puzzling is that my error messages are always different. Here's the third one I got last night (invalid argument):
>------------------------------------------
/usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG -I../bin -I../executor -I../runtimestats -I../porting_layer -I../qmscommon -I/home/nitinlamba/incubator-trafodion/core/sqf/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include -I/usr/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-MD,executor/linux/64bit/debug/depend/d_ExHbaseDDL.dep -Wp,-MT,executor/linux/64bit/debug/ExHbaseDDL.o -c -o executor/linux/64bit/debug/ExHbaseDDL.o ../executor/ExHbaseDDL.cpp ##(SQL)
In file included from ../common/NAMemory.h:64, ##(SQL)
from ../common/CollHeap.h:36, ##(SQL)
from ../common/ComSpace.h:44, ##(SQL)
from ../common/NAHeap.h:39, ##(SQL)
from ../executor/ex_god.h:45, ##(SQL)
from ../cli/cli_stdh.h:23, ##(SQL)
from ../executor/ExHbaseDDL.cpp:26: ##(SQL)
../common/NAStringDefGlobals.h:54:33: error: ../common/SqlExportDllDefines.h: Invalid argument ##(SQL)
make[4]: *** [executor/linux/64bit/debug/ExHbaseDDL.o] Error 1 ##(SQL)
make[4]: *** Waiting for unfinished jobs.... ##(SQL)
make[4]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sql/nskgmake' ##(SQL)
make[3]: *** [all] Error 2 ##(SQL)
make[3]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sqf/sql' ##(SQL)
make[2]: *** [make_sql] Error 2
make[2]: Leaving directory `/home/nitinlamba/incubator-trafodion/core/sqf'
make[1]: *** [foundation] Error 2
make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
make: *** [all] Error 2
------------------------------------------<
It appears that the concurrency in the make process isn't reliable; not sure if it is running into inter-job race conditions - one make job is expecting libs/ artifacts to be available or another job to be complete. I'm no expert but just a hunch...
Anyway, I plan to contribute the docker scripts so will create a pull request soon.
If someone gives me access to the project wiki, I could even create a page to explain the setup and capture detailed instructions.
Thanks,
Nitin
________________________________________
From: Gunnar Tapper <ta...@gmail.com>
Sent: Thursday, March 3, 2016 6:35 PM
To: dev@trafodion.incubator.apache.org
Cc: Hans Zeller
Subject: Re: Error building Trafodion
Hi Nitin:
I followed the instructions in the Contributor Guide to the letter and ran
into a bunch of problems. I've fixed up the documentation accordingly
including installing qmake (temporary fix).
It would help tremendously if I could use the same OS image as you're using
to ensure that there are no more gotchas. For example, I ran make all -j 1
to serialize my make and that worked fine but I'm not sure that such an
approach would make any difference in your case.
Thanks,
Gunnar
On Thu, Mar 3, 2016 at 3:54 PM, Gunnar Tapper <ta...@gmail.com>
wrote:
> Hi Nitin,
>
> I'm going through the instructions from scratch to see if I can recreate
> what you're seeing.I'm using an OpenStack VM with 8 GB of memory. Ulimit -s
> = 10240.
>
> Thanks,
>
> Gunnar
>
> On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com>
> wrote:
>
>> Hi Nitin,
>>
>>
>>
>> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
>> 2cpu, no swap space.
>>
>>
>>
>> $ ulimit -s
>>
>> 10240
>>
>>
>>
>> Trafodion built fine for me, no problems. Did you check dmesg to see if
>> there were any kernel messages?
>>
>>
>>
>> --Steve
>>
>>
>>
>> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
>> *Sent:* Thursday, March 3, 2016 11:21 AM
>> *To:* dev <de...@trafodion.incubator.apache.org>
>> *Cc:* Steve Varnau <st...@esgyn.com>
>> *Subject:* Re: Error building Trafodion
>>
>>
>>
>> Hi Nitin, if you want to have an environment where the build is likely to
>> succeed, you can try this Amazon AMI:
>>
>> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
>>
>>
>>
>> This has a full Trafodion source tree installed, you can make code
>> changes,
>> build and debug.
>>
>>
>> Hans
>>
>>
>>
>> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
>>
>> Thanks Steve,
>>
>> Update #5: Still no luck.
>>
>> Tried to do a clean setup and build but g++ failed at a different step
>> now:
>>
>> -----------------------------------------------------------------
>>
>> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
>> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
>> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror
>> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
>> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
>> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET
>> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
>> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
>> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
>> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
>> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
>> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
>> -I/usr/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
>> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
>>
>> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
>> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
>> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
>> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
>> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
>> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
>> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
>> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman
>> -I../sqludr
>> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
>> -I../porting_layer -include
>> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
>> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
>> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
>> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
>> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
>> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
>> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
>> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
>> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
>> Please submit a full bug report. ##(SQL)
>> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
>> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
>> ##(SQL)
>> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>>
>> -----------------------------------------------------------------
>>
>> The process hung for me. A quick web search on 'g++ segmentation fault'
>> [1]
>> suggests that maybe the stack size is limited. So I increased the limit
>> 'ulimit -s 65532' with the same result. I then removed the limit
>> completely
>> 'ulimit -s unlimited' without any change in outcome. It seems I'm running
>> into hardware or environment limitations. Does anyone know the minimum
>> spec
>> for the dev machine? I have an 8 GB VM that I'm running this on.
>>
>> Not sure what else I can do at this point - running out of ideas and
>> patience. Will keep trying to build trafodion in my free time...
>>
>> Nitin
>> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
>>
>> ________________________________________
>> From: Steve Varnau <st...@esgyn.com>
>> Sent: Sunday, February 28, 2016 8:54 AM
>>
>> To: Nitin Lamba; dev@trafodion.incubator.apache.org
>> Subject: RE: Error building Trafodion
>>
>> I have seen this gcc internal error message before. It ended up to be
>> nothing in the code, but rather the OS decided the process was taking too
>> much memory and killed it. In my case, cgroups was misconfigured to limit
>> the user to 10% of memory. The dmesg command or /var/log messages showed
>> that the OS was doing it.
>>
>> --Steve
>>
>>
>> > -----Original Message-----
>> > From: Nitin Lamba [mailto:nitin@ampool.io]
>> > Sent: Sunday, February 28, 2016 8:06 AM
>> > To: Steve Varnau <st...@esgyn.com>;
>> > dev@trafodion.incubator.apache.org
>> > Subject: Re: Error building Trafodion
>> >
>> > Thanks Steve. Glad that my buggy build journey is helping uncover new
>> issues.
>> >
>> > Update #4: Build is blocked for me - details below:
>> >
>> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
>> setup
>> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
>> the script
>> > uses '-without-qt' option anyway.
>> >
>> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
>> all'.
>> > Now, the build fails on a different step - log excerpt below:
>> >
>> > -----------------------------------------------------------
>> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
>> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
>> -Wno-
>> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
>> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
>> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
>> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
>> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
>> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
>> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
>> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
>> > -I../bin -I../executor -I../runtimestats -I../porting_layer
>> -I../qmscommon -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
>> -I/usr/include -
>> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
>> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
>> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
>> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
>> > 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
>> > openjdk.x86_64/include
>> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
>> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
>> -I../sqlmsg -
>> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
>> -I../exp -
>> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
>> -I../arkfsindp2
>> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
>> -I../sqlshare -
>> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
>> -I../security -
>> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
>> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
>> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
>> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
>> -
>> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
>> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
>> > MT,executor/linux/64bit/debug/stubs2.o -c -o
>> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
>> > g++: Internal error: Killed (program cc1plus) ##(SQL)
>> > Please submit a full bug report. ##(SQL)
>> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
>> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
>> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>> > make[4]: Leaving directory `/home/nitinlamba/incubator-
>> > trafodion/core/sql/nskgmake' ##(SQL)
>> > make[3]: *** [all] Error 2 ##(SQL)
>> > make[3]: Leaving directory `/home/nitinlamba/incubator-
>> > trafodion/core/sqf/sql' ##(SQL)
>> > make[2]: *** [make_sql] Error 2
>> > make[2]: Leaving directory
>> `/home/nitinlamba/incubator-trafodion/core/sqf'
>> > make[1]: *** [foundation] Error 2
>> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
>> > make: *** [all] Error 2
>> > -----------------------------------------------------------
>> >
>> > No idea why g++ doesn't like this. Any ideas?
>> >
>> > Nitin
>> > [1]
>> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
>> > 0-on-centos6-4
>> >
>> > ________________________________________
>> > From: Steve Varnau <st...@esgyn.com>
>> > Sent: Saturday, February 27, 2016 12:08 PM
>> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
>> > Subject: RE: Error building Trafodion
>> >
>> > The qt-devel package should be optional, just as the QT_TOOLKIT variable
>> > need not be pointing to anything. It is for a an optional query-debugger
>> > tool. I'd say that is a makefile bug that tries to call qmake
>> > unconditionally.
>> >
>> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
>> > 4.8). That seems like a bug as well.
>> >
>> > --Steve
>> >
>> >
>> > > -----Original Message-----
>> > > From: Nitin Lamba [mailto:nitin@ampool.io]
>> > > Sent: Saturday, February 27, 2016 8:37 AM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau <st...@esgyn.com>
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > Update #3:
>> > >
>> > > Tried with CentOS 6.6; gcc seems to be the correct version:
>> > > $ gcc --version
>> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
>> > >
>> > > 'make all' moved further but failed due to 'qmake' not available - log
>> > excerpt
>> > > below:
>> > >
>> > > -----------------------------------------------------------------
>> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
>> -
>> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
>> > -Wno-
>> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
>> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
>> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
>> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
>> > > clitest/linux/64bit/debug/blobtest.o
>> > clitest/linux/64bit/debug/vers_libclitest.o
>> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
>> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
>> > -llog4cxx
>> > > ##(SQL)
>> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
>> > > cp -f $PWD/libSqlCompilerDebugger.so
>> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
>> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
>> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
>> > make
>> > > rule. ##(SQL)
>> > > make[5]: *** No targets specified and no makefile found.
>> > Stop. ##(SQL)
>> > > cp: cannot stat `/home/nitinlamba/incubator-
>> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
>> > such
>> > > file or directory ##(SQL)
>> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
>> > >
>> > > -----------------------------------------------------------------
>> > > A quick check on the web suggests that package 'qt-devel' should be
>> > installed -
>> > > this is missing from the wiki page as a dependency [1].
>> > >
>> > > Frankly, this is too much of a trial and error for a new developer to
>> > get started.
>> > > The instructions should be updated for all of these gotchas (CentOS 6.
>> X,
>> > gcc,
>> > > qmake, ...).
>> > >
>> > > I'll keep digging...
>> > > Nitin
>> > > [1]
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
>> > > ment
>> > >
>> > > ________________________________________
>> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
>> > > Sent: Friday, February 26, 2016 9:27 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
>> > > So sorry for not clear before, you need CentOS 6.6 or older version.
>> The
>> > > problem is the GCC version. In the error message below, it seems the
>> GCC
>> > you
>> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
>> 4.8.
>> > You
>> > > have to use a lower version. GCC 4.4.7 is what I am using without
>> issue,
>> > and my
>> > > workstation is CentOS 6.6.
>> > >
>> > > It should be possible to install GCC 4.4 on newer CentOS versions, but
>> > maybe
>> > > need to change some C/C++ rumtime lib as well. You may need to build
>> the
>> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
>> > will try it
>> > > asap.
>> > >
>> > > Thanks,
>> > > Ming
>> > >
>> > > -----????-----
>> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
>> > > ????: 2016?2?27? 13:14
>> > > ???: dev@trafodion.incubator.apache.org
>> > > ??: Steve Varnau <st...@esgyn.com>
>> > > ??: Re: Error building Trafodion
>> > >
>> > > Update:
>> > >
>> > > Started with CentOS 6.7 (Final) but ran into a different issue in the
>> > same
>> > > module (undefined reference to certain functions) - log excerpt below:
>> > >
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > `std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
>> > false,
>> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char>
>> >*>(std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
>> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::operator=(std::basic_string<char, std::char_traits<char>,
>> > std::allocator<char>
>> > > >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
>> > > ##(Security)
>> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
>> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
>> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
>> > > /home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
>> reference
>> > to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > /home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
>> reference
>> > to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > collect2: ld returned 1 exit status ##(Security)
>> > >
>> > > Any ideas?
>> > >
>> > > Nitin
>> > >
>> > > ________________________________________
>> > > From: Nitin Lamba <ni...@ampool.io>
>> > > Sent: Friday, February 26, 2016 7:37 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > Thanks Ming! Will try with CentOS 6.
>> > >
>> > > Nitin
>> > >
>> > > ________________________________________
>> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
>> > > Sent: Friday, February 26, 2016 7:32 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: ??: Error building Trafodion
>> > >
>> > > Hi, Nitin,
>> > >
>> > > I run into same error last week when I tried to use CentOS 7 as my
>> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
>> > > incompatible.
>> > > For this particular issue, I modified the Makefile under
>> > > incubator-trafodion/core/dbsecurity/auth/Makefile
>> > > to add '-llber' into LINK_OPTIONS
>> > > And pass this error.
>> > > I have no idea why current building workstation not meet this link
>> > error, I have
>> > > no theory here :-) I have another CentOS 6.5 workstation, same
>> codebase,
>> > but
>> > > not meet this build error. It is still a mystery for me. Need time to
>> > investigate
>> > > more.
>> > >
>> > > But if I you are using GCC 4.8, the building will meet few more errors
>> > after
>> > > solving this issue. I fixed a few, but still some more are there, and
>> > not able to
>> > > proceed too much up to now. So I think if you are using gcc 4.8,
>> please
>> > consider
>> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
>> > >
>> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
>> > development
>> > > workstation will save you a lot of time, it is well tested.
>> > >
>> > > Thanks,
>> > > Ming
>> > >
>> > > -----????-----
>> > > ???: Nitin Lamba [mailto:nitin@ampool.io]
>> > > ????: 2016?2?27? 11:00
>> > > ???: dev@trafodion.incubator.apache.org
>> > > ??: Steve Varnau <st...@esgyn.com>
>> > > ??: Error building Trafodion
>> > >
>> > > Hi,
>> > >
>> > >
>> > > I tried to build Trafodion by following the instructions on the wiki
>> > [1], [2] using
>> > > 'make all'. However, I ran into an error compiling 'auth' within
>> > dbsecurity - log
>> > > excerpt below:
>> > >
>> > >
>> > > [... SNIPPET ...]
>> > >
>> > > cd auth; make ##(Security)
>> > >
>> > > make[3]: Entering directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth' ##(Security)
>> > >
>> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
>> > > DNA_64BIT -o /home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
>> > -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
>> > > ../../sql/common -L/home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
>> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
>> > Linux-
>> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
>> > ##(Security)
>> > >
>> > > /usr/bin/ld:
>> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
>> > > undefined reference to symbol 'ber_set_option' ##(Security)
>> > >
>> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
>> > /lib64/liblber-2.4.so.2 so
>> > > try adding it to the linker command line ##(Security)
>> > >
>> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
>> > ##(Security)
>> > >
>> > > collect2: error: ld returned 1 exit status ##(Security)
>> > >
>> > > make[3]: *** [/home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
>> > >
>> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth' ##(Security)
>> > >
>> > > make[2]: *** [auth] Error 2 ##(Security)
>> > >
>> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity' ##(Security)
>> > >
>> > > make[1]: *** [dbsecurity] Error 2
>> > >
>> > >
>> > > Any ideas what I could be doing wrong?
>> > >
>> > >
>> > > Thanks,
>> > >
>> > > Nitin
>> > >
>> > >
>> > > [1]
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
>> > > ment
>> > >
>> > > [2]
>> https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
>>
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
Re: Error building Trafodion
Posted by Gunnar Tapper <ta...@gmail.com>.
Hi Nitin:
I followed the instructions in the Contributor Guide to the letter and ran
into a bunch of problems. I've fixed up the documentation accordingly
including installing qmake (temporary fix).
It would help tremendously if I could use the same OS image as you're using
to ensure that there are no more gotchas. For example, I ran make all -j 1
to serialize my make and that worked fine but I'm not sure that such an
approach would make any difference in your case.
Thanks,
Gunnar
On Thu, Mar 3, 2016 at 3:54 PM, Gunnar Tapper <ta...@gmail.com>
wrote:
> Hi Nitin,
>
> I'm going through the instructions from scratch to see if I can recreate
> what you're seeing.I'm using an OpenStack VM with 8 GB of memory. Ulimit -s
> = 10240.
>
> Thanks,
>
> Gunnar
>
> On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com>
> wrote:
>
>> Hi Nitin,
>>
>>
>>
>> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
>> 2cpu, no swap space.
>>
>>
>>
>> $ ulimit -s
>>
>> 10240
>>
>>
>>
>> Trafodion built fine for me, no problems. Did you check dmesg to see if
>> there were any kernel messages?
>>
>>
>>
>> --Steve
>>
>>
>>
>> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
>> *Sent:* Thursday, March 3, 2016 11:21 AM
>> *To:* dev <de...@trafodion.incubator.apache.org>
>> *Cc:* Steve Varnau <st...@esgyn.com>
>> *Subject:* Re: Error building Trafodion
>>
>>
>>
>> Hi Nitin, if you want to have an environment where the build is likely to
>> succeed, you can try this Amazon AMI:
>>
>> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
>>
>>
>>
>> This has a full Trafodion source tree installed, you can make code
>> changes,
>> build and debug.
>>
>>
>> Hans
>>
>>
>>
>> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
>>
>> Thanks Steve,
>>
>> Update #5: Still no luck.
>>
>> Tried to do a clean setup and build but g++ failed at a different step
>> now:
>>
>> -----------------------------------------------------------------
>>
>> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
>> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
>> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror
>> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
>> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
>> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET
>> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
>> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
>> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
>> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
>> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
>> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
>> -I/usr/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
>> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
>> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
>>
>> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
>> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
>> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
>> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
>> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
>> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
>> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
>> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman
>> -I../sqludr
>> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
>> -I../porting_layer -include
>> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
>> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
>> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
>> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
>> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
>> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
>> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
>> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
>> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
>> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
>> Please submit a full bug report. ##(SQL)
>> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
>> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
>> ##(SQL)
>> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>>
>> -----------------------------------------------------------------
>>
>> The process hung for me. A quick web search on 'g++ segmentation fault'
>> [1]
>> suggests that maybe the stack size is limited. So I increased the limit
>> 'ulimit -s 65532' with the same result. I then removed the limit
>> completely
>> 'ulimit -s unlimited' without any change in outcome. It seems I'm running
>> into hardware or environment limitations. Does anyone know the minimum
>> spec
>> for the dev machine? I have an 8 GB VM that I'm running this on.
>>
>> Not sure what else I can do at this point - running out of ideas and
>> patience. Will keep trying to build trafodion in my free time...
>>
>> Nitin
>> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
>>
>> ________________________________________
>> From: Steve Varnau <st...@esgyn.com>
>> Sent: Sunday, February 28, 2016 8:54 AM
>>
>> To: Nitin Lamba; dev@trafodion.incubator.apache.org
>> Subject: RE: Error building Trafodion
>>
>> I have seen this gcc internal error message before. It ended up to be
>> nothing in the code, but rather the OS decided the process was taking too
>> much memory and killed it. In my case, cgroups was misconfigured to limit
>> the user to 10% of memory. The dmesg command or /var/log messages showed
>> that the OS was doing it.
>>
>> --Steve
>>
>>
>> > -----Original Message-----
>> > From: Nitin Lamba [mailto:nitin@ampool.io]
>> > Sent: Sunday, February 28, 2016 8:06 AM
>> > To: Steve Varnau <st...@esgyn.com>;
>> > dev@trafodion.incubator.apache.org
>> > Subject: Re: Error building Trafodion
>> >
>> > Thanks Steve. Glad that my buggy build journey is helping uncover new
>> issues.
>> >
>> > Update #4: Build is blocked for me - details below:
>> >
>> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
>> setup
>> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
>> the script
>> > uses '-without-qt' option anyway.
>> >
>> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
>> all'.
>> > Now, the build fails on a different step - log excerpt below:
>> >
>> > -----------------------------------------------------------
>> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
>> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
>> -Wno-
>> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
>> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
>> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
>> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
>> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
>> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
>> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
>> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
>> > -I../bin -I../executor -I../runtimestats -I../porting_layer
>> -I../qmscommon -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
>> -I/usr/include -
>> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
>> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
>> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
>> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
>> > 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
>> > openjdk.x86_64/include
>> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
>> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
>> -I../sqlmsg -
>> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
>> -I../exp -
>> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
>> -I../arkfsindp2
>> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
>> -I../sqlshare -
>> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
>> -I../security -
>> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
>> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
>> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
>> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
>> -
>> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
>> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
>> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
>> > MT,executor/linux/64bit/debug/stubs2.o -c -o
>> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
>> > g++: Internal error: Killed (program cc1plus) ##(SQL)
>> > Please submit a full bug report. ##(SQL)
>> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
>> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
>> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>> > make[4]: Leaving directory `/home/nitinlamba/incubator-
>> > trafodion/core/sql/nskgmake' ##(SQL)
>> > make[3]: *** [all] Error 2 ##(SQL)
>> > make[3]: Leaving directory `/home/nitinlamba/incubator-
>> > trafodion/core/sqf/sql' ##(SQL)
>> > make[2]: *** [make_sql] Error 2
>> > make[2]: Leaving directory
>> `/home/nitinlamba/incubator-trafodion/core/sqf'
>> > make[1]: *** [foundation] Error 2
>> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
>> > make: *** [all] Error 2
>> > -----------------------------------------------------------
>> >
>> > No idea why g++ doesn't like this. Any ideas?
>> >
>> > Nitin
>> > [1]
>> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
>> > 0-on-centos6-4
>> >
>> > ________________________________________
>> > From: Steve Varnau <st...@esgyn.com>
>> > Sent: Saturday, February 27, 2016 12:08 PM
>> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
>> > Subject: RE: Error building Trafodion
>> >
>> > The qt-devel package should be optional, just as the QT_TOOLKIT variable
>> > need not be pointing to anything. It is for a an optional query-debugger
>> > tool. I'd say that is a makefile bug that tries to call qmake
>> > unconditionally.
>> >
>> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
>> > 4.8). That seems like a bug as well.
>> >
>> > --Steve
>> >
>> >
>> > > -----Original Message-----
>> > > From: Nitin Lamba [mailto:nitin@ampool.io]
>> > > Sent: Saturday, February 27, 2016 8:37 AM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau <st...@esgyn.com>
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > Update #3:
>> > >
>> > > Tried with CentOS 6.6; gcc seems to be the correct version:
>> > > $ gcc --version
>> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
>> > >
>> > > 'make all' moved further but failed due to 'qmake' not available - log
>> > excerpt
>> > > below:
>> > >
>> > > -----------------------------------------------------------------
>> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
>> -
>> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
>> > -Wno-
>> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
>> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
>> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
>> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
>> > > clitest/linux/64bit/debug/blobtest.o
>> > clitest/linux/64bit/debug/vers_libclitest.o
>> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
>> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
>> > -llog4cxx
>> > > ##(SQL)
>> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
>> > > cp -f $PWD/libSqlCompilerDebugger.so
>> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
>> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
>> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
>> > make
>> > > rule. ##(SQL)
>> > > make[5]: *** No targets specified and no makefile found.
>> > Stop. ##(SQL)
>> > > cp: cannot stat `/home/nitinlamba/incubator-
>> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
>> > such
>> > > file or directory ##(SQL)
>> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
>> > >
>> > > -----------------------------------------------------------------
>> > > A quick check on the web suggests that package 'qt-devel' should be
>> > installed -
>> > > this is missing from the wiki page as a dependency [1].
>> > >
>> > > Frankly, this is too much of a trial and error for a new developer to
>> > get started.
>> > > The instructions should be updated for all of these gotchas (CentOS 6.
>> X,
>> > gcc,
>> > > qmake, ...).
>> > >
>> > > I'll keep digging...
>> > > Nitin
>> > > [1]
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
>> > > ment
>> > >
>> > > ________________________________________
>> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
>> > > Sent: Friday, February 26, 2016 9:27 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
>> > > So sorry for not clear before, you need CentOS 6.6 or older version.
>> The
>> > > problem is the GCC version. In the error message below, it seems the
>> GCC
>> > you
>> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
>> 4.8.
>> > You
>> > > have to use a lower version. GCC 4.4.7 is what I am using without
>> issue,
>> > and my
>> > > workstation is CentOS 6.6.
>> > >
>> > > It should be possible to install GCC 4.4 on newer CentOS versions, but
>> > maybe
>> > > need to change some C/C++ rumtime lib as well. You may need to build
>> the
>> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
>> > will try it
>> > > asap.
>> > >
>> > > Thanks,
>> > > Ming
>> > >
>> > > -----邮件原件-----
>> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
>> > > 发送时间: 2016年2月27日 13:14
>> > > 收件人: dev@trafodion.incubator.apache.org
>> > > 抄送: Steve Varnau <st...@esgyn.com>
>> > > 主题: Re: Error building Trafodion
>> > >
>> > > Update:
>> > >
>> > > Started with CentOS 6.7 (Final) but ran into a different issue in the
>> > same
>> > > module (undefined reference to certain functions) - log excerpt below:
>> > >
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > `std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
>> > false,
>> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char>
>> >*>(std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*,
>> std::basic_string<char,
>> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
>> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::operator=(std::basic_string<char, std::char_traits<char>,
>> > std::allocator<char>
>> > > >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
>> > > ##(Security)
>> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
>> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
>> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
>> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
>> > > /home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
>> reference
>> > to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > /home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
>> reference
>> > to
>> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
>> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
>> > > std::allocator<char> >&&)' ##(Security)
>> > > collect2: ld returned 1 exit status ##(Security)
>> > >
>> > > Any ideas?
>> > >
>> > > Nitin
>> > >
>> > > ________________________________________
>> > > From: Nitin Lamba <ni...@ampool.io>
>> > > Sent: Friday, February 26, 2016 7:37 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: Re: Error building Trafodion
>> > >
>> > > Thanks Ming! Will try with CentOS 6.
>> > >
>> > > Nitin
>> > >
>> > > ________________________________________
>> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
>> > > Sent: Friday, February 26, 2016 7:32 PM
>> > > To: dev@trafodion.incubator.apache.org
>> > > Cc: Steve Varnau
>> > > Subject: 答复: Error building Trafodion
>> > >
>> > > Hi, Nitin,
>> > >
>> > > I run into same error last week when I tried to use CentOS 7 as my
>> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
>> > > incompatible.
>> > > For this particular issue, I modified the Makefile under
>> > > incubator-trafodion/core/dbsecurity/auth/Makefile
>> > > to add '-llber' into LINK_OPTIONS
>> > > And pass this error.
>> > > I have no idea why current building workstation not meet this link
>> > error, I have
>> > > no theory here :-) I have another CentOS 6.5 workstation, same
>> codebase,
>> > but
>> > > not meet this build error. It is still a mystery for me. Need time to
>> > investigate
>> > > more.
>> > >
>> > > But if I you are using GCC 4.8, the building will meet few more errors
>> > after
>> > > solving this issue. I fixed a few, but still some more are there, and
>> > not able to
>> > > proceed too much up to now. So I think if you are using gcc 4.8,
>> please
>> > consider
>> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
>> > >
>> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
>> > development
>> > > workstation will save you a lot of time, it is well tested.
>> > >
>> > > Thanks,
>> > > Ming
>> > >
>> > > -----邮件原件-----
>> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
>> > > 发送时间: 2016年2月27日 11:00
>> > > 收件人: dev@trafodion.incubator.apache.org
>> > > 抄送: Steve Varnau <st...@esgyn.com>
>> > > 主题: Error building Trafodion
>> > >
>> > > Hi,
>> > >
>> > >
>> > > I tried to build Trafodion by following the instructions on the wiki
>> > [1], [2] using
>> > > 'make all'. However, I ran into an error compiling 'auth' within
>> > dbsecurity - log
>> > > excerpt below:
>> > >
>> > >
>> > > [... SNIPPET ...]
>> > >
>> > > cd auth; make ##(Security)
>> > >
>> > > make[3]: Entering directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth' ##(Security)
>> > >
>> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
>> > > DNA_64BIT -o /home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
>> > -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
>> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
>> > > ../../sql/common -L/home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
>> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
>> > Linux-
>> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
>> > ##(Security)
>> > >
>> > > /usr/bin/ld:
>> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
>> > > undefined reference to symbol 'ber_set_option' ##(Security)
>> > >
>> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
>> > /lib64/liblber-2.4.so.2 so
>> > > try adding it to the linker command line ##(Security)
>> > >
>> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
>> > ##(Security)
>> > >
>> > > collect2: error: ld returned 1 exit status ##(Security)
>> > >
>> > > make[3]: *** [/home/nitinlamba/incubator-
>> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
>> > >
>> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity/auth' ##(Security)
>> > >
>> > > make[2]: *** [auth] Error 2 ##(Security)
>> > >
>> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
>> > > trafodion/core/dbsecurity' ##(Security)
>> > >
>> > > make[1]: *** [dbsecurity] Error 2
>> > >
>> > >
>> > > Any ideas what I could be doing wrong?
>> > >
>> > >
>> > > Thanks,
>> > >
>> > > Nitin
>> > >
>> > >
>> > > [1]
>> > >
>> >
>> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
>> > > ment
>> > >
>> > > [2]
>> https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
>>
>
>
>
> --
> Thanks,
>
> Gunnar
> *If you think you can you can, if you think you can't you're right.*
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
Re: Error building Trafodion
Posted by Gunnar Tapper <ta...@gmail.com>.
Hi Nitin,
I'm going through the instructions from scratch to see if I can recreate
what you're seeing.I'm using an OpenStack VM with 8 GB of memory. Ulimit -s
= 10240.
Thanks,
Gunnar
On Thu, Mar 3, 2016 at 2:40 PM, Steve Varnau <st...@esgyn.com> wrote:
> Hi Nitin,
>
>
>
> I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
> 2cpu, no swap space.
>
>
>
> $ ulimit -s
>
> 10240
>
>
>
> Trafodion built fine for me, no problems. Did you check dmesg to see if
> there were any kernel messages?
>
>
>
> --Steve
>
>
>
> *From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
> *Sent:* Thursday, March 3, 2016 11:21 AM
> *To:* dev <de...@trafodion.incubator.apache.org>
> *Cc:* Steve Varnau <st...@esgyn.com>
> *Subject:* Re: Error building Trafodion
>
>
>
> Hi Nitin, if you want to have an environment where the build is likely to
> succeed, you can try this Amazon AMI:
>
> https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
>
>
>
> This has a full Trafodion source tree installed, you can make code changes,
> build and debug.
>
>
> Hans
>
>
>
> On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
>
> Thanks Steve,
>
> Update #5: Still no luck.
>
> Tried to do a clean setup and build but g++ failed at a different step now:
>
> -----------------------------------------------------------------
>
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror
> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET
> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
>
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
> Please submit a full bug report. ##(SQL)
> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
> ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>
> -----------------------------------------------------------------
>
> The process hung for me. A quick web search on 'g++ segmentation fault' [1]
> suggests that maybe the stack size is limited. So I increased the limit
> 'ulimit -s 65532' with the same result. I then removed the limit completely
> 'ulimit -s unlimited' without any change in outcome. It seems I'm running
> into hardware or environment limitations. Does anyone know the minimum spec
> for the dev machine? I have an 8 GB VM that I'm running this on.
>
> Not sure what else I can do at this point - running out of ideas and
> patience. Will keep trying to build trafodion in my free time...
>
> Nitin
> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
>
> ________________________________________
> From: Steve Varnau <st...@esgyn.com>
> Sent: Sunday, February 28, 2016 8:54 AM
>
> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> Subject: RE: Error building Trafodion
>
> I have seen this gcc internal error message before. It ended up to be
> nothing in the code, but rather the OS decided the process was taking too
> much memory and killed it. In my case, cgroups was misconfigured to limit
> the user to 10% of memory. The dmesg command or /var/log messages showed
> that the OS was doing it.
>
> --Steve
>
>
> > -----Original Message-----
> > From: Nitin Lamba [mailto:nitin@ampool.io]
> > Sent: Sunday, February 28, 2016 8:06 AM
> > To: Steve Varnau <st...@esgyn.com>;
> > dev@trafodion.incubator.apache.org
> > Subject: Re: Error building Trafodion
> >
> > Thanks Steve. Glad that my buggy build journey is helping uncover new
> issues.
> >
> > Update #4: Build is blocked for me - details below:
> >
> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
> setup
> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
> the script
> > uses '-without-qt' option anyway.
> >
> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
> all'.
> > Now, the build fails on a different step - log excerpt below:
> >
> > -----------------------------------------------------------
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-
> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> -I../qmscommon -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include -
> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> > 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
> > openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
> -I../sqlmsg -
> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> -I../exp -
> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2
> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
> -I../sqlshare -
> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
> -I../security -
> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -
> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> > MT,executor/linux/64bit/debug/stubs2.o -c -o
> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> > g++: Internal error: Killed (program cc1plus) ##(SQL)
> > Please submit a full bug report. ##(SQL)
> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> > make[4]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/sql/nskgmake' ##(SQL)
> > make[3]: *** [all] Error 2 ##(SQL)
> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/sqf/sql' ##(SQL)
> > make[2]: *** [make_sql] Error 2
> > make[2]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sqf'
> > make[1]: *** [foundation] Error 2
> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> > make: *** [all] Error 2
> > -----------------------------------------------------------
> >
> > No idea why g++ doesn't like this. Any ideas?
> >
> > Nitin
> > [1]
> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> > 0-on-centos6-4
> >
> > ________________________________________
> > From: Steve Varnau <st...@esgyn.com>
> > Sent: Saturday, February 27, 2016 12:08 PM
> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
> > Subject: RE: Error building Trafodion
> >
> > The qt-devel package should be optional, just as the QT_TOOLKIT variable
> > need not be pointing to anything. It is for a an optional query-debugger
> > tool. I'd say that is a makefile bug that tries to call qmake
> > unconditionally.
> >
> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> > 4.8). That seems like a bug as well.
> >
> > --Steve
> >
> >
> > > -----Original Message-----
> > > From: Nitin Lamba [mailto:nitin@ampool.io]
> > > Sent: Saturday, February 27, 2016 8:37 AM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau <st...@esgyn.com>
> > > Subject: Re: Error building Trafodion
> > >
> > > Update #3:
> > >
> > > Tried with CentOS 6.6; gcc seems to be the correct version:
> > > $ gcc --version
> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> > >
> > > 'make all' moved further but failed due to 'qmake' not available - log
> > excerpt
> > > below:
> > >
> > > -----------------------------------------------------------------
> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -
> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> > -Wno-
> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> > > clitest/linux/64bit/debug/blobtest.o
> > clitest/linux/64bit/debug/vers_libclitest.o
> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> > -llog4cxx
> > > ##(SQL)
> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> > > cp -f $PWD/libSqlCompilerDebugger.so
> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
> > make
> > > rule. ##(SQL)
> > > make[5]: *** No targets specified and no makefile found.
> > Stop. ##(SQL)
> > > cp: cannot stat `/home/nitinlamba/incubator-
> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
> > such
> > > file or directory ##(SQL)
> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> > >
> > > -----------------------------------------------------------------
> > > A quick check on the web suggests that package 'qt-devel' should be
> > installed -
> > > this is missing from the wiki page as a dependency [1].
> > >
> > > Frankly, this is too much of a trial and error for a new developer to
> > get started.
> > > The instructions should be updated for all of these gotchas (CentOS 6.
> X,
> > gcc,
> > > qmake, ...).
> > >
> > > I'll keep digging...
> > > Nitin
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > > ment
> > >
> > > ________________________________________
> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > > Sent: Friday, February 26, 2016 9:27 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: Re: Error building Trafodion
> > >
> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> > > So sorry for not clear before, you need CentOS 6.6 or older version.
> The
> > > problem is the GCC version. In the error message below, it seems the
> GCC
> > you
> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
> 4.8.
> > You
> > > have to use a lower version. GCC 4.4.7 is what I am using without
> issue,
> > and my
> > > workstation is CentOS 6.6.
> > >
> > > It should be possible to install GCC 4.4 on newer CentOS versions, but
> > maybe
> > > need to change some C/C++ rumtime lib as well. You may need to build
> the
> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
> > will try it
> > > asap.
> > >
> > > Thanks,
> > > Ming
> > >
> > > -----邮件原件-----
> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > > 发送时间: 2016年2月27日 13:14
> > > 收件人: dev@trafodion.incubator.apache.org
> > > 抄送: Steve Varnau <st...@esgyn.com>
> > > 主题: Re: Error building Trafodion
> > >
> > > Update:
> > >
> > > Started with CentOS 6.7 (Final) but ran into a different issue in the
> > same
> > > module (undefined reference to certain functions) - log excerpt below:
> > >
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
> > false,
> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char>
> >*>(std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::operator=(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > > >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> > > ##(Security)
> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> > > /home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> reference
> > to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > /home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> reference
> > to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > collect2: ld returned 1 exit status ##(Security)
> > >
> > > Any ideas?
> > >
> > > Nitin
> > >
> > > ________________________________________
> > > From: Nitin Lamba <ni...@ampool.io>
> > > Sent: Friday, February 26, 2016 7:37 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: Re: Error building Trafodion
> > >
> > > Thanks Ming! Will try with CentOS 6.
> > >
> > > Nitin
> > >
> > > ________________________________________
> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > > Sent: Friday, February 26, 2016 7:32 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: 答复: Error building Trafodion
> > >
> > > Hi, Nitin,
> > >
> > > I run into same error last week when I tried to use CentOS 7 as my
> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> > > incompatible.
> > > For this particular issue, I modified the Makefile under
> > > incubator-trafodion/core/dbsecurity/auth/Makefile
> > > to add '-llber' into LINK_OPTIONS
> > > And pass this error.
> > > I have no idea why current building workstation not meet this link
> > error, I have
> > > no theory here :-) I have another CentOS 6.5 workstation, same
> codebase,
> > but
> > > not meet this build error. It is still a mystery for me. Need time to
> > investigate
> > > more.
> > >
> > > But if I you are using GCC 4.8, the building will meet few more errors
> > after
> > > solving this issue. I fixed a few, but still some more are there, and
> > not able to
> > > proceed too much up to now. So I think if you are using gcc 4.8,
> please
> > consider
> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
> > >
> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> > development
> > > workstation will save you a lot of time, it is well tested.
> > >
> > > Thanks,
> > > Ming
> > >
> > > -----邮件原件-----
> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > > 发送时间: 2016年2月27日 11:00
> > > 收件人: dev@trafodion.incubator.apache.org
> > > 抄送: Steve Varnau <st...@esgyn.com>
> > > 主题: Error building Trafodion
> > >
> > > Hi,
> > >
> > >
> > > I tried to build Trafodion by following the instructions on the wiki
> > [1], [2] using
> > > 'make all'. However, I ran into an error compiling 'auth' within
> > dbsecurity - log
> > > excerpt below:
> > >
> > >
> > > [... SNIPPET ...]
> > >
> > > cd auth; make ##(Security)
> > >
> > > make[3]: Entering directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >
> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> > > DNA_64BIT -o /home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
> > -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> > > ../../sql/common -L/home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> > Linux-
> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> > ##(Security)
> > >
> > > /usr/bin/ld:
> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> > > undefined reference to symbol 'ber_set_option' ##(Security)
> > >
> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> > /lib64/liblber-2.4.so.2 so
> > > try adding it to the linker command line ##(Security)
> > >
> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> > ##(Security)
> > >
> > > collect2: error: ld returned 1 exit status ##(Security)
> > >
> > > make[3]: *** [/home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> > >
> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >
> > > make[2]: *** [auth] Error 2 ##(Security)
> > >
> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity' ##(Security)
> > >
> > > make[1]: *** [dbsecurity] Error 2
> > >
> > >
> > > Any ideas what I could be doing wrong?
> > >
> > >
> > > Thanks,
> > >
> > > Nitin
> > >
> > >
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > > ment
> > >
> > > [2] https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
>
--
Thanks,
Gunnar
*If you think you can you can, if you think you can't you're right.*
RE: Error building Trafodion
Posted by Steve Varnau <st...@esgyn.com>.
Hi Nitin,
I thought I’d give a go on an 8GB machine. I spun up a VM, 8GB memory,
2cpu, no swap space.
$ ulimit -s
10240
Trafodion built fine for me, no problems. Did you check dmesg to see if
there were any kernel messages?
--Steve
*From:* Hans Zeller [mailto:hans.zeller@esgyn.com]
*Sent:* Thursday, March 3, 2016 11:21 AM
*To:* dev <de...@trafodion.incubator.apache.org>
*Cc:* Steve Varnau <st...@esgyn.com>
*Subject:* Re: Error building Trafodion
Hi Nitin, if you want to have an environment where the build is likely to
succeed, you can try this Amazon AMI:
https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
This has a full Trafodion source tree installed, you can make code changes,
build and debug.
Hans
On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
Thanks Steve,
Update #5: Still no luck.
Tried to do a clean setup and build but g++ failed at a different step now:
-----------------------------------------------------------------
/usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
-fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
-DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror
-DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
-DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
-DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET
-D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
-DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
-DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
-DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
-DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
-I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
-I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
-I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
-I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
-I/usr/include
-I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
-I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
-I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
-I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
-I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
-I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
-I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
-I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
-I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
-I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
-I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
-I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
-I../porting_layer -include
"/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
-I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
-I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
-I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
-I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
-I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
-Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
-Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
Please submit a full bug report. ##(SQL)
See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
##(SQL)
make[4]: *** Waiting for unfinished jobs.... ##(SQL)
-----------------------------------------------------------------
The process hung for me. A quick web search on 'g++ segmentation fault' [1]
suggests that maybe the stack size is limited. So I increased the limit
'ulimit -s 65532' with the same result. I then removed the limit completely
'ulimit -s unlimited' without any change in outcome. It seems I'm running
into hardware or environment limitations. Does anyone know the minimum spec
for the dev machine? I have an 8 GB VM that I'm running this on.
Not sure what else I can do at this point - running out of ideas and
patience. Will keep trying to build trafodion in my free time...
Nitin
[1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
________________________________________
From: Steve Varnau <st...@esgyn.com>
Sent: Sunday, February 28, 2016 8:54 AM
To: Nitin Lamba; dev@trafodion.incubator.apache.org
Subject: RE: Error building Trafodion
I have seen this gcc internal error message before. It ended up to be
nothing in the code, but rather the OS decided the process was taking too
much memory and killed it. In my case, cgroups was misconfigured to limit
the user to 10% of memory. The dmesg command or /var/log messages showed
that the OS was doing it.
--Steve
> -----Original Message-----
> From: Nitin Lamba [mailto:nitin@ampool.io]
> Sent: Sunday, February 28, 2016 8:06 AM
> To: Steve Varnau <st...@esgyn.com>;
> dev@trafodion.incubator.apache.org
> Subject: Re: Error building Trafodion
>
> Thanks Steve. Glad that my buggy build journey is helping uncover new
issues.
>
> Update #4: Build is blocked for me - details below:
>
> Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
setup
> (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
the script
> uses '-without-qt' option anyway.
>
> So I installed qt-devel package AFTER the tools setup and re-ran 'make
all'.
> Now, the build fails on a different step - log excerpt below:
>
> -----------------------------------------------------------
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
> fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
-Wno-
> unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> -I../bin -I../executor -I../runtimestats -I../porting_layer
-I../qmscommon -
> I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
-I/usr/include -
> I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
> I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
> openjdk.x86_64/include
-I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
-I../sqlmsg -
> I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
-I../exp -
> I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
-I../arkfsindp2
> -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
-I../sqlshare -
> I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
-I../security -
> I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
-
> I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
> I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> MT,executor/linux/64bit/debug/stubs2.o -c -o
> executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> g++: Internal error: Killed (program cc1plus) ##(SQL)
> Please submit a full bug report. ##(SQL)
> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> make[4]: Leaving directory `/home/nitinlamba/incubator-
> trafodion/core/sql/nskgmake' ##(SQL)
> make[3]: *** [all] Error 2 ##(SQL)
> make[3]: Leaving directory `/home/nitinlamba/incubator-
> trafodion/core/sqf/sql' ##(SQL)
> make[2]: *** [make_sql] Error 2
> make[2]: Leaving directory
`/home/nitinlamba/incubator-trafodion/core/sqf'
> make[1]: *** [foundation] Error 2
> make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> make: *** [all] Error 2
> -----------------------------------------------------------
>
> No idea why g++ doesn't like this. Any ideas?
>
> Nitin
> [1]
http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> 0-on-centos6-4
>
> ________________________________________
> From: Steve Varnau <st...@esgyn.com>
> Sent: Saturday, February 27, 2016 12:08 PM
> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> Subject: RE: Error building Trafodion
>
> The qt-devel package should be optional, just as the QT_TOOLKIT variable
> need not be pointing to anything. It is for a an optional query-debugger
> tool. I'd say that is a makefile bug that tries to call qmake
> unconditionally.
>
> Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> 4.8). That seems like a bug as well.
>
> --Steve
>
>
> > -----Original Message-----
> > From: Nitin Lamba [mailto:nitin@ampool.io]
> > Sent: Saturday, February 27, 2016 8:37 AM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau <st...@esgyn.com>
> > Subject: Re: Error building Trafodion
> >
> > Update #3:
> >
> > Tried with CentOS 6.6; gcc seems to be the correct version:
> > $ gcc --version
> > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> >
> > 'make all' moved further but failed due to 'qmake' not available - log
> excerpt
> > below:
> >
> > -----------------------------------------------------------------
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
-
> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-
> > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> > clitest/linux/64bit/debug/blobtest.o
> clitest/linux/64bit/debug/vers_libclitest.o
> > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> -llog4cxx
> > ##(SQL)
> > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> > cp -f $PWD/libSqlCompilerDebugger.so
> > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> > ./mk.sh: line 28: qmake: command not found ##(SQL)
> > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
> make
> > rule. ##(SQL)
> > make[5]: *** No targets specified and no makefile found.
> Stop. ##(SQL)
> > cp: cannot stat `/home/nitinlamba/incubator-
> > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
> such
> > file or directory ##(SQL)
> > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> >
> > -----------------------------------------------------------------
> > A quick check on the web suggests that package 'qt-devel' should be
> installed -
> > this is missing from the wiki page as a dependency [1].
> >
> > Frankly, this is too much of a trial and error for a new developer to
> get started.
> > The instructions should be updated for all of these gotchas (CentOS 6.
X,
> gcc,
> > qmake, ...).
> >
> > I'll keep digging...
> > Nitin
> > [1]
> >
>
https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > ment
> >
> > ________________________________________
> > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > Sent: Friday, February 26, 2016 9:27 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: Re: Error building Trafodion
> >
> > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> > So sorry for not clear before, you need CentOS 6.6 or older version.
The
> > problem is the GCC version. In the error message below, it seems the
GCC
> you
> > are using is 4.8.2, some Trafodion modules not compatible with GCC
4.8.
> You
> > have to use a lower version. GCC 4.4.7 is what I am using without
issue,
> and my
> > workstation is CentOS 6.6.
> >
> > It should be possible to install GCC 4.4 on newer CentOS versions, but
> maybe
> > need to change some C/C++ rumtime lib as well. You may need to build
the
> > toolchain from gcc source code in order to get a complete gcc 4.4. I
> will try it
> > asap.
> >
> > Thanks,
> > Ming
> >
> > -----邮件原件-----
> > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > 发送时间: 2016年2月27日 13:14
> > 收件人: dev@trafodion.incubator.apache.org
> > 抄送: Steve Varnau <st...@esgyn.com>
> > 主题: Re: Error building Trafodion
> >
> > Update:
> >
> > Started with CentOS 6.7 (Final) but ran into a different issue in the
> same
> > module (undefined reference to certain functions) - log excerpt below:
> >
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> `std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
> false,
> > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char>
>*>(std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*,
std::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::operator=(std::basic_string<char, std::char_traits<char>,
> std::allocator<char>
> > >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> > ##(Security)
> > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > Linux-x86_64/64/dbg/ldapcheck.o: In function
> > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> > /home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
reference
> to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > /home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
reference
> to
> > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >&&)' ##(Security)
> > collect2: ld returned 1 exit status ##(Security)
> >
> > Any ideas?
> >
> > Nitin
> >
> > ________________________________________
> > From: Nitin Lamba <ni...@ampool.io>
> > Sent: Friday, February 26, 2016 7:37 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: Re: Error building Trafodion
> >
> > Thanks Ming! Will try with CentOS 6.
> >
> > Nitin
> >
> > ________________________________________
> > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > Sent: Friday, February 26, 2016 7:32 PM
> > To: dev@trafodion.incubator.apache.org
> > Cc: Steve Varnau
> > Subject: 答复: Error building Trafodion
> >
> > Hi, Nitin,
> >
> > I run into same error last week when I tried to use CentOS 7 as my
> > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> > incompatible.
> > For this particular issue, I modified the Makefile under
> > incubator-trafodion/core/dbsecurity/auth/Makefile
> > to add '-llber' into LINK_OPTIONS
> > And pass this error.
> > I have no idea why current building workstation not meet this link
> error, I have
> > no theory here :-) I have another CentOS 6.5 workstation, same
codebase,
> but
> > not meet this build error. It is still a mystery for me. Need time to
> investigate
> > more.
> >
> > But if I you are using GCC 4.8, the building will meet few more errors
> after
> > solving this issue. I fixed a few, but still some more are there, and
> not able to
> > proceed too much up to now. So I think if you are using gcc 4.8,
please
> consider
> > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
> >
> > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> development
> > workstation will save you a lot of time, it is well tested.
> >
> > Thanks,
> > Ming
> >
> > -----邮件原件-----
> > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > 发送时间: 2016年2月27日 11:00
> > 收件人: dev@trafodion.incubator.apache.org
> > 抄送: Steve Varnau <st...@esgyn.com>
> > 主题: Error building Trafodion
> >
> > Hi,
> >
> >
> > I tried to build Trafodion by following the instructions on the wiki
> [1], [2] using
> > 'make all'. However, I ran into an error compiling 'auth' within
> dbsecurity - log
> > excerpt below:
> >
> >
> > [... SNIPPET ...]
> >
> > cd auth; make ##(Security)
> >
> > make[3]: Entering directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth' ##(Security)
> >
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> > DNA_64BIT -o /home/nitinlamba/incubator-
> > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
> -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
> > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> > ../../sql/common -L/home/nitinlamba/incubator-
> > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> Linux-
> > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> ##(Security)
> >
> > /usr/bin/ld:
> /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> > undefined reference to symbol 'ber_set_option' ##(Security)
> >
> > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> /lib64/liblber-2.4.so.2 so
> > try adding it to the linker command line ##(Security)
> >
> > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> ##(Security)
> >
> > collect2: error: ld returned 1 exit status ##(Security)
> >
> > make[3]: *** [/home/nitinlamba/incubator-
> > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> >
> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity/auth' ##(Security)
> >
> > make[2]: *** [auth] Error 2 ##(Security)
> >
> > make[2]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/dbsecurity' ##(Security)
> >
> > make[1]: *** [dbsecurity] Error 2
> >
> >
> > Any ideas what I could be doing wrong?
> >
> >
> > Thanks,
> >
> > Nitin
> >
> >
> > [1]
> >
>
https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > ment
> >
> > [2] https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
Re: Error building Trafodion
Posted by Hans Zeller <ha...@esgyn.com>.
Hi Nitin, if you want to have an environment where the build is likely to
succeed, you can try this Amazon AMI:
https://aws.amazon.com/marketplace/pp/B018RBMFG0/ref=srh_res_product_title?ie=UTF8&sr=0-3&qid=1457026427523
This has a full Trafodion source tree installed, you can make code changes,
build and debug.
Hans
On Thu, Mar 3, 2016 at 11:02 AM, Nitin Lamba <ni...@ampool.io> wrote:
> Thanks Steve,
>
> Update #5: Still no luck.
>
> Tried to do a clean setup and build but g++ failed at a different step now:
>
> -----------------------------------------------------------------
>
> /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb
> -DNA_DEBUG_GUI -fPIC -Wno-unknown-pragmas -Wreturn-type -Wformat -Werror
> -DNA_LINUX -DSQ_LINUX -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD
> -DARKFS_GENERATOR -D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT
> -DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -D_TNS_R_TARGET
> -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -D_WIN32_WINNT=0x402
> -DNA_ITOA_NOT_SUPPORTED -DMPI_ -DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H
> -DNA_CMPDLL -DSQ_CPP_INTF -DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS
> -DNA_64BIT -D_DEBUG -DTRAF_SOFTWARE_VERS_MAJOR=2
> -DTRAF_SOFTWARE_VERS_MINOR=0 -DTRAF_SOFTWARE_VERS_UPDATE=0
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I../sqlcomp -I/home/nitinlamba/incubator-trafodion/core/sqf/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include
> -I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include
> -I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include/log4cxx
> -I/usr/include -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux -I../sqlci
> -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export -I../sqlmsg
> -I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator -I../exp
> -I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2 -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio
> -I../ustat -I../sqlshare -I../sqlmxevents -I../bin -I../langman -I../sqludr
> -I../udrserv -I../security -I../runtimestats -I../qmscommon -I../qms
> -I../porting_layer -include
> "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h"
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include
> -I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include
> -I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc
> -I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger
> -Wp,-MD,sqlcomp/linux/64bit/debug/depend/d_CmpSeabaseDDLcleanup.dep
> -Wp,-MT,sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o -c -o
> sqlcomp/linux/64bit/debug/CmpSeabaseDDLcleanup.o
> ../sqlcomp/CmpSeabaseDDLcleanup.cpp ##(SQL)
> g++: Internal error: Segmentation fault (program cc1plus) ##(SQL)
> Please submit a full bug report. ##(SQL)
> See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> make[4]: *** [sqlcomp/linux/64bit/debug/CmpSeabaseDDLauth.o] Error 1
> ##(SQL)
> make[4]: *** Waiting for unfinished jobs.... ##(SQL)
>
> -----------------------------------------------------------------
>
> The process hung for me. A quick web search on 'g++ segmentation fault'
> [1] suggests that maybe the stack size is limited. So I increased the limit
> 'ulimit -s 65532' with the same result. I then removed the limit completely
> 'ulimit -s unlimited' without any change in outcome. It seems I'm running
> into hardware or environment limitations. Does anyone know the minimum spec
> for the dev machine? I have an 8 GB VM that I'm running this on.
>
> Not sure what else I can do at this point - running out of ideas and
> patience. Will keep trying to build trafodion in my free time...
>
> Nitin
> [1] https://gcc.gnu.org/bugzilla/show_bug.cgi?id=49351
>
> ________________________________________
> From: Steve Varnau <st...@esgyn.com>
> Sent: Sunday, February 28, 2016 8:54 AM
> To: Nitin Lamba; dev@trafodion.incubator.apache.org
> Subject: RE: Error building Trafodion
>
> I have seen this gcc internal error message before. It ended up to be
> nothing in the code, but rather the OS decided the process was taking too
> much memory and killed it. In my case, cgroups was misconfigured to limit
> the user to 10% of memory. The dmesg command or /var/log messages showed
> that the OS was doing it.
>
> --Steve
>
>
> > -----Original Message-----
> > From: Nitin Lamba [mailto:nitin@ampool.io]
> > Sent: Sunday, February 28, 2016 8:06 AM
> > To: Steve Varnau <st...@esgyn.com>;
> > dev@trafodion.incubator.apache.org
> > Subject: Re: Error building Trafodion
> >
> > Thanks Steve. Glad that my buggy build journey is helping uncover new
> issues.
> >
> > Update #4: Build is blocked for me - details below:
> >
> > Tried to install qt-devel but it failed to build thrift-0.9.0 in tools
> setup
> > (traf_tools_setup.sh). It seems this is a known issue [1] and besides,
> the script
> > uses '-without-qt' option anyway.
> >
> > So I installed qt-devel package AFTER the tools setup and re-ran 'make
> all'.
> > Now, the build fails on a different step - log excerpt below:
> >
> > -----------------------------------------------------------
> > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x -
> > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> -Wno-
> > unknown-pragmas -Wreturn-type -Wformat -Werror -DNA_LINUX -DSQ_LINUX
> > -DNGG -D_M_DG -D_NSKFS_ -D_FULL_BUILD -DARKFS_GENERATOR -
> > D_DP2NT_ -D_LITTLE_ENDIAN_ -DARG_PRESENT_OMIT -
> > DNSK_USE_MSGSYS_SHELLS -D_REENTRANT -D_GLIBCXX_DEPRECATED -
> > D_TNS_R_TARGET -D_MSC_VER -D_X86_ -DWIN32_LEAN_AND_MEAN -
> > D_WIN32_WINNT=0x402 -DNA_ITOA_NOT_SUPPORTED -DMPI_ -
> > DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -DNA_CMPDLL -DSQ_CPP_INTF -
> > DSQ_NEW_PHANDLE -DUSE_NEW_PHANDLE -DSP_DIS -DNA_64BIT -D_DEBUG
> > -I../bin -I../executor -I../runtimestats -I../porting_layer
> -I../qmscommon -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/inc -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/export/include
> -I/usr/include -
> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include -
> > I/home/nitinlamba/trafodion-build-tools/thrift-0.9.0/include/thrift -
> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-0.10.0/include -
> > I/home/nitinlamba/trafodion-build-tools/apache-log4cxx-
> > 0.10.0/include/log4cxx -I/usr/include -I/usr/lib/jvm/java-1.7.0-
> > openjdk.x86_64/include
> -I/usr/lib/jvm/java-1.7.0-openjdk.x86_64/include/linux
> > -I../sqlci -I../arkcmp -I../comexe -I../sqlfe -I../eh -I../export
> -I../sqlmsg -
> > I../sqlcomp -I../sqlcat -I../executor -I../parser -I../generator
> -I../exp -
> > I../filesystem -I../optimizer -I../cli -I../nskcre -I../common -I../dml
> -I../arkfsindp2
> > -I../arkfsinopen -I../ddl -I../sort -I../catman -I../smdio -I../ustat
> -I../sqlshare -
> > I../sqlmxevents -I../bin -I../langman -I../sqludr -I../udrserv
> -I../security -
> > I../runtimestats -I../qmscommon -I../qms -I../porting_layer -include
> > "/home/nitinlamba/incubator-trafodion/core/sqf/inc/seaquest/sqtypes.h" -
> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include -
> > I/home/nitinlamba/trafodion-build-tools/dest-llvm-3.2/debug/include/llvm
> -
> > I/home/nitinlamba/trafodion-build-tools/udis86-1.7.2/include -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/../dbsecurity/auth/inc -
> > I/home/nitinlamba/incubator-trafodion/core/sqf/commonLogger -Wp,-
> > MD,executor/linux/64bit/debug/depend/d_stubs2.dep -Wp,-
> > MT,executor/linux/64bit/debug/stubs2.o -c -o
> > executor/linux/64bit/debug/stubs2.o ../executor/stubs2.cpp ##(SQL)
> > g++: Internal error: Killed (program cc1plus) ##(SQL)
> > Please submit a full bug report. ##(SQL)
> > See <http://bugzilla.redhat.com/bugzilla> for instructions. ##(SQL)
> > make[4]: *** [executor/linux/64bit/debug/stubs.o] Error 1 ##(SQL)
> > make[4]: *** Waiting for unfinished jobs.... ##(SQL)
> > make[4]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/sql/nskgmake' ##(SQL)
> > make[3]: *** [all] Error 2 ##(SQL)
> > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > trafodion/core/sqf/sql' ##(SQL)
> > make[2]: *** [make_sql] Error 2
> > make[2]: Leaving directory
> `/home/nitinlamba/incubator-trafodion/core/sqf'
> > make[1]: *** [foundation] Error 2
> > make[1]: Leaving directory `/home/nitinlamba/incubator-trafodion/core'
> > make: *** [all] Error 2
> > -----------------------------------------------------------
> >
> > No idea why g++ doesn't like this. Any ideas?
> >
> > Nitin
> > [1]
> http://stackoverflow.com/questions/18218848/unable-to-compile-thrift-0-9-
> > 0-on-centos6-4
> >
> > ________________________________________
> > From: Steve Varnau <st...@esgyn.com>
> > Sent: Saturday, February 27, 2016 12:08 PM
> > To: Nitin Lamba; dev@trafodion.incubator.apache.org
> > Subject: RE: Error building Trafodion
> >
> > The qt-devel package should be optional, just as the QT_TOOLKIT variable
> > need not be pointing to anything. It is for a an optional query-debugger
> > tool. I'd say that is a makefile bug that tries to call qmake
> > unconditionally.
> >
> > Likewise, it is news to me that build does not work on Centos 6.7 (gcc
> > 4.8). That seems like a bug as well.
> >
> > --Steve
> >
> >
> > > -----Original Message-----
> > > From: Nitin Lamba [mailto:nitin@ampool.io]
> > > Sent: Saturday, February 27, 2016 8:37 AM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau <st...@esgyn.com>
> > > Subject: Re: Error building Trafodion
> > >
> > > Update #3:
> > >
> > > Tried with CentOS 6.6; gcc seems to be the correct version:
> > > $ gcc --version
> > > gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-16)
> > >
> > > 'make all' moved further but failed due to 'qmake' not available - log
> > excerpt
> > > below:
> > >
> > > -----------------------------------------------------------------
> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -m64 -O0 -fshort-wchar -std=c++0x
> -
> > > fcheck-new -fno-strict-aliasing -msse2 -mfpmath=sse -g3 -ggdb -fPIC
> > -Wno-
> > > unknown-pragmas -Wreturn-type -Wformat -Werror -shared -o
> > > ../lib/linux/64bit/debug/libclitest.so -L../lib/linux/64bit/debug -
> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d -
> > > L/home/nitinlamba/incubator-trafodion/core/sqf/export/lib64d
> > > clitest/linux/64bit/debug/blobtest.o
> > clitest/linux/64bit/debug/vers_libclitest.o
> > > clitest/linux/64bit/debug/mpisetup.o -L /usr/lib/jvm/java-1.7.0-
> > > openjdk.x86_64/jre/lib/amd64/server -ljvm -lhdfs -lthrift -lcurl
> > -llog4cxx
> > > ##(SQL)
> > > cd ../SqlCompilerDebugger && . ./mk.sh; \ ##(SQL)
> > > cp -f $PWD/libSqlCompilerDebugger.so
> > > ../lib/linux/64bit/debug/libSqlCompilerDebugger.so; ##(SQL)
> > > ./mk.sh: line 28: qmake: command not found ##(SQL)
> > > make[5]: warning: jobserver unavailable: using -j1. Add `+' to parent
> > make
> > > rule. ##(SQL)
> > > make[5]: *** No targets specified and no makefile found.
> > Stop. ##(SQL)
> > > cp: cannot stat `/home/nitinlamba/incubator-
> > > trafodion/core/sql/SqlCompilerDebugger/libSqlCompilerDebugger.so': No
> > such
> > > file or directory ##(SQL)
> > > make[4]: *** [cmpdbg_qt_build] Error 1 ##(SQL)
> > >
> > > -----------------------------------------------------------------
> > > A quick check on the web suggests that package 'qt-devel' should be
> > installed -
> > > this is missing from the wiki page as a dependency [1].
> > >
> > > Frankly, this is too much of a trial and error for a new developer to
> > get started.
> > > The instructions should be updated for all of these gotchas (CentOS 6.
> X,
> > gcc,
> > > qmake, ...).
> > >
> > > I'll keep digging...
> > > Nitin
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > > ment
> > >
> > > ________________________________________
> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > > Sent: Friday, February 26, 2016 9:27 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: Re: Error building Trafodion
> > >
> > > I tried CentOS 6.4 , 6.5 and 6.6 before, just not 6.7...
> > > So sorry for not clear before, you need CentOS 6.6 or older version.
> The
> > > problem is the GCC version. In the error message below, it seems the
> GCC
> > you
> > > are using is 4.8.2, some Trafodion modules not compatible with GCC
> 4.8.
> > You
> > > have to use a lower version. GCC 4.4.7 is what I am using without
> issue,
> > and my
> > > workstation is CentOS 6.6.
> > >
> > > It should be possible to install GCC 4.4 on newer CentOS versions, but
> > maybe
> > > need to change some C/C++ rumtime lib as well. You may need to build
> the
> > > toolchain from gcc source code in order to get a complete gcc 4.4. I
> > will try it
> > > asap.
> > >
> > > Thanks,
> > > Ming
> > >
> > > -----邮件原件-----
> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > > 发送时间: 2016年2月27日 13:14
> > > 收件人: dev@trafodion.incubator.apache.org
> > > 抄送: Steve Varnau <st...@esgyn.com>
> > > 主题: Re: Error building Trafodion
> > >
> > > Update:
> > >
> > > Started with CentOS 6.7 (Final) but ran into a different issue in the
> > same
> > > module (undefined reference to certain functions) - log excerpt below:
> > >
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > `std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >* std::__copy_move<true,
> > false,
> > > std::random_access_iterator_tag>::__copy_m<std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char>
> >*>(std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*,
> std::basic_string<char,
> > > std::char_traits<char>, std::allocator<char> >*)': ##(Security)
> > > /usr/include/c++/4.8.2/bits/stl_algobase.h:354: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::operator=(std::basic_string<char, std::char_traits<char>,
> > std::allocator<char>
> > > >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > > `_ZN9__gnu_cxx13new_allocatorISsE9constructISsJSsEEEvPT_DpOT0_':
> > > ##(Security)
> > > /usr/include/c++/4.8.2/ext/new_allocator.h:120: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapconfignode.o: In function
> > > `_ZSt10_ConstructISsJSsEEvPT_DpOT0_': ##(Security)
> > > /usr/include/c++/4.8.2/bits/stl_construct.h:75: undefined reference to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > Linux-x86_64/64/dbg/ldapcheck.o: In function
> > > `AuthEvents::AuthEvents(AuthEvents&&)': ##(Security)
> > > /home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> reference
> > to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > /home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth/src/ldapcheck.cpp:50: undefined
> reference
> > to
> > > `std::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > >::basic_string(std::basic_string<char, std::char_traits<char>,
> > > std::allocator<char> >&&)' ##(Security)
> > > collect2: ld returned 1 exit status ##(Security)
> > >
> > > Any ideas?
> > >
> > > Nitin
> > >
> > > ________________________________________
> > > From: Nitin Lamba <ni...@ampool.io>
> > > Sent: Friday, February 26, 2016 7:37 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: Re: Error building Trafodion
> > >
> > > Thanks Ming! Will try with CentOS 6.
> > >
> > > Nitin
> > >
> > > ________________________________________
> > > From: Liu, Ming (Ming) <mi...@esgyn.cn>
> > > Sent: Friday, February 26, 2016 7:32 PM
> > > To: dev@trafodion.incubator.apache.org
> > > Cc: Steve Varnau
> > > Subject: 答复: Error building Trafodion
> > >
> > > Hi, Nitin,
> > >
> > > I run into same error last week when I tried to use CentOS 7 as my
> > > Development machine. The default GCC on CentOS 7 is GCC4.8, it seems
> > > incompatible.
> > > For this particular issue, I modified the Makefile under
> > > incubator-trafodion/core/dbsecurity/auth/Makefile
> > > to add '-llber' into LINK_OPTIONS
> > > And pass this error.
> > > I have no idea why current building workstation not meet this link
> > error, I have
> > > no theory here :-) I have another CentOS 6.5 workstation, same
> codebase,
> > but
> > > not meet this build error. It is still a mystery for me. Need time to
> > investigate
> > > more.
> > >
> > > But if I you are using GCC 4.8, the building will meet few more errors
> > after
> > > solving this issue. I fixed a few, but still some more are there, and
> > not able to
> > > proceed too much up to now. So I think if you are using gcc 4.8,
> please
> > consider
> > > to use an older version. CentOS 6.5 ship with GCC 4.4, which is fine.
> > >
> > > In sum, if you are not using CentOS 6, please use CentOS 6.x as
> > development
> > > workstation will save you a lot of time, it is well tested.
> > >
> > > Thanks,
> > > Ming
> > >
> > > -----邮件原件-----
> > > 发件人: Nitin Lamba [mailto:nitin@ampool.io]
> > > 发送时间: 2016年2月27日 11:00
> > > 收件人: dev@trafodion.incubator.apache.org
> > > 抄送: Steve Varnau <st...@esgyn.com>
> > > 主题: Error building Trafodion
> > >
> > > Hi,
> > >
> > >
> > > I tried to build Trafodion by following the instructions on the wiki
> > [1], [2] using
> > > 'make all'. However, I ran into an error compiling 'auth' within
> > dbsecurity - log
> > > excerpt below:
> > >
> > >
> > > [... SNIPPET ...]
> > >
> > > cd auth; make ##(Security)
> > >
> > > make[3]: Entering directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >
> > > /usr/bin/g++ -DSQ_PHANDLE_VERIFIER -fPIC -g -m64 -DNA_LINUX -
> > > DNA_64BIT -o /home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/bin64/ldapcheck -I. -I./inc -I ../shared/inc
> > -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/cli -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/common -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/executor -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/export -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/../sql/porting_layer -I
> > > /home/nitinlamba/incubator-trafodion/core/sqf/export/include -I
> > > ../../sql/common -L/home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/lib64 -lldap -lssl Linux-
> > > x86_64/64/rls/ldapconfignode.o Linux-x86_64/64/rls/versldapcheck.o
> > Linux-
> > > x86_64/64/rls/ldapcheck.o Linux-x86_64/64/rls/ldapconfigfile.o
> > ##(Security)
> > >
> > > /usr/bin/ld:
> > /usr/lib/gcc/x86_64-redhat-linux/4.8.5/../../../../lib64/libldap.so:
> > > undefined reference to symbol 'ber_set_option' ##(Security)
> > >
> > > /usr/bin/ld: note: 'ber_set_option' is defined in DSO
> > /lib64/liblber-2.4.so.2 so
> > > try adding it to the linker command line ##(Security)
> > >
> > > /lib64/liblber-2.4.so.2: could not read symbols: Invalid operation
> > ##(Security)
> > >
> > > collect2: error: ld returned 1 exit status ##(Security)
> > >
> > > make[3]: *** [/home/nitinlamba/incubator-
> > > trafodion/core/sqf/export/bin64/ldapcheck] Error 1 ##(Security)
> > >
> > > make[3]: Leaving directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity/auth' ##(Security)
> > >
> > > make[2]: *** [auth] Error 2 ##(Security)
> > >
> > > make[2]: Leaving directory `/home/nitinlamba/incubator-
> > > trafodion/core/dbsecurity' ##(Security)
> > >
> > > make[1]: *** [dbsecurity] Error 2
> > >
> > >
> > > Any ideas what I could be doing wrong?
> > >
> > >
> > > Thanks,
> > >
> > > Nitin
> > >
> > >
> > > [1]
> > >
> >
> https://cwiki.apache.org/confluence/display/TRAFODION/Create+Build+Environ
> > > ment
> > >
> > > [2] https://cwiki.apache.org/confluence/display/TRAFODION/Build+Source
>