You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Anatoli Fomenko <af...@yahoo.com> on 2012/11/19 00:17:11 UTC

Re: ? BIGTOP-280

Moving this thread to the bigtop-dev list, for the benefits of the community.
Anatoli


________________________________
 From: Anatoli Fomenko <af...@yahoo.com>
To: James Page <ja...@ubuntu.com> 
Sent: Sunday, November 18, 2012 9:44 AM
Subject: Re: ? BIGTOP-280
 

Hi James,

The problem seems to be the one that you mentioned, and exactly equal to the one initially described by Shridhar on Ubuntu 11.04. Here is the output:

     [exec] config.status: executing libtool commands
     [exec] make[1]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
     [exec] make  all-am
     [exec] make[2]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
     [exec] /bin/bash ./libtool  --tag=CC   --mode=compile gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native  -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2  -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo
 '/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c
     [exec] libtool: compile:  gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c  -fPIC -DPIC -o .libs/ZlibCompressor.o
     [exec] make[2]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
     [exec] make[1]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
     [exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs':
     [exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71:41: error: expected expression before ',' token
     [exec] make[2]: *** [ZlibCompressor.lo] Error 1
     [exec] make[1]: *** [all] Error 2

BUILD FAILED
/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build.xml:686: exec returned: 2

The flags in bigtop-packages/src/common/hadoop/do-component-build  look like this:
LDFLAGS="-Wl,--no-as-needed $LIBRARIES" FUSE_HOME=`pwd`/build/c++/${HADOOP_ARCH} ant \

where LIBRARIES="-lcrypto -lm "

The flags seem to pass correctly, per config.log:
configure:2774: gcc -o conftest -DHADOOP_CONF_DIR=/etc/hadoop/conf -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed -lcrypto -lm  -L/usr/l
ib/jvm/jdk1.6.0_37//jre/lib/amd64/server conftest.c  >&5

But they seem to have no effect on the execution.

#  uname -a
Linux ubuntu 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux

Please let me know if you need more details.

Your help is very much appreciated.

Anatoli


________________________________
 From: James Page <ja...@ubuntu.com>
To: Anatoli Fomenko <af...@yahoo.com> 
Sent: Sunday, November 18, 2012 8:20 AM
Subject: Re: ? BIGTOP-280
 
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hi Anatoli

On 18/11/12 07:22, Anatoli Fomenko wrote:
> I'm working with Cos on 0.3.1.
> 
> As expected for Hadoop 1.1.0 (per the BOM) on Ubuntu 12.04.1
> 64-bit, I stepped on BIGTOP-280. I tried your BIGTOP-280.patch,
> and, while I remember it working somewhere else (perhaps, Ubuntu
> 12.04 32 bit), does not work on Ubuntu 12.04.1 64-bit.
> 
> Any hints?

What problem are you hitting? From memory the original compilation
failure was during resolution of the so name for libz.

> For completeness:  This issue is fixed in Hadoop 1.2.0, but we
> would not like to wait. Also, I can fall back to 10.04.4 or 10.10,
> where LDFLAGS="-Wl,--no-as-needed" is a default.

I'd prefer to push for 12.04; I'll extend help as required to get this
resolved.

Cheers

James


- -- 
James
 Page
Ubuntu Core Developer
Debian Maintainer
james.page@ubuntu.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla -
 http://www.enigmail.net/

iQIcBAEBCAAGBQJQqQrWAAoJEL/srsug59jDCVMP/3sM/xJ9B9nnoMswFTwOb02p
cMne1Z1075UNn+igtokgU8NesBWmKNgxPF8Vpq2VId3K68xnlFXp1wl02giUNdwl
VBhKRQGyStHcRbRZGBrxIrhmGYa9NQrtchZVXS7KXKUOQdac04uGpEIcj6inBeEh
6o3vBYX2HO1TKblPaDiev+FMj2aq1wChZb9AVcuRvd0jUZWDSlLtb0M8XAe78lsf
jhwEXXZnFjPyvTqVP4H5KLGhq4RvXFWVIYDmJcmhw/N84x0IFrAHPmTHcTm9cjMu
DAW7+dolSsBkinfy+kzHwPc5bBlTMqWFS1MY8GVsukrkePOKSLqEMlUYphXChdRL
kkg0zZTAVvCkIFvL6QhyGQ5q+Bq8v+a4Z8zxkWrhh/o03LH0Qyhh44BPWWSyrVp3
s70AaJUQ24LZZlVbpIGyy0JCfcywcq+kWfdwQQsYIiPU53WfGyYLKvfVXrxxS0MV
SAOJmv3hKZ4U6zIUyqLdn1BGPQjz0DdXN++DscE5nIuBnDiRI+OsJTUUuykz9i8V
iD9o6goZTkU2UWHtvRPTV/9MwhHI4zf/N70XugKLAjI+zWRaNFlE1tDpFQ0hAMl+
rT37+DDCkCUQW/c1z1xQiuh3oXz4XJ1sbFFf36rxKPXwkml3Bcmzb4wBIQWD+4tJ
OQnHr6VkJmxSZDz+Rwxz
=fzVI
-----END PGP SIGNATURE-----

Re: ? BIGTOP-280

Posted by Konstantin Boudnik <co...@apache.org>.
Thanks for bringing this up! That seems to be an issue that is blocking 0.3.1,
right?

Cos

On Sun, Nov 18, 2012 at 03:17PM, Anatoli Fomenko wrote:
> Moving this thread to the bigtop-dev list, for the benefits of the community.
> Anatoli
> 
> 
> ________________________________
>  From: Anatoli Fomenko <af...@yahoo.com>
> To: James Page <ja...@ubuntu.com> 
> Sent: Sunday, November 18, 2012 9:44 AM
> Subject: Re: ? BIGTOP-280
>  
> 
> Hi James,
> 
> The problem seems to be the one that you mentioned, and exactly equal to the one initially described by Shridhar on Ubuntu 11.04. Here is the output:
> 
> ═ ═ ═[exec] config.status: executing libtool commands
> ═ ═ ═[exec] make[1]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] make ═all-am
> ═ ═ ═[exec] make[2]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] /bin/bash ./libtool ═--tag=CC ═ --mode=compile gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native ═-I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 ═-I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo
>  '/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c
> ═ ═ ═[exec] libtool: compile: ═gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c ═-fPIC -DPIC -o .libs/ZlibCompressor.o
> ═ ═ ═[exec] make[2]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] make[1]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs':
> ═ ═ ═[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71:41: error: expected expression before ',' token
> ═ ═ ═[exec] make[2]: *** [ZlibCompressor.lo] Error 1
> ═ ═ ═[exec] make[1]: *** [all] Error 2
> 
> BUILD FAILED
> /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build.xml:686: exec returned: 2
> 
> The flags in bigtop-packages/src/common/hadoop/do-component-build═ look like this:
> LDFLAGS="-Wl,--no-as-needed $LIBRARIES" FUSE_HOME=`pwd`/build/c++/${HADOOP_ARCH} ant \
> 
> where═LIBRARIES="-lcrypto -lm "
> 
> The flags seem to pass correctly, per config.log:
> configure:2774: gcc -o conftest -DHADOOP_CONF_DIR=/etc/hadoop/conf -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed -lcrypto -lm ═-L/usr/l
> ib/jvm/jdk1.6.0_37//jre/lib/amd64/server conftest.c ═>&5
> 
> But they seem to have no effect on the execution.
> 
> #══uname -a
> Linux ubuntu 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
> 
> Please let me know if you need more details.
> 
> Your help is very much appreciated.
> 
> Anatoli
> 
> 
> ________________________________
>  From: James Page <ja...@ubuntu.com>
> To: Anatoli Fomenko <af...@yahoo.com> 
> Sent: Sunday, November 18, 2012 8:20 AM
> Subject: Re: ? BIGTOP-280
>  
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
> 
> Hi Anatoli
> 
> On 18/11/12 07:22, Anatoli Fomenko wrote:
> > I'm working with Cos on 0.3.1.
> > 
> > As expected for Hadoop 1.1.0 (per the BOM) on Ubuntu 12.04.1
> > 64-bit, I stepped on BIGTOP-280. I tried your BIGTOP-280.patch,
> > and, while I remember it working somewhere else (perhaps, Ubuntu
> > 12.04 32 bit), does not work on Ubuntu 12.04.1 64-bit.
> > 
> > Any hints?
> 
> What problem are you hitting? From memory the original compilation
> failure was during resolution of the so name for libz.
> 
> > For completeness:═ This issue is fixed in Hadoop 1.2.0, but we
> > would not like to wait. Also, I can fall back to 10.04.4 or 10.10,
> > where LDFLAGS="-Wl,--no-as-needed" is a default.
> 
> I'd prefer to push for 12.04; I'll extend help as required to get this
> resolved.
> 
> Cheers
> 
> James
> 
> 
> - -- 
> James
>  Page
> Ubuntu Core Developer
> Debian Maintainer
> james.page@ubuntu.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.11 (GNU/Linux)
> Comment: Using GnuPG with Mozilla -
>  http://www.enigmail.net/
> 
> iQIcBAEBCAAGBQJQqQrWAAoJEL/srsug59jDCVMP/3sM/xJ9B9nnoMswFTwOb02p
> cMne1Z1075UNn+igtokgU8NesBWmKNgxPF8Vpq2VId3K68xnlFXp1wl02giUNdwl
> VBhKRQGyStHcRbRZGBrxIrhmGYa9NQrtchZVXS7KXKUOQdac04uGpEIcj6inBeEh
> 6o3vBYX2HO1TKblPaDiev+FMj2aq1wChZb9AVcuRvd0jUZWDSlLtb0M8XAe78lsf
> jhwEXXZnFjPyvTqVP4H5KLGhq4RvXFWVIYDmJcmhw/N84x0IFrAHPmTHcTm9cjMu
> DAW7+dolSsBkinfy+kzHwPc5bBlTMqWFS1MY8GVsukrkePOKSLqEMlUYphXChdRL
> kkg0zZTAVvCkIFvL6QhyGQ5q+Bq8v+a4Z8zxkWrhh/o03LH0Qyhh44BPWWSyrVp3
> s70AaJUQ24LZZlVbpIGyy0JCfcywcq+kWfdwQQsYIiPU53WfGyYLKvfVXrxxS0MV
> SAOJmv3hKZ4U6zIUyqLdn1BGPQjz0DdXN++DscE5nIuBnDiRI+OsJTUUuykz9i8V
> iD9o6goZTkU2UWHtvRPTV/9MwhHI4zf/N70XugKLAjI+zWRaNFlE1tDpFQ0hAMl+
> rT37+DDCkCUQW/c1z1xQiuh3oXz4XJ1sbFFf36rxKPXwkml3Bcmzb4wBIQWD+4tJ
> OQnHr6VkJmxSZDz+Rwxz
> =fzVI
> -----END PGP SIGNATURE-----