You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Anatoli Fomenko <af...@yahoo.com> on 2012/11/19 00:17:11 UTC
Re: ? BIGTOP-280
Moving this thread to the bigtop-dev list, for the benefits of the community.
Anatoli
________________________________
From: Anatoli Fomenko <af...@yahoo.com>
To: James Page <ja...@ubuntu.com>
Sent: Sunday, November 18, 2012 9:44 AM
Subject: Re: ? BIGTOP-280
Hi James,
The problem seems to be the one that you mentioned, and exactly equal to the one initially described by Shridhar on Ubuntu 11.04. Here is the output:
[exec] config.status: executing libtool commands
[exec] make[1]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
[exec] make all-am
[exec] make[2]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
[exec] /bin/bash ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo
'/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c
[exec] libtool: compile: gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c -fPIC -DPIC -o .libs/ZlibCompressor.o
[exec] make[2]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
[exec] make[1]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs':
[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71:41: error: expected expression before ',' token
[exec] make[2]: *** [ZlibCompressor.lo] Error 1
[exec] make[1]: *** [all] Error 2
BUILD FAILED
/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build.xml:686: exec returned: 2
The flags in bigtop-packages/src/common/hadoop/do-component-build look like this:
LDFLAGS="-Wl,--no-as-needed $LIBRARIES" FUSE_HOME=`pwd`/build/c++/${HADOOP_ARCH} ant \
where LIBRARIES="-lcrypto -lm "
The flags seem to pass correctly, per config.log:
configure:2774: gcc -o conftest -DHADOOP_CONF_DIR=/etc/hadoop/conf -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed -lcrypto -lm -L/usr/l
ib/jvm/jdk1.6.0_37//jre/lib/amd64/server conftest.c >&5
But they seem to have no effect on the execution.
# uname -a
Linux ubuntu 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
Please let me know if you need more details.
Your help is very much appreciated.
Anatoli
________________________________
From: James Page <ja...@ubuntu.com>
To: Anatoli Fomenko <af...@yahoo.com>
Sent: Sunday, November 18, 2012 8:20 AM
Subject: Re: ? BIGTOP-280
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Hi Anatoli
On 18/11/12 07:22, Anatoli Fomenko wrote:
> I'm working with Cos on 0.3.1.
>
> As expected for Hadoop 1.1.0 (per the BOM) on Ubuntu 12.04.1
> 64-bit, I stepped on BIGTOP-280. I tried your BIGTOP-280.patch,
> and, while I remember it working somewhere else (perhaps, Ubuntu
> 12.04 32 bit), does not work on Ubuntu 12.04.1 64-bit.
>
> Any hints?
What problem are you hitting? From memory the original compilation
failure was during resolution of the so name for libz.
> For completeness: This issue is fixed in Hadoop 1.2.0, but we
> would not like to wait. Also, I can fall back to 10.04.4 or 10.10,
> where LDFLAGS="-Wl,--no-as-needed" is a default.
I'd prefer to push for 12.04; I'll extend help as required to get this
resolved.
Cheers
James
- --
James
Page
Ubuntu Core Developer
Debian Maintainer
james.page@ubuntu.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla -
http://www.enigmail.net/
iQIcBAEBCAAGBQJQqQrWAAoJEL/srsug59jDCVMP/3sM/xJ9B9nnoMswFTwOb02p
cMne1Z1075UNn+igtokgU8NesBWmKNgxPF8Vpq2VId3K68xnlFXp1wl02giUNdwl
VBhKRQGyStHcRbRZGBrxIrhmGYa9NQrtchZVXS7KXKUOQdac04uGpEIcj6inBeEh
6o3vBYX2HO1TKblPaDiev+FMj2aq1wChZb9AVcuRvd0jUZWDSlLtb0M8XAe78lsf
jhwEXXZnFjPyvTqVP4H5KLGhq4RvXFWVIYDmJcmhw/N84x0IFrAHPmTHcTm9cjMu
DAW7+dolSsBkinfy+kzHwPc5bBlTMqWFS1MY8GVsukrkePOKSLqEMlUYphXChdRL
kkg0zZTAVvCkIFvL6QhyGQ5q+Bq8v+a4Z8zxkWrhh/o03LH0Qyhh44BPWWSyrVp3
s70AaJUQ24LZZlVbpIGyy0JCfcywcq+kWfdwQQsYIiPU53WfGyYLKvfVXrxxS0MV
SAOJmv3hKZ4U6zIUyqLdn1BGPQjz0DdXN++DscE5nIuBnDiRI+OsJTUUuykz9i8V
iD9o6goZTkU2UWHtvRPTV/9MwhHI4zf/N70XugKLAjI+zWRaNFlE1tDpFQ0hAMl+
rT37+DDCkCUQW/c1z1xQiuh3oXz4XJ1sbFFf36rxKPXwkml3Bcmzb4wBIQWD+4tJ
OQnHr6VkJmxSZDz+Rwxz
=fzVI
-----END PGP SIGNATURE-----
Re: ? BIGTOP-280
Posted by Konstantin Boudnik <co...@apache.org>.
Thanks for bringing this up! That seems to be an issue that is blocking 0.3.1,
right?
Cos
On Sun, Nov 18, 2012 at 03:17PM, Anatoli Fomenko wrote:
> Moving this thread to the bigtop-dev list, for the benefits of the community.
> Anatoli
>
>
> ________________________________
> From: Anatoli Fomenko <af...@yahoo.com>
> To: James Page <ja...@ubuntu.com>
> Sent: Sunday, November 18, 2012 9:44 AM
> Subject: Re: ? BIGTOP-280
>
>
> Hi James,
>
> The problem seems to be the one that you mentioned, and exactly equal to the one initially described by Shridhar on Ubuntu 11.04. Here is the output:
>
> ═ ═ ═[exec] config.status: executing libtool commands
> ═ ═ ═[exec] make[1]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] make ═all-am
> ═ ═ ═[exec] make[2]: Entering directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] /bin/bash ./libtool ═--tag=CC ═ --mode=compile gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native ═-I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 ═-I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c -o ZlibCompressor.lo `test -f 'src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c' || echo
> '/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/'`src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c
> ═ ═ ═[exec] libtool: compile: ═gcc -DHAVE_CONFIG_H -I. -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -I/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src -Isrc/org/apache/hadoop/io/compress/zlib -Isrc/org/apache/hadoop/io/compress/snappy -Isrc/org/apache/hadoop/io/nativeio -Isrc/org/apache/hadoop/security -D_FORTIFY_SOURCE=2 -I/usr/lib/jvm/jdk1.6.0_37//include -I/usr/lib/jvm/jdk1.6.0_37//include/linux -g -Wall -fPIC -O2 -m64 -g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security -MT ZlibCompressor.lo -MD -MP -MF .deps/ZlibCompressor.Tpo -c /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c ═-fPIC -DPIC -o .libs/ZlibCompressor.o
> ═ ═ ═[exec] make[2]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] make[1]: Leaving directory `/home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build/native/Linux-amd64-64'
> ═ ═ ═[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c: In function 'Java_org_apache_hadoop_io_compress_zlib_ZlibCompressor_initIDs':
> ═ ═ ═[exec] /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/src/native/src/org/apache/hadoop/io/compress/zlib/ZlibCompressor.c:71:41: error: expected expression before ',' token
> ═ ═ ═[exec] make[2]: *** [ZlibCompressor.lo] Error 1
> ═ ═ ═[exec] make[1]: *** [all] Error 2
>
> BUILD FAILED
> /home/anatolifomenko/git/branch-0.3.1/bigtop/output/hadoop/hadoop-1.1.0/build.xml:686: exec returned: 2
>
> The flags in bigtop-packages/src/common/hadoop/do-component-build═ look like this:
> LDFLAGS="-Wl,--no-as-needed $LIBRARIES" FUSE_HOME=`pwd`/build/c++/${HADOOP_ARCH} ant \
>
> where═LIBRARIES="-lcrypto -lm "
>
> The flags seem to pass correctly, per config.log:
> configure:2774: gcc -o conftest -DHADOOP_CONF_DIR=/etc/hadoop/conf -D_FORTIFY_SOURCE=2 -Wl,--no-as-needed -lcrypto -lm ═-L/usr/l
> ib/jvm/jdk1.6.0_37//jre/lib/amd64/server conftest.c ═>&5
>
> But they seem to have no effect on the execution.
>
> #══uname -a
> Linux ubuntu 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
>
> Please let me know if you need more details.
>
> Your help is very much appreciated.
>
> Anatoli
>
>
> ________________________________
> From: James Page <ja...@ubuntu.com>
> To: Anatoli Fomenko <af...@yahoo.com>
> Sent: Sunday, November 18, 2012 8:20 AM
> Subject: Re: ? BIGTOP-280
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Hi Anatoli
>
> On 18/11/12 07:22, Anatoli Fomenko wrote:
> > I'm working with Cos on 0.3.1.
> >
> > As expected for Hadoop 1.1.0 (per the BOM) on Ubuntu 12.04.1
> > 64-bit, I stepped on BIGTOP-280. I tried your BIGTOP-280.patch,
> > and, while I remember it working somewhere else (perhaps, Ubuntu
> > 12.04 32 bit), does not work on Ubuntu 12.04.1 64-bit.
> >
> > Any hints?
>
> What problem are you hitting? From memory the original compilation
> failure was during resolution of the so name for libz.
>
> > For completeness:═ This issue is fixed in Hadoop 1.2.0, but we
> > would not like to wait. Also, I can fall back to 10.04.4 or 10.10,
> > where LDFLAGS="-Wl,--no-as-needed" is a default.
>
> I'd prefer to push for 12.04; I'll extend help as required to get this
> resolved.
>
> Cheers
>
> James
>
>
> - --
> James
> Page
> Ubuntu Core Developer
> Debian Maintainer
> james.page@ubuntu.com
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.11 (GNU/Linux)
> Comment: Using GnuPG with Mozilla -
> http://www.enigmail.net/
>
> iQIcBAEBCAAGBQJQqQrWAAoJEL/srsug59jDCVMP/3sM/xJ9B9nnoMswFTwOb02p
> cMne1Z1075UNn+igtokgU8NesBWmKNgxPF8Vpq2VId3K68xnlFXp1wl02giUNdwl
> VBhKRQGyStHcRbRZGBrxIrhmGYa9NQrtchZVXS7KXKUOQdac04uGpEIcj6inBeEh
> 6o3vBYX2HO1TKblPaDiev+FMj2aq1wChZb9AVcuRvd0jUZWDSlLtb0M8XAe78lsf
> jhwEXXZnFjPyvTqVP4H5KLGhq4RvXFWVIYDmJcmhw/N84x0IFrAHPmTHcTm9cjMu
> DAW7+dolSsBkinfy+kzHwPc5bBlTMqWFS1MY8GVsukrkePOKSLqEMlUYphXChdRL
> kkg0zZTAVvCkIFvL6QhyGQ5q+Bq8v+a4Z8zxkWrhh/o03LH0Qyhh44BPWWSyrVp3
> s70AaJUQ24LZZlVbpIGyy0JCfcywcq+kWfdwQQsYIiPU53WfGyYLKvfVXrxxS0MV
> SAOJmv3hKZ4U6zIUyqLdn1BGPQjz0DdXN++DscE5nIuBnDiRI+OsJTUUuykz9i8V
> iD9o6goZTkU2UWHtvRPTV/9MwhHI4zf/N70XugKLAjI+zWRaNFlE1tDpFQ0hAMl+
> rT37+DDCkCUQW/c1z1xQiuh3oXz4XJ1sbFFf36rxKPXwkml3Bcmzb4wBIQWD+4tJ
> OQnHr6VkJmxSZDz+Rwxz
> =fzVI
> -----END PGP SIGNATURE-----