You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Tucker Berckmann <tu...@scaleflux.com> on 2015/08/18 02:26:38 UTC
Unable to pass complete tests on 2.7.1
Hello,
I am trying to build the Apache Hadoop 2.7.1 release from source on a
clean Ubuntu 14.04 system, but the unit tests are failing (see command
line 11 below).
Any help would be appreciated.
Also, I do not understand why I had to install the plugins (see command
line 8) in order to get a successful compilation. Note that the
compilation fails in (6) but passes in (10).
Thanks and regards,
Tucker
----Command Line----
(1) hadoop@hadoop-testnode:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
(2) hadoop@hadoop-testnode:~$ bash install_part1.sh
( lots of output)
(3) hadoop@hadoop-testnode:~$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
(4) hadoop@hadoop-testnode:~$ bash install_part2.sh
( lots of output )
(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/
(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output )
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]
( some more output )
[ERROR] Failed to parse plugin descriptor for
org.apache.hadoop:hadoop-maven-plugins:2.7.1
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/
(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn
install
( lots of output )
(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..
(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output, completes successfully )
(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test
( lots of output )
Tests in error:
TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156
» FileNotFound
TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in
CLASSPATH
TestSSLHttpServer.cleanup:96 NullPointer
TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in
CLASSPATH
TestHttpCookieFlag.cleanup:147 NullPointer
TestJMXJsonServlet.cleanup:46 NullPointer
Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE
[15:33.867s]
----install_part1.sh----
rm -f hadoop-2.7.1-src.tar.gz
wget
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
----install_part2.sh----
sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev
Re: Unable to pass complete tests on 2.7.1
Posted by Ravi Prakash <ra...@ymail.com>.
Hi Tucker!
Sadly, unit tests failing is usual for hadoop builds. You can use -DskipTests to build without running unit tests, or -fn (fail-never) to continue despite failures.
The maven-plugin helps us manage generated source code (e.g. protobuf files generate more java files which need to be compiled).
HTH
Ravi
On Monday, August 17, 2015 5:26 PM, Tucker Berckmann <tu...@scaleflux.com> wrote:
Hello,
I am trying to build the Apache Hadoop 2.7.1 release from source on a
clean Ubuntu 14.04 system, but the unit tests are failing (see command
line 11 below).
Any help would be appreciated.
Also, I do not understand why I had to install the plugins (see command
line 8) in order to get a successful compilation. Note that the
compilation fails in (6) but passes in (10).
Thanks and regards,
Tucker
----Command Line----
(1) hadoop@hadoop-testnode:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
(2) hadoop@hadoop-testnode:~$ bash install_part1.sh
( lots of output)
(3) hadoop@hadoop-testnode:~$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
(4) hadoop@hadoop-testnode:~$ bash install_part2.sh
( lots of output )
(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/
(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output )
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]
( some more output )
[ERROR] Failed to parse plugin descriptor for
org.apache.hadoop:hadoop-maven-plugins:2.7.1
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/
(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn
install
( lots of output )
(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..
(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output, completes successfully )
(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test
( lots of output )
Tests in error:
TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156
» FileNotFound
TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in
CLASSPATH
TestSSLHttpServer.cleanup:96 NullPointer
TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in
CLASSPATH
TestHttpCookieFlag.cleanup:147 NullPointer
TestJMXJsonServlet.cleanup:46 NullPointer
Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE
[15:33.867s]
----install_part1.sh----
rm -f hadoop-2.7.1-src.tar.gz
wget
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
----install_part2.sh----
sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev
Re: Unable to pass complete tests on 2.7.1
Posted by Ravi Prakash <ra...@ymail.com>.
Hi Tucker!
Sadly, unit tests failing is usual for hadoop builds. You can use -DskipTests to build without running unit tests, or -fn (fail-never) to continue despite failures.
The maven-plugin helps us manage generated source code (e.g. protobuf files generate more java files which need to be compiled).
HTH
Ravi
On Monday, August 17, 2015 5:26 PM, Tucker Berckmann <tu...@scaleflux.com> wrote:
Hello,
I am trying to build the Apache Hadoop 2.7.1 release from source on a
clean Ubuntu 14.04 system, but the unit tests are failing (see command
line 11 below).
Any help would be appreciated.
Also, I do not understand why I had to install the plugins (see command
line 8) in order to get a successful compilation. Note that the
compilation fails in (6) but passes in (10).
Thanks and regards,
Tucker
----Command Line----
(1) hadoop@hadoop-testnode:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
(2) hadoop@hadoop-testnode:~$ bash install_part1.sh
( lots of output)
(3) hadoop@hadoop-testnode:~$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
(4) hadoop@hadoop-testnode:~$ bash install_part2.sh
( lots of output )
(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/
(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output )
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]
( some more output )
[ERROR] Failed to parse plugin descriptor for
org.apache.hadoop:hadoop-maven-plugins:2.7.1
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/
(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn
install
( lots of output )
(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..
(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output, completes successfully )
(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test
( lots of output )
Tests in error:
TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156
» FileNotFound
TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in
CLASSPATH
TestSSLHttpServer.cleanup:96 NullPointer
TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in
CLASSPATH
TestHttpCookieFlag.cleanup:147 NullPointer
TestJMXJsonServlet.cleanup:46 NullPointer
Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE
[15:33.867s]
----install_part1.sh----
rm -f hadoop-2.7.1-src.tar.gz
wget
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
----install_part2.sh----
sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev
Re: Unable to pass complete tests on 2.7.1
Posted by Ravi Prakash <ra...@ymail.com>.
Hi Tucker!
Sadly, unit tests failing is usual for hadoop builds. You can use -DskipTests to build without running unit tests, or -fn (fail-never) to continue despite failures.
The maven-plugin helps us manage generated source code (e.g. protobuf files generate more java files which need to be compiled).
HTH
Ravi
On Monday, August 17, 2015 5:26 PM, Tucker Berckmann <tu...@scaleflux.com> wrote:
Hello,
I am trying to build the Apache Hadoop 2.7.1 release from source on a
clean Ubuntu 14.04 system, but the unit tests are failing (see command
line 11 below).
Any help would be appreciated.
Also, I do not understand why I had to install the plugins (see command
line 8) in order to get a successful compilation. Note that the
compilation fails in (6) but passes in (10).
Thanks and regards,
Tucker
----Command Line----
(1) hadoop@hadoop-testnode:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
(2) hadoop@hadoop-testnode:~$ bash install_part1.sh
( lots of output)
(3) hadoop@hadoop-testnode:~$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
(4) hadoop@hadoop-testnode:~$ bash install_part2.sh
( lots of output )
(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/
(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output )
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]
( some more output )
[ERROR] Failed to parse plugin descriptor for
org.apache.hadoop:hadoop-maven-plugins:2.7.1
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/
(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn
install
( lots of output )
(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..
(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output, completes successfully )
(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test
( lots of output )
Tests in error:
TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156
» FileNotFound
TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in
CLASSPATH
TestSSLHttpServer.cleanup:96 NullPointer
TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in
CLASSPATH
TestHttpCookieFlag.cleanup:147 NullPointer
TestJMXJsonServlet.cleanup:46 NullPointer
Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE
[15:33.867s]
----install_part1.sh----
rm -f hadoop-2.7.1-src.tar.gz
wget
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
----install_part2.sh----
sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev
Re: Unable to pass complete tests on 2.7.1
Posted by Ravi Prakash <ra...@ymail.com>.
Hi Tucker!
Sadly, unit tests failing is usual for hadoop builds. You can use -DskipTests to build without running unit tests, or -fn (fail-never) to continue despite failures.
The maven-plugin helps us manage generated source code (e.g. protobuf files generate more java files which need to be compiled).
HTH
Ravi
On Monday, August 17, 2015 5:26 PM, Tucker Berckmann <tu...@scaleflux.com> wrote:
Hello,
I am trying to build the Apache Hadoop 2.7.1 release from source on a
clean Ubuntu 14.04 system, but the unit tests are failing (see command
line 11 below).
Any help would be appreciated.
Also, I do not understand why I had to install the plugins (see command
line 8) in order to get a successful compilation. Note that the
compilation fails in (6) but passes in (10).
Thanks and regards,
Tucker
----Command Line----
(1) hadoop@hadoop-testnode:~$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.2 LTS
Release: 14.04
Codename: trusty
(2) hadoop@hadoop-testnode:~$ bash install_part1.sh
( lots of output)
(3) hadoop@hadoop-testnode:~$ java -version
java version "1.7.0_80"
Java(TM) SE Runtime Environment (build 1.7.0_80-b15)
Java HotSpot(TM) 64-Bit Server VM (build 24.80-b11, mixed mode)
(4) hadoop@hadoop-testnode:~$ bash install_part2.sh
( lots of output )
(5) hadoop@hadoop-testnode:~$ cd hadoop-2.7.1-src/
(6) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output )
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [1.960s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [1.276s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [3.446s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.050s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.054s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS
[4:41.806s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS
[1:57.117s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[2:14.411s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.245s]
[INFO] Apache Hadoop Common .............................. FAILURE [0.003s]
( some more output )
[ERROR] Failed to parse plugin descriptor for
org.apache.hadoop:hadoop-maven-plugins:2.7.1
(/home/hadoop/hadoop-2.7.1-src/hadoop-maven-plugins/target/classes): No
plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
(7) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ cd hadoop-maven-plugins/
(8) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ mvn
install
( lots of output )
(9) hadoop@hadoop-testnode:~/hadoop-2.7.1-src/hadoop-maven-plugins$ cd ..
(10) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn compile
( lots of output, completes successfully )
(11) hadoop@hadoop-testnode:~/hadoop-2.7.1-src$ mvn test
( lots of output )
Tests in error:
TestHttpServer.cleanup:151 NullPointer
TestHttpServerWebapps.testValidServerResource:41->HttpServerFunctionalTest.createServer:156
» FileNotFound
TestSSLHttpServer.setup:75 » FileNotFound webapps/test not found in
CLASSPATH
TestSSLHttpServer.cleanup:96 NullPointer
TestHttpCookieFlag.setUp:99 » FileNotFound webapps/test not found in
CLASSPATH
TestHttpCookieFlag.cleanup:147 NullPointer
TestJMXJsonServlet.cleanup:46 NullPointer
Tests run: 2877, Failures: 15, Errors: 7, Skipped: 186
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................ SUCCESS [0.200s]
[INFO] Apache Hadoop Project POM ......................... SUCCESS [0.693s]
[INFO] Apache Hadoop Annotations ......................... SUCCESS [0.390s]
[INFO] Apache Hadoop Project Dist POM .................... SUCCESS [0.074s]
[INFO] Apache Hadoop Assemblies .......................... SUCCESS [0.059s]
[INFO] Apache Hadoop Maven Plugins ....................... SUCCESS [0.766s]
[INFO] Apache Hadoop MiniKDC ............................. SUCCESS [12.461s]
[INFO] Apache Hadoop Auth ................................ SUCCESS
[4:13.099s]
[INFO] Apache Hadoop Auth Examples ....................... SUCCESS [0.059s]
[INFO] Apache Hadoop Common .............................. FAILURE
[15:33.867s]
----install_part1.sh----
rm -f hadoop-2.7.1-src.tar.gz
wget
http://mirror.cogentco.com/pub/apache/hadoop/common/hadoop-2.7.1/hadoop-2.7.1-src.tar.gz
tar xf hadoop-2.7.1-src.tar.gz
sudo apt-get purge openjdk*
sudo apt-get install software-properties-common
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java7-installer
----install_part2.sh----
sudo apt-get -y install maven
sudo apt-get -y install build-essential autoconf automake libtool cmake
zlib1g-dev pkg-config libssl-dev
sudo apt-get -y install libprotobuf-dev protobuf-compiler
sudo apt-get install snappy libsnappy-dev
sudo apt-get install bzip2 libbz2-dev
sudo apt-get install libjansson-dev
sudo apt-get install fuse libfuse-dev