You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Ewan Higgs <Ew...@wdc.com> on 2017/08/07 16:19:11 UTC

Integration Tests build line

Hi all,
I’m having trouble getting integration tests to run successfully. It hasn’t really affected me so far, but it’s bothering me that I’m not getting these working and I’d like this to work. So maybe I’m doing something wrong. I tried looking in Jenkins but I didn’t see the integration tests being used anywhere.


mvn install -Dtest=**/ITUseMiniCluster.java -DforkMode=never -Pnoshade

Running org.apache.hadoop.example.ITUseMiniCluster
Tests run: 4, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 35.641 sec <<< FAILURE! - in org.apache.hadoop.example.ITUseMiniCluster
useWebHDFS(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 21.097 sec  <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/mockito/stubbing/Answer
                at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
                at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:97)
                at org.apache.hadoop.hdfs.MiniDFSCluster.shouldWait(MiniDFSCluster.java:2668)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2564)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2607)
                at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1667)
                at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:874)
                at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:494)
                at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:453)
                at org.apache.hadoop.example.ITUseMiniCluster.clusterUp(ITUseMiniCluster.java:74)

useWebHDFS(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 21.1 sec  <<< ERROR!
java.lang.NullPointerException: null
                at org.apache.hadoop.example.ITUseMiniCluster.clusterDown(ITUseMiniCluster.java:80)

useHdfsFileSystem(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 14.486 sec  <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/mockito/stubbing/Answer
                at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
                at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:97)
                at org.apache.hadoop.hdfs.MiniDFSCluster.shouldWait(MiniDFSCluster.java:2668)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2564)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2607)
                at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1667)
                at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:874)
                at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:494)
                at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:453)
                at org.apache.hadoop.example.ITUseMiniCluster.clusterUp(ITUseMiniCluster.java:74)

useHdfsFileSystem(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 14.486 sec  <<< ERROR!
java.lang.NullPointerException: null
                at org.apache.hadoop.example.ITUseMiniCluster.clusterDown(ITUseMiniCluster.java:80)



Thanks for any help!

-Ewan

Western Digital Corporation (and its subsidiaries) E-mail Confidentiality Notice & Disclaimer:

This e-mail and any files transmitted with it may contain confidential or legally privileged information of WDC and/or its affiliates, and are intended solely for the use of the individual or entity to which they are addressed. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited. If you have received this e-mail in error, please notify the sender immediately and delete the e-mail in its entirety from your system.

Re: Integration Tests build line

Posted by Allen Wittenauer <aw...@effectivemachines.com>.
> On Aug 9, 2017, at 5:04 AM, Ewan Higgs <Ew...@wdc.com> wrote:
> Is Jenkins even building these?

	No, Jenkins is not currently running any of the ITs (this one and the ones in hadoop-aws).  Probably worth pointing out that a large chunk of the unit tests are really misclassified ITs (esp in hadoop-mapreduce-project and hadoop-yarn-project).

> I don’t see org.apache.hadoop.example listed here:
> https://builds.apache.org/job/PreCommit-HDFS-Build/20614/testReport/

	It wouldn’t necessarily be there anyway, given that precommit is patch-sensitive. (i.e., it only runs tests for modules that got patched.)  All of the unit tests are run as part of the daily qbt runs, however.



---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org


Re: Integration Tests build line

Posted by Ewan Higgs <Ew...@wdc.com>.
Hi all,
Sorry to be annoying, but I’m still unable to build integration tests and wasn’t sure if anyone had seen this message.

Is Jenkins even building these? I don’t see org.apache.hadoop.example listed here:
https://builds.apache.org/job/PreCommit-HDFS-Build/20614/testReport/

Thanks
Ewan

From: Ewan Higgs <Ew...@wdc.com>
Date: Monday, 7 August 2017 at 18:19
To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>
Subject: Integration Tests build line

Hi all,
I’m having trouble getting integration tests to run successfully. It hasn’t really affected me so far, but it’s bothering me that I’m not getting these working and I’d like this to work. So maybe I’m doing something wrong. I tried looking in Jenkins but I didn’t see the integration tests being used anywhere.


mvn install -Dtest=**/ITUseMiniCluster.java -DforkMode=never -Pnoshade

Running org.apache.hadoop.example.ITUseMiniCluster
Tests run: 4, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 35.641 sec <<< FAILURE! - in org.apache.hadoop.example.ITUseMiniCluster
useWebHDFS(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 21.097 sec  <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/mockito/stubbing/Answer
                at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
                at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:97)
                at org.apache.hadoop.hdfs.MiniDFSCluster.shouldWait(MiniDFSCluster.java:2668)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2564)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2607)
                at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1667)
                at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:874)
                at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:494)
                at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:453)
                at org.apache.hadoop.example.ITUseMiniCluster.clusterUp(ITUseMiniCluster.java:74)

useWebHDFS(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 21.1 sec  <<< ERROR!
java.lang.NullPointerException: null
                at org.apache.hadoop.example.ITUseMiniCluster.clusterDown(ITUseMiniCluster.java:80)

useHdfsFileSystem(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 14.486 sec  <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/mockito/stubbing/Answer
                at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
                at org.apache.maven.surefire.booter.IsolatedClassLoader.loadClass(IsolatedClassLoader.java:97)
                at org.apache.hadoop.hdfs.MiniDFSCluster.shouldWait(MiniDFSCluster.java:2668)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2564)
                at org.apache.hadoop.hdfs.MiniDFSCluster.waitActive(MiniDFSCluster.java:2607)
                at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1667)
                at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:874)
                at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:494)
                at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:453)
                at org.apache.hadoop.example.ITUseMiniCluster.clusterUp(ITUseMiniCluster.java:74)

useHdfsFileSystem(org.apache.hadoop.example.ITUseMiniCluster)  Time elapsed: 14.486 sec  <<< ERROR!
java.lang.NullPointerException: null
                at org.apache.hadoop.example.ITUseMiniCluster.clusterDown(ITUseMiniCluster.java:80)



Thanks for any help!

-Ewan

Western Digital Corporation (and its subsidiaries) E-mail Confidentiality Notice & Disclaimer:

This e-mail and any files transmitted with it may contain confidential or legally privileged information of WDC and/or its affiliates, and are intended solely for the use of the individual or entity to which they are addressed. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited. If you have received this e-mail in error, please notify the sender immediately and delete the e-mail in its entirety from your system.