You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Tony Burton <TB...@SportingIndex.com> on 2012/09/05 15:49:44 UTC
build failure - trying to build hadoop trunk checkout
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
On 6 September 2012 14:11, Michael Segel <mi...@hotmail.com> wrote:
>
> On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
>
> How is this breaking RFC-952?
>
> Its not. There is a bug. Under RFC-952, the restrictions deal with
> 'label' length, 1-63 characters and that the first and last character can't
> be a hyphen('-')
>
>
it was the @ I was worried about
> If the error message is accurate, its barfing because the code check isn't
> case insensitive.
>
>
my guess too. If someone did do an .equalsIgnoreCase() it would still break
in Turkey, so the patch should use EN_US as the locale for the case
conversion
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
On 6 September 2012 14:11, Michael Segel <mi...@hotmail.com> wrote:
>
> On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
>
> How is this breaking RFC-952?
>
> Its not. There is a bug. Under RFC-952, the restrictions deal with
> 'label' length, 1-63 characters and that the first and last character can't
> be a hyphen('-')
>
>
it was the @ I was worried about
> If the error message is accurate, its barfing because the code check isn't
> case insensitive.
>
>
my guess too. If someone did do an .equalsIgnoreCase() it would still break
in Turkey, so the patch should use EN_US as the locale for the case
conversion
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
On 6 September 2012 14:11, Michael Segel <mi...@hotmail.com> wrote:
>
> On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
>
> How is this breaking RFC-952?
>
> Its not. There is a bug. Under RFC-952, the restrictions deal with
> 'label' length, 1-63 characters and that the first and last character can't
> be a hyphen('-')
>
>
it was the @ I was worried about
> If the error message is accurate, its barfing because the code check isn't
> case insensitive.
>
>
my guess too. If someone did do an .equalsIgnoreCase() it would still break
in Turkey, so the patch should use EN_US as the locale for the case
conversion
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
On 6 September 2012 14:11, Michael Segel <mi...@hotmail.com> wrote:
>
> On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
>
> How is this breaking RFC-952?
>
> Its not. There is a bug. Under RFC-952, the restrictions deal with
> 'label' length, 1-63 characters and that the first and last character can't
> be a hyphen('-')
>
>
it was the @ I was worried about
> If the error message is accurate, its barfing because the code check isn't
> case insensitive.
>
>
my guess too. If someone did do an .equalsIgnoreCase() it would still break
in Turkey, so the patch should use EN_US as the locale for the case
conversion
Re: build failure - trying to build hadoop trunk checkout
Posted by Michael Segel <mi...@hotmail.com>.
On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
>
How is this breaking RFC-952?
Its not. There is a bug. Under RFC-952, the restrictions deal with 'label' length, 1-63 characters and that the first and last character can't be a hyphen('-')
If the error message is accurate, its barfing because the code check isn't case insensitive.
Or were you talking about something else?
Re: build failure - trying to build hadoop trunk checkout
Posted by Michael Segel <mi...@hotmail.com>.
On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
>
How is this breaking RFC-952?
Its not. There is a bug. Under RFC-952, the restrictions deal with 'label' length, 1-63 characters and that the first and last character can't be a hyphen('-')
If the error message is accurate, its barfing because the code check isn't case insensitive.
Or were you talking about something else?
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Changing the hostname to lowercase fixed this particular problem - thanks for your replies.
The build is failing elsewhere now, I'll post a new thread for that.
Tony
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 10 September 2012 10:44
To: user@hadoop.apache.org
Subject: RE: build failure - trying to build hadoop trunk checkout
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
On Sep 10, 2012, at 2:43 AM, Tony Burton wrote:
> (Seems a bit hacky though – can someone explain using easy words why this happens in Kerberos?)
>
As part of authenticating and generating tokens for clients, Kerberos needs, besides many other things, the hostname of the client. They must resolve to the same hostname on the client and server by their corresponding DNS. And by convention, hostnames are case insensitive. What we observed is that the Kerberos client and server disagree when it comes to hostnames with upper case alphabet.
HTH
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
On Sep 10, 2012, at 2:43 AM, Tony Burton wrote:
> (Seems a bit hacky though – can someone explain using easy words why this happens in Kerberos?)
>
As part of authenticating and generating tokens for clients, Kerberos needs, besides many other things, the hostname of the client. They must resolve to the same hostname on the client and server by their corresponding DNS. And by convention, hostnames are case insensitive. What we observed is that the Kerberos client and server disagree when it comes to hostnames with upper case alphabet.
HTH
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
I tried this:
cd into hadoop-mapreduce-project
ant test
and got further build errors - I’ll try mapreduce-dev.
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 10:55
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
I tried this:
cd into hadoop-mapreduce-project
ant test
and got further build errors - I’ll try mapreduce-dev.
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 10:55
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.
Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project?
Tony
-----Original Message-----
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 12:15
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.
Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project?
Tony
-----Original Message-----
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 12:15
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.
Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project?
Tony
-----Original Message-----
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 12:15
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Another "mvn test" caused the build to fail slightly further down the road. As my Jira issue is documentation-only, I've submitted the patch anyway.
Is this multiple-failure scenario typical for trying to build hadoop from the trunk? It's sure putting me off submitting code in future. Is there any way the build process could be reconsidered such that there's only one source of instruction for how to successfully build the project?
Tony
-----Original Message-----
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 12:15
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.
Thanks
hemanth
On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <ha...@cloudera.com> wrote:
> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:harsh@cloudera.com]
> > Sent: 11 September 2012 11:36
> > To: user@hadoop.apache.org
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:harsh@cloudera.com]
> >> Sent: 11 September 2012 11:25
> >> To: user@hadoop.apache.org
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:stevel@hortonworks.com]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: user@hadoop.apache.org
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed? Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO] [snipped SKIPPED test groups]
> >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> >>> [INFO]
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 17.229s
> >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> >>> [INFO] Final Memory: 21M/163M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test
> (default-test) on
> >>> project hadoop-mapreduce-client-jobclient: Execution default-test of
> goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> >>> java.lang.reflect.InvocationTargetException; nested exception is
> >>> java.lang.reflect.InvocationTargetException: null:
> >>> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl
> >>> -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e
> >>> switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> please
> >>> read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>>
> >>>
> >>>
> >>> Inbound Email has been scanned for viruses and SPAM
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> www.sportingindex.com
> >> Inbound Email has been scanned for viruses and SPAM
> >> **********************************************************************
> >> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> >> and approved by Sporting Index Ltd.
> >>
> >> Outbound email has been scanned for viruses and SPAM
> >
> >
> >
> > --
> > Harsh J
> > www.sportingindex.com
> > Inbound Email has been scanned for viruses and SPAM
> > **********************************************************************
> > This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> > and approved by Sporting Index Ltd.
> >
> > Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
>
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.
Thanks
hemanth
On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <ha...@cloudera.com> wrote:
> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:harsh@cloudera.com]
> > Sent: 11 September 2012 11:36
> > To: user@hadoop.apache.org
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:harsh@cloudera.com]
> >> Sent: 11 September 2012 11:25
> >> To: user@hadoop.apache.org
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:stevel@hortonworks.com]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: user@hadoop.apache.org
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed? Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO] [snipped SKIPPED test groups]
> >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> >>> [INFO]
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 17.229s
> >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> >>> [INFO] Final Memory: 21M/163M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test
> (default-test) on
> >>> project hadoop-mapreduce-client-jobclient: Execution default-test of
> goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> >>> java.lang.reflect.InvocationTargetException; nested exception is
> >>> java.lang.reflect.InvocationTargetException: null:
> >>> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl
> >>> -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e
> >>> switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> please
> >>> read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>>
> >>>
> >>>
> >>> Inbound Email has been scanned for viruses and SPAM
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> www.sportingindex.com
> >> Inbound Email has been scanned for viruses and SPAM
> >> **********************************************************************
> >> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> >> and approved by Sporting Index Ltd.
> >>
> >> Outbound email has been scanned for viruses and SPAM
> >
> >
> >
> > --
> > Harsh J
> > www.sportingindex.com
> > Inbound Email has been scanned for viruses and SPAM
> > **********************************************************************
> > This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> > and approved by Sporting Index Ltd.
> >
> > Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.
Thanks
hemanth
On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <ha...@cloudera.com> wrote:
> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:harsh@cloudera.com]
> > Sent: 11 September 2012 11:36
> > To: user@hadoop.apache.org
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:harsh@cloudera.com]
> >> Sent: 11 September 2012 11:25
> >> To: user@hadoop.apache.org
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:stevel@hortonworks.com]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: user@hadoop.apache.org
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed? Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO] [snipped SKIPPED test groups]
> >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> >>> [INFO]
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 17.229s
> >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> >>> [INFO] Final Memory: 21M/163M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test
> (default-test) on
> >>> project hadoop-mapreduce-client-jobclient: Execution default-test of
> goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> >>> java.lang.reflect.InvocationTargetException; nested exception is
> >>> java.lang.reflect.InvocationTargetException: null:
> >>> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl
> >>> -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e
> >>> switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> please
> >>> read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>>
> >>>
> >>>
> >>> Inbound Email has been scanned for viruses and SPAM
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> www.sportingindex.com
> >> Inbound Email has been scanned for viruses and SPAM
> >> **********************************************************************
> >> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> >> and approved by Sporting Index Ltd.
> >>
> >> Outbound email has been scanned for viruses and SPAM
> >
> >
> >
> > --
> > Harsh J
> > www.sportingindex.com
> > Inbound Email has been scanned for viruses and SPAM
> > **********************************************************************
> > This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> > and approved by Sporting Index Ltd.
> >
> > Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Also, for the maven based builds, BUILDING.txt in the root folder of hadoop
source does get one started.
Thanks
hemanth
On Tue, Sep 11, 2012 at 4:28 PM, Harsh J <ha...@cloudera.com> wrote:
> I guess we'll need to clean that guide and divide it in two - For
> branch-1 maintenance contributors, and for trunk contributors.
>
> I had another page that serves a slightly different purpose, but may
> help you just the same:
> http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
>
> On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> > That's good to know - is there a more up to date guide than
> http://wiki.apache.org/hadoop/HowToContribute which still makes many
> references to ant builds?
> >
> >
> >
> >
> > -----Original Message-----
> > From: Harsh J [mailto:harsh@cloudera.com]
> > Sent: 11 September 2012 11:36
> > To: user@hadoop.apache.org
> > Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >
> > Ah there is no longer a need to run ant anymore on trunk. Ignore the
> > leftover files in the base MR project directory - those should be
> > cleaned up soon. All of the functional pieces of the build right now
> > definitely use Maven.
> >
> > On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >> Ok - thanks Harsh.
> >>
> >> Following Steve's earlier advice I tried the mvn install, which worked
> fine, then ant test in hadoop-mapreduce-project which failed. I was
> mid-email to mapreduce-dev@hadoop, now I'll try mvn test in
> hadoop-mapreduce-project and report back.
> >>
> >> Tony
> >>
> >>
> >> -----Original Message-----
> >> From: Harsh J [mailto:harsh@cloudera.com]
> >> Sent: 11 September 2012 11:25
> >> To: user@hadoop.apache.org
> >> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>
> >> Tony,
> >>
> >> What I do is:
> >>
> >> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/;
> mvn test
> >>
> >> This seems to work in running without any missing dependencies at least.
> >>
> >> The user lists are all merged, but the developer lists remain separate
> >> as that works better.
> >>
> >> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots
> I can
> >>> see came from repository.apache.org though.
> >>>
> >>>
> >>>
> >>> How do I run the MR tests only?
> >>>
> >>>
> >>>
> >>> Thanks for the mapreduce-dev mailing list suggestion, I thought all
> lists
> >>> had merged into one though - did I get the wrong end of the stick?
> >>>
> >>>
> >>>
> >>> Tony
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> From: Steve Loughran [mailto:stevel@hortonworks.com]
> >>> Sent: 11 September 2012 10:45
> >>>
> >>>
> >>> To: user@hadoop.apache.org
> >>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
> >>>
> >>>
> >>>
> >>> It's probably some maven thing -in particular Maven's habit of
> grabbing the
> >>> online nightly snapshots off apache rather than local,
> >>>
> >>>
> >>>
> >>> try mvn clean install -DskipTests -offline
> >>>
> >>> to force in all the artifacts, then run the MR tests
> >>>
> >>>
> >>>
> >>> Tony -why not get on the mapreduce-dev mailing list, as this is the
> place to
> >>> discuss build and test process.
> >>>
> >>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>
> wrote:
> >>>
> >>> Hi,
> >>>
> >>>
> >>>
> >>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> >>> codebase as part of following the "How To Contribute" guide at
> >>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> >>> failing in hadoop-mapreduce-client-jobclient, the failure message is
> below -
> >>> something to do with org.hadoop.yarn.client and/or the maven surefire
> >>> plugin. Can anyone suggest how to proceed? Thanks!
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Reactor Summary:
> >>> [INFO] [snipped SKIPPED test groups]
> >>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> >>> [INFO]
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD FAILURE
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 17.229s
> >>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> >>> [INFO] Final Memory: 21M/163M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [ERROR] Failed to execute goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test
> (default-test) on
> >>> project hadoop-mapreduce-client-jobclient: Execution default-test of
> goal
> >>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> >>> java.lang.reflect.InvocationTargetException; nested exception is
> >>> java.lang.reflect.InvocationTargetException: null:
> >>> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl
> >>> -> [Help 1]
> >>> [ERROR]
> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with
> the -e
> >>> switch.
> >>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> >>> [ERROR]
> >>> [ERROR] For more information about the errors and possible solutions,
> please
> >>> read the following articles:
> >>> [ERROR] [Help 1]
> >>>
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>>
> >>>
> >>>
> >>> Inbound Email has been scanned for viruses and SPAM
> >>>
> >>> P Think of the environment: please don't print this email unless you
> really
> >>> need to.
> >>>
> >>> Outbound Email has been scanned for viruses and SPAM
> >>>
> >>> This email and any attachments are confidential, protected by
> copyright and
> >>> may be legally privileged. If you are not the intended recipient, then
> the
> >>> dissemination or copying of this email is prohibited. If you have
> received
> >>> this in error, please notify the sender by replying by email and then
> delete
> >>> the email completely from your system. Neither Sporting Index nor the
> sender
> >>> accepts responsibility for any virus, or any other defect which might
> affect
> >>> any computer or IT system into which the email is received and/or
> opened. It
> >>> is the responsibility of the recipient to scan the email and no
> >>> responsibility is accepted for any loss or damage arising in any way
> from
> >>> receipt or use of this email. Sporting Index Ltd is a company
> registered in
> >>> England and Wales with company number 2636842, whose registered office
> is at
> >>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd
> is
> >>> authorised and regulated by the UK Financial Services Authority (reg.
> no.
> >>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> >>> financial promotion contained herein has been issued and approved by
> >>> Sporting Index Ltd.
> >>
> >>
> >>
> >> --
> >> Harsh J
> >> www.sportingindex.com
> >> Inbound Email has been scanned for viruses and SPAM
> >> **********************************************************************
> >> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> >> and approved by Sporting Index Ltd.
> >>
> >> Outbound email has been scanned for viruses and SPAM
> >
> >
> >
> > --
> > Harsh J
> > www.sportingindex.com
> > Inbound Email has been scanned for viruses and SPAM
> > **********************************************************************
> > This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> > and approved by Sporting Index Ltd.
> >
> > Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
>
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Good suggestions Harsh and Hemanth.
When I was asked to submit a patch for hadoop 1.0.3, I thought it a good exercise to work through the build process to become familiar even though the patch is documentation-only. Maybe the requests for patches could come with a list of suggested reading as well as the link to http://wiki.apache.org/hadoop/HowToContribute, and the contributer can distill the appropriate important steps from all three. Otherwise, it's hard to tell which is the "gospel" version.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:59
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
I guess we'll need to clean that guide and divide it in two - For
branch-1 maintenance contributors, and for trunk contributors.
I had another page that serves a slightly different purpose, but may
help you just the same:
http://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk
On Tue, Sep 11, 2012 at 4:09 PM, Tony Burton <TB...@sportingindex.com> wrote:
> That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
>
>
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:36
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Ah there is no longer a need to run ant anymore on trunk. Ignore the
> leftover files in the base MR project directory - those should be
> cleaned up soon. All of the functional pieces of the build right now
> definitely use Maven.
>
> On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Ok - thanks Harsh.
>>
>> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>>
>> Tony
>>
>>
>> -----Original Message-----
>> From: Harsh J [mailto:harsh@cloudera.com]
>> Sent: 11 September 2012 11:25
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>> Tony,
>>
>> What I do is:
>>
>> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>>
>> This seems to work in running without any missing dependencies at least.
>>
>> The user lists are all merged, but the developer lists remain separate
>> as that works better.
>>
>> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>>> see came from repository.apache.org though.
>>>
>>>
>>>
>>> How do I run the MR tests only?
>>>
>>>
>>>
>>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>>> had merged into one though - did I get the wrong end of the stick?
>>>
>>>
>>>
>>> Tony
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>>> Sent: 11 September 2012 10:45
>>>
>>>
>>> To: user@hadoop.apache.org
>>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>>
>>>
>>>
>>> It's probably some maven thing -in particular Maven's habit of grabbing the
>>> online nightly snapshots off apache rather than local,
>>>
>>>
>>>
>>> try mvn clean install -DskipTests -offline
>>>
>>> to force in all the artifacts, then run the MR tests
>>>
>>>
>>>
>>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>>> discuss build and test process.
>>>
>>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>>> codebase as part of following the "How To Contribute" guide at
>>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>>> something to do with org.hadoop.yarn.client and/or the maven surefire
>>> plugin. Can anyone suggest how to proceed? Thanks!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Reactor Summary:
>>> [INFO] [snipped SKIPPED test groups]
>>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>>> [INFO]
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD FAILURE
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 17.229s
>>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>>> [INFO] Final Memory: 21M/163M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [ERROR] Failed to execute goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>>> java.lang.reflect.InvocationTargetException; nested exception is
>>> java.lang.reflect.InvocationTargetException: null:
>>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>>> -> [Help 1]
>>> [ERROR]
>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>>> switch.
>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>>> [ERROR]
>>> [ERROR] For more information about the errors and possible solutions, please
>>> read the following articles:
>>> [ERROR] [Help 1]
>>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>>
>>>
>>>
>>> Inbound Email has been scanned for viruses and SPAM
>>>
>>> P Think of the environment: please don't print this email unless you really
>>> need to.
>>>
>>> Outbound Email has been scanned for viruses and SPAM
>>>
>>> This email and any attachments are confidential, protected by copyright and
>>> may be legally privileged. If you are not the intended recipient, then the
>>> dissemination or copying of this email is prohibited. If you have received
>>> this in error, please notify the sender by replying by email and then delete
>>> the email completely from your system. Neither Sporting Index nor the sender
>>> accepts responsibility for any virus, or any other defect which might affect
>>> any computer or IT system into which the email is received and/or opened. It
>>> is the responsibility of the recipient to scan the email and no
>>> responsibility is accepted for any loss or damage arising in any way from
>>> receipt or use of this email. Sporting Index Ltd is a company registered in
>>> England and Wales with company number 2636842, whose registered office is at
>>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>>> authorised and regulated by the UK Financial Services Authority (reg. no.
>>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>>> financial promotion contained herein has been issued and approved by
>>> Sporting Index Ltd.
>>
>>
>>
>> --
>> Harsh J
>> www.sportingindex.com
>> Inbound Email has been scanned for viruses and SPAM
>> **********************************************************************
>> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
>> and approved by Sporting Index Ltd.
>>
>> Outbound email has been scanned for viruses and SPAM
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:36
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:36
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:36
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
That's good to know - is there a more up to date guide than http://wiki.apache.org/hadoop/HowToContribute which still makes many references to ant builds?
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:36
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Ah there is no longer a need to run ant anymore on trunk. Ignore the
leftover files in the base MR project directory - those should be
cleaned up soon. All of the functional pieces of the build right now
definitely use Maven.
On Tue, Sep 11, 2012 at 4:01 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Ok - thanks Harsh.
>
> Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
>
> Tony
>
>
> -----Original Message-----
> From: Harsh J [mailto:harsh@cloudera.com]
> Sent: 11 September 2012 11:25
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
> Tony,
>
> What I do is:
>
> $ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
>
> This seems to work in running without any missing dependencies at least.
>
> The user lists are all merged, but the developer lists remain separate
> as that works better.
>
> On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
>> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
>> see came from repository.apache.org though.
>>
>>
>>
>> How do I run the MR tests only?
>>
>>
>>
>> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
>> had merged into one though - did I get the wrong end of the stick?
>>
>>
>>
>> Tony
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> From: Steve Loughran [mailto:stevel@hortonworks.com]
>> Sent: 11 September 2012 10:45
>>
>>
>> To: user@hadoop.apache.org
>> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>>
>>
>>
>> It's probably some maven thing -in particular Maven's habit of grabbing the
>> online nightly snapshots off apache rather than local,
>>
>>
>>
>> try mvn clean install -DskipTests -offline
>>
>> to force in all the artifacts, then run the MR tests
>>
>>
>>
>> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
>> discuss build and test process.
>>
>> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I've checked out the hadoop trunk, and I'm running "mvn test" on the
>> codebase as part of following the "How To Contribute" guide at
>> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
>> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
>> something to do with org.hadoop.yarn.client and/or the maven surefire
>> plugin. Can anyone suggest how to proceed? Thanks!
>>
>>
>>
>>
>>
>>
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO] [snipped SKIPPED test groups]
>> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
>> [INFO]
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 17.229s
>> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
>> [INFO] Final Memory: 21M/163M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
>> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
>> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
>> java.lang.reflect.InvocationTargetException; nested exception is
>> java.lang.reflect.InvocationTargetException: null:
>> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
>> -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
>> switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions, please
>> read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>>
>>
>>
>> Inbound Email has been scanned for viruses and SPAM
>>
>> P Think of the environment: please don't print this email unless you really
>> need to.
>>
>> Outbound Email has been scanned for viruses and SPAM
>>
>> This email and any attachments are confidential, protected by copyright and
>> may be legally privileged. If you are not the intended recipient, then the
>> dissemination or copying of this email is prohibited. If you have received
>> this in error, please notify the sender by replying by email and then delete
>> the email completely from your system. Neither Sporting Index nor the sender
>> accepts responsibility for any virus, or any other defect which might affect
>> any computer or IT system into which the email is received and/or opened. It
>> is the responsibility of the recipient to scan the email and no
>> responsibility is accepted for any loss or damage arising in any way from
>> receipt or use of this email. Sporting Index Ltd is a company registered in
>> England and Wales with company number 2636842, whose registered office is at
>> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
>> authorised and regulated by the UK Financial Services Authority (reg. no.
>> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
>> financial promotion contained herein has been issued and approved by
>> Sporting Index Ltd.
>
>
>
> --
> Harsh J
> www.sportingindex.com
> Inbound Email has been scanned for viruses and SPAM
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
--
Harsh J
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Ok - thanks Harsh.
Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:25
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though - did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> codebase as part of following the "How To Contribute" guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Ok - thanks Harsh.
Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:25
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though - did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> codebase as part of following the "How To Contribute" guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Ok - thanks Harsh.
Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:25
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though - did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> codebase as part of following the "How To Contribute" guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Ok - thanks Harsh.
Following Steve's earlier advice I tried the mvn install, which worked fine, then ant test in hadoop-mapreduce-project which failed. I was mid-email to mapreduce-dev@hadoop, now I'll try mvn test in hadoop-mapreduce-project and report back.
Tony
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 11 September 2012 11:25
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I'll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though - did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I've checked out the hadoop trunk, and I'm running "mvn test" on the
> codebase as part of following the "How To Contribute" guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below -
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
www.sportingindex.com
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though – did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below –
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though – did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below –
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
I tried this:
cd into hadoop-mapreduce-project
ant test
and got further build errors - I’ll try mapreduce-dev.
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 10:55
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though – did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below –
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
I tried this:
cd into hadoop-mapreduce-project
ant test
and got further build errors - I’ll try mapreduce-dev.
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 11 September 2012 10:55
To: user@hadoop.apache.org
Subject: RE: hadoop trunk build failure - yarn, surefire related?
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Harsh J <ha...@cloudera.com>.
Tony,
What I do is:
$ cd hadoop/; mvn install -DskipTests; cd hadoop-mapreduce-project/; mvn test
This seems to work in running without any missing dependencies at least.
The user lists are all merged, but the developer lists remain separate
as that works better.
On Tue, Sep 11, 2012 at 3:24 PM, Tony Burton <TB...@sportingindex.com> wrote:
> Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can
> see came from repository.apache.org though.
>
>
>
> How do I run the MR tests only?
>
>
>
> Thanks for the mapreduce-dev mailing list suggestion, I thought all lists
> had merged into one though – did I get the wrong end of the stick?
>
>
>
> Tony
>
>
>
>
>
>
>
>
>
> From: Steve Loughran [mailto:stevel@hortonworks.com]
> Sent: 11 September 2012 10:45
>
>
> To: user@hadoop.apache.org
> Subject: Re: hadoop trunk build failure - yarn, surefire related?
>
>
>
> It's probably some maven thing -in particular Maven's habit of grabbing the
> online nightly snapshots off apache rather than local,
>
>
>
> try mvn clean install -DskipTests -offline
>
> to force in all the artifacts, then run the MR tests
>
>
>
> Tony -why not get on the mapreduce-dev mailing list, as this is the place to
> discuss build and test process.
>
> On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
>
> Hi,
>
>
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below –
> something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!
>
>
>
>
>
>
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl
> -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
>
>
>
> Inbound Email has been scanned for viruses and SPAM
>
> P Think of the environment: please don't print this email unless you really
> need to.
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright and
> may be legally privileged. If you are not the intended recipient, then the
> dissemination or copying of this email is prohibited. If you have received
> this in error, please notify the sender by replying by email and then delete
> the email completely from your system. Neither Sporting Index nor the sender
> accepts responsibility for any virus, or any other defect which might affect
> any computer or IT system into which the email is received and/or opened. It
> is the responsibility of the recipient to scan the email and no
> responsibility is accepted for any loss or damage arising in any way from
> receipt or use of this email. Sporting Index Ltd is a company registered in
> England and Wales with company number 2636842, whose registered office is at
> Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is
> authorised and regulated by the UK Financial Services Authority (reg. no.
> 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any
> financial promotion contained herein has been issued and approved by
> Sporting Index Ltd.
--
Harsh J
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks Steve, I’ll try the mvn command you suggest. All the snapshots I can see came from repository.apache.org though.
How do I run the MR tests only?
Thanks for the mapreduce-dev mailing list suggestion, I thought all lists had merged into one though – did I get the wrong end of the stick?
Tony
From: Steve Loughran [mailto:stevel@hortonworks.com]
Sent: 11 September 2012 10:45
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
It's probably some maven thing -in particular Maven's habit of grabbing the online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I’ve checked out the hadoop trunk, and I’m running “mvn test” on the codebase as part of following the “How To Contribute” guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below – something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Steve Loughran <st...@hortonworks.com>.
It's probably some maven thing -in particular Maven's habit of grabbing the
online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place
to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi Ramesh
Thanks for the quick reply, but I'm having trouble following your English. Are you saying that there is one command to build everything? If so, can you tell me what it is?
Tony
From: Narasingu Ramesh [mailto:ramesh.narasingu@gmail.com]
Sent: 11 September 2012 10:06
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Hi,
Please find i think one command is there then only build the all applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi Ramesh
Thanks for the quick reply, but I'm having trouble following your English. Are you saying that there is one command to build everything? If so, can you tell me what it is?
Tony
From: Narasingu Ramesh [mailto:ramesh.narasingu@gmail.com]
Sent: 11 September 2012 10:06
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Hi,
Please find i think one command is there then only build the all applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi Ramesh
Thanks for the quick reply, but I'm having trouble following your English. Are you saying that there is one command to build everything? If so, can you tell me what it is?
Tony
From: Narasingu Ramesh [mailto:ramesh.narasingu@gmail.com]
Sent: 11 September 2012 10:06
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Hi,
Please find i think one command is there then only build the all applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi Ramesh
Thanks for the quick reply, but I'm having trouble following your English. Are you saying that there is one command to build everything? If so, can you tell me what it is?
Tony
From: Narasingu Ramesh [mailto:ramesh.narasingu@gmail.com]
Sent: 11 September 2012 10:06
To: user@hadoop.apache.org
Subject: Re: hadoop trunk build failure - yarn, surefire related?
Hi,
Please find i think one command is there then only build the all applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi,
Please find i think one command is there then only build the all
applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Steve Loughran <st...@hortonworks.com>.
It's probably some maven thing -in particular Maven's habit of grabbing the
online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place
to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi,
Please find i think one command is there then only build the all
applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi,
Please find i think one command is there then only build the all
applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Steve Loughran <st...@hortonworks.com>.
It's probably some maven thing -in particular Maven's habit of grabbing the
online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place
to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Narasingu Ramesh <ra...@gmail.com>.
Hi,
Please find i think one command is there then only build the all
applications.
Thanks & Regards,
Ramesh.Narasingu
On Tue, Sep 11, 2012 at 2:28 PM, Tony Burton <TB...@sportingindex.com>wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
Re: hadoop trunk build failure - yarn, surefire related?
Posted by Steve Loughran <st...@hortonworks.com>.
It's probably some maven thing -in particular Maven's habit of grabbing the
online nightly snapshots off apache rather than local,
try mvn clean install -DskipTests -offline
to force in all the artifacts, then run the MR tests
Tony -why not get on the mapreduce-dev mailing list, as this is the place
to discuss build and test process.
On 11 September 2012 09:58, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,****
>
> ** **
>
> I’ve checked out the hadoop trunk, and I’m running “mvn test” on the
> codebase as part of following the “How To Contribute” guide at
> http://wiki.apache.org/hadoop/HowToContribute. The tests are currently
> failing in hadoop-mapreduce-client-jobclient, the failure message is below
> – something to do with org.hadoop.yarn.client and/or the maven surefire
> plugin. Can anyone suggest how to proceed? Thanks!****
>
> ** **
>
> ** **
>
> ** **
>
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO] [snipped SKIPPED test groups]
> [INFO] hadoop-mapreduce-client-jobclient ................. FAILURE
> [13.988s]
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 17.229s
> [INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
> [INFO] Final Memory: 21M/163M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on
> project hadoop-mapreduce-client-jobclient: Execution default-test of goal
> org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed:
> java.lang.reflect.InvocationTargetException; nested exception is
> java.lang.reflect.InvocationTargetException: null:
> org/hadoop/yarn/client/YarnClientImpl:
> org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException*
> ***
>
> *P **Think of the environment: please don't print this email unless you
> really need to.*****
>
> Outbound Email has been scanned for viruses and SPAM
>
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial Services
> Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has been
> issued and approved by Sporting Index Ltd.
>
hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Changing the hostname to lowercase fixed this particular problem - thanks for your replies.
The build is failing elsewhere now, I'll post a new thread for that.
Tony
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 10 September 2012 10:44
To: user@hadoop.apache.org
Subject: RE: build failure - trying to build hadoop trunk checkout
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Changing the hostname to lowercase fixed this particular problem - thanks for your replies.
The build is failing elsewhere now, I'll post a new thread for that.
Tony
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 10 September 2012 10:44
To: user@hadoop.apache.org
Subject: RE: build failure - trying to build hadoop trunk checkout
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Changing the hostname to lowercase fixed this particular problem - thanks for your replies.
The build is failing elsewhere now, I'll post a new thread for that.
Tony
From: Tony Burton [mailto:TBurton@SportingIndex.com]
Sent: 10 September 2012 10:44
To: user@hadoop.apache.org
Subject: RE: build failure - trying to build hadoop trunk checkout
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
P Think of the environment: please don't print this email unless you really need to.
Outbound Email has been scanned for viruses and SPAM
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd.
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
hadoop trunk build failure - yarn, surefire related?
Posted by Tony Burton <TB...@SportingIndex.com>.
Hi,
I've checked out the hadoop trunk, and I'm running "mvn test" on the codebase as part of following the "How To Contribute" guide at http://wiki.apache.org/hadoop/HowToContribute. The tests are currently failing in hadoop-mapreduce-client-jobclient, the failure message is below - something to do with org.hadoop.yarn.client and/or the maven surefire plugin. Can anyone suggest how to proceed? Thanks!
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] [snipped SKIPPED test groups]
[INFO] hadoop-mapreduce-client-jobclient ................. FAILURE [13.988s]
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.229s
[INFO] Finished at: Tue Sep 11 09:53:44 BST 2012
[INFO] Final Memory: 21M/163M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-mapreduce-client-jobclient: Execution default-test of goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test failed: java.lang.reflect.InvocationTargetException; nested exception is java.lang.reflect.InvocationTargetException: null: org/hadoop/yarn/client/YarnClientImpl: org.hadoop.yarn.client.YarnClientImpl -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
On Sep 10, 2012, at 2:43 AM, Tony Burton wrote:
> (Seems a bit hacky though – can someone explain using easy words why this happens in Kerberos?)
>
As part of authenticating and generating tokens for clients, Kerberos needs, besides many other things, the hostname of the client. They must resolve to the same hostname on the client and server by their corresponding DNS. And by convention, hostnames are case insensitive. What we observed is that the Kerberos client and server disagree when it comes to hostnames with upper case alphabet.
HTH
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
On Sep 10, 2012, at 2:43 AM, Tony Burton wrote:
> (Seems a bit hacky though – can someone explain using easy words why this happens in Kerberos?)
>
As part of authenticating and generating tokens for clients, Kerberos needs, besides many other things, the hostname of the client. They must resolve to the same hostname on the client and server by their corresponding DNS. And by convention, hostnames are case insensitive. What we observed is that the Kerberos client and server disagree when it comes to hostnames with upper case alphabet.
HTH
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
RE: build failure - trying to build hadoop trunk checkout
Posted by Tony Burton <TB...@SportingIndex.com>.
Thanks for the replies all. I'll investigate changing my hostname and report back.
(Seems a bit hacky though - can someone explain using easy words why this happens in Kerberos?)
Tony
From: Vinod Kumar Vavilapalli [mailto:vinodkv@hortonworks.com]
Sent: 06 September 2012 18:51
To: user@hadoop.apache.org
Subject: Re: build failure - trying to build hadoop trunk checkout
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com>> wrote:
Hi,
I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
Results :
Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
The test in question is:
@Test
public void testLocalHostNameForNullOrWild() throws Exception {
String local = SecurityUtil.getLocalHostName();
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
assertEquals("hdfs/" + local + "@REALM",
SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
}
And my hostname is tonyb-Precision-WorkStation-390.
Any idea how I can get this test to pass?
Thanks,
Tony
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Inbound Email has been scanned for viruses and SPAM
**********************************************************************
This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
and approved by Sporting Index Ltd.
Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
>
> On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
>
> On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Michael Segel <mi...@hotmail.com>.
On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
>
How is this breaking RFC-952?
Its not. There is a bug. Under RFC-952, the restrictions deal with 'label' length, 1-63 characters and that the first and last character can't be a hyphen('-')
If the error message is accurate, its barfing because the code check isn't case insensitive.
Or were you talking about something else?
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
>
> On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Michael Segel <mi...@hotmail.com>.
On Sep 6, 2012, at 6:24 AM, Steve Loughran <st...@hortonworks.com> wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
>
How is this breaking RFC-952?
Its not. There is a bug. Under RFC-952, the restrictions deal with 'label' length, 1-63 characters and that the first and last character can't be a hyphen('-')
If the error message is accurate, its barfing because the code check isn't case insensitive.
Or were you talking about something else?
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Never mind filing. I recalled that we debugged this issue long time back and cornered this down to problems with kerberos. See https://issues.apache.org/jira/browse/HADOOP-7988.
Given that, Tony, changing your hostname seems to be the only option.
Thanks,
+Vinod
On Sep 6, 2012, at 4:24 AM, Steve Loughran wrote:
> file this as a JIRA against hadoop-common, though your machine's hostname looks suspiciously close to breaking the RFC-952 rules on hostnames
>
> -steve
>
> On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
file this as a JIRA against hadoop-common, though your machine's hostname
looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContributefor building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level
> directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests:
> testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil):
> expected:<hd...@REALM> but
> was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
file this as a JIRA against hadoop-common, though your machine's hostname
looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContributefor building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level
> directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests:
> testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil):
> expected:<hd...@REALM> but
> was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
This is happening because SecurityUtil.getServerPrincipal(..) eventually is converting host-name to lowercase. Please file a bug here: https://issues.apache.org/jira/browse/HADOOP
The shorter-term workaround is to change your hostname to all lower-case, if that is possible.
HTH
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Sep 5, 2012, at 6:49 AM, Tony Burton wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
file this as a JIRA against hadoop-common, though your machine's hostname
looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContributefor building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level
> directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests:
> testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil):
> expected:<hd...@REALM> but
> was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
This is happening because SecurityUtil.getServerPrincipal(..) eventually is converting host-name to lowercase. Please file a bug here: https://issues.apache.org/jira/browse/HADOOP
The shorter-term workaround is to change your hostname to all lower-case, if that is possible.
HTH
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Sep 5, 2012, at 6:49 AM, Tony Burton wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
This is happening because SecurityUtil.getServerPrincipal(..) eventually is converting host-name to lowercase. Please file a bug here: https://issues.apache.org/jira/browse/HADOOP
The shorter-term workaround is to change your hostname to all lower-case, if that is possible.
HTH
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Sep 5, 2012, at 6:49 AM, Tony Burton wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
This is happening because SecurityUtil.getServerPrincipal(..) eventually is converting host-name to lowercase. Please file a bug here: https://issues.apache.org/jira/browse/HADOOP
The shorter-term workaround is to change your hostname to all lower-case, if that is possible.
HTH
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Sep 5, 2012, at 6:49 AM, Tony Burton wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContribute for building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected:<hd...@REALM> but was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM", "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Index nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Services Authority (reg. no. 150404) and Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
Re: build failure - trying to build hadoop trunk checkout
Posted by Steve Loughran <st...@hortonworks.com>.
file this as a JIRA against hadoop-common, though your machine's hostname
looks suspiciously close to breaking the RFC-952 rules on hostnames
-steve
On 5 September 2012 14:49, Tony Burton <TB...@sportingindex.com> wrote:
> Hi,
>
> I'm following the steps at http://wiki.apache.org/hadoop/HowToContributefor building hadoop in preparation for submitting a patch.
>
> I've checked out the trunk, and when I run "mvn test" from the top-level
> directory, I get the following error (snipped for clarity):
>
> Results :
>
> Failed tests:
> testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil):
> expected:<hd...@REALM> but
> was:<hd...@REALM>
>
> The test in question is:
>
> @Test
> public void testLocalHostNameForNullOrWild() throws Exception {
> String local = SecurityUtil.getLocalHostName();
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> (String)null));
> assertEquals("hdfs/" + local + "@REALM",
> SecurityUtil.getServerPrincipal("hdfs/_HOST@REALM",
> "0.0.0.0"));
> }
>
> And my hostname is tonyb-Precision-WorkStation-390.
>
> Any idea how I can get this test to pass?
>
> Thanks,
>
> Tony
>
>
>
>
>
>
> **********************************************************************
> This email and any attachments are confidential, protected by copyright
> and may be legally privileged. If you are not the intended recipient, then
> the dissemination or copying of this email is prohibited. If you have
> received this in error, please notify the sender by replying by email and
> then delete the email completely from your system. Neither Sporting Index
> nor the sender accepts responsibility for any virus, or any other defect
> which might affect any computer or IT system into which the email is
> received and/or opened. It is the responsibility of the recipient to scan
> the email and no responsibility is accepted for any loss or damage arising
> in any way from receipt or use of this email. Sporting Index Ltd is a
> company registered in England and Wales with company number 2636842, whose
> registered office is at Gateway House, Milverton Street, London, SE11 4AP.
> Sporting Index Ltd is authorised and regulated by the UK Financial
> Services Authority (reg. no. 150404) and Gambling Commission (reg. no.
> 000-027343-R-308898-001). Any financial promotion contained herein has
> been issued
> and approved by Sporting Index Ltd.
>
> Outbound email has been scanned for viruses and SPAM
>