You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2012/09/22 00:16:08 UTC
[jira] [Created] (MAPREDUCE-4675) TestKillSubProcesses fails as the
process is still alive after the job is done
Arpit Gupta created MAPREDUCE-4675:
--------------------------------------
Summary: TestKillSubProcesses fails as the process is still alive after the job is done
Key: MAPREDUCE-4675
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: test
Affects Versions: 1.1.0, 1.2.0
Reporter: Arpit Gupta
Assignee: Bikas Saha
I ran this test in branch 1 and branch 1.1 and they both failed with the following
{code}
Testcase: testJobKillFailAndSucceed took 82.219 sec
FAILED
null
junit.framework.AssertionFailedError: null
at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as
the process is still alive after the job is done
Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462207#comment-13462207 ]
Vinod Kumar Vavilapalli commented on MAPREDUCE-4675:
----------------------------------------------------
Tx for the update, Arpit!
This looks good. +1. Committing.
> TestKillSubProcesses fails as the process is still alive after the job is done
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4675
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Arpit Gupta
> Assignee: Bikas Saha
> Attachments: MAPREDUCE-4675.branch-1.1.patch
>
>
> I ran this test in branch 1 and branch 1.1 and they both failed with the following
> {code}
> Testcase: testJobKillFailAndSucceed took 82.219 sec
> FAILED
> null
> junit.framework.AssertionFailedError: null
> at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
> at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4675) TestKillSubProcesses fails as the
process is still alive after the job is done
Posted by "Bikas Saha (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bikas Saha updated MAPREDUCE-4675:
----------------------------------
Attachment: MAPREDUCE-4675.branch-1.1.patch
A recent commit changed the heartbeat interval for small clusters that looks like it made this test race and fail. The MR parameter that was changed is final and so the test cannot override it. Working around by changing a different parameter that will change the heartbeat.
> TestKillSubProcesses fails as the process is still alive after the job is done
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4675
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Arpit Gupta
> Assignee: Bikas Saha
> Attachments: MAPREDUCE-4675.branch-1.1.patch
>
>
> I ran this test in branch 1 and branch 1.1 and they both failed with the following
> {code}
> Testcase: testJobKillFailAndSucceed took 82.219 sec
> FAILED
> null
> junit.framework.AssertionFailedError: null
> at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
> at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as
the process is still alive after the job is done
Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462205#comment-13462205 ]
Arpit Gupta commented on MAPREDUCE-4675:
----------------------------------------
Ran the test a few times with the patch attached and tests pass.
> TestKillSubProcesses fails as the process is still alive after the job is done
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4675
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Arpit Gupta
> Assignee: Bikas Saha
> Attachments: MAPREDUCE-4675.branch-1.1.patch
>
>
> I ran this test in branch 1 and branch 1.1 and they both failed with the following
> {code}
> Testcase: testJobKillFailAndSucceed took 82.219 sec
> FAILED
> null
> junit.framework.AssertionFailedError: null
> at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
> at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-4675) TestKillSubProcesses fails as
the process is still alive after the job is done
Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli resolved MAPREDUCE-4675.
------------------------------------------------
Resolution: Fixed
Fix Version/s: 1.1.0
Release Note: Fixed a race condition caused in TestKillSubProcesses caused due to a recent commit.
Hadoop Flags: Reviewed
Just committed this to branch-1 and branch-1.1. Thanks Bikas! And Arpit for reporting and verifying the fix!
> TestKillSubProcesses fails as the process is still alive after the job is done
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4675
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Arpit Gupta
> Assignee: Bikas Saha
> Fix For: 1.1.0
>
> Attachments: MAPREDUCE-4675.branch-1.1.patch
>
>
> I ran this test in branch 1 and branch 1.1 and they both failed with the following
> {code}
> Testcase: testJobKillFailAndSucceed took 82.219 sec
> FAILED
> null
> junit.framework.AssertionFailedError: null
> at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
> at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as
the process is still alive after the job is done
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462104#comment-13462104 ]
Arun C Murthy commented on MAPREDUCE-4675:
------------------------------------------
+1, thanks for the fix Bikas!
> TestKillSubProcesses fails as the process is still alive after the job is done
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4675
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4675
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Arpit Gupta
> Assignee: Bikas Saha
> Attachments: MAPREDUCE-4675.branch-1.1.patch
>
>
> I ran this test in branch 1 and branch 1.1 and they both failed with the following
> {code}
> Testcase: testJobKillFailAndSucceed took 82.219 sec
> FAILED
> null
> junit.framework.AssertionFailedError: null
> at org.apache.hadoop.mapred.TestKillSubProcesses.validateKillingSubprocesses(TestKillSubProcesses.java:245)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runKillingJobAndValidate(TestKillSubProcesses.java:97)
> at org.apache.hadoop.mapred.TestKillSubProcesses.runTests(TestKillSubProcesses.java:336)
> at org.apache.hadoop.mapred.TestKillSubProcesses.testJobKillFailAndSucceed(TestKillSubProcesses.java:320)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira