You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2009/05/25 13:59:45 UTC
[jira] Created: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
ArithmeticException in heartbeats with zero map jobs
----------------------------------------------------
Key: HADOOP-5908
URL: https://issues.apache.org/jira/browse/HADOOP-5908
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Vinod K V
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714824#action_12714824 ]
Devaraj Das commented on HADOOP-5908:
-------------------------------------
The testcase has a problem - the cleanup task is meant to block for a long time but it looks like it might not in the current implemented.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714406#action_12714406 ]
Amar Kamat commented on HADOOP-5908:
------------------------------------
ant tests passed on my box.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.3.patch
Attaching a patch incorporating Devaraj's comments. Result of test-patch
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 6 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{code}
Ant test passed on my box.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch, HADOOP-5908-v3.3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.2.patch
Incorporated offline changes suggested by Devaraj. Result of test-patch
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 9 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{code}
Running ant test now
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713539#action_12713539 ]
Amar Kamat commented on HADOOP-5908:
------------------------------------
ant test passed on my box.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.3-branch20.patch
Attaching a patch for 0.20 branch.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch, HADOOP-5908-v3.3-branch20.patch, HADOOP-5908-v3.3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Ramya R (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713563#action_12713563 ]
Ramya R commented on HADOOP-5908:
---------------------------------
With the above patch, observed NPE in heartbeats with zero map jobs.
Below is the stacktrace
{noformat}
java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.mapred.JobInProgress.findNewMapTask(JobInProgress.java:1777)
at org.apache.hadoop.mapred.JobInProgress.obtainNewMapTask(JobInProgress.java:982)
at org.apache.hadoop.mapred.CapacityTaskScheduler$MapSchedulingMgr.obtainNewTask(CapacityTaskScheduler.java:572)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.getTaskFromQueue(CapacityTaskScheduler.java:418)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.assignTasks(CapacityTaskScheduler.java:498)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.access$500(CapacityTaskScheduler.java:277)
at org.apache.hadoop.mapred.CapacityTaskScheduler.assignTasks(CapacityTaskScheduler.java:977)
at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2605)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
{noformat}
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12713958#action_12713958 ]
Amar Kamat commented on HADOOP-5908:
------------------------------------
Result of test-patch
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 6 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
{code}
Running ant test now.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.0.patch
Attaching a patch that guards the maps value to be non-zero in denominator. Result of test-patch
{code}
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 6 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec]
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings
{code}
Verified that jip.desiredMap() is checked for non-zero value before using it in denominator.
Testing in progress.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712701#action_12712701 ]
Vinod K V commented on HADOOP-5908:
-----------------------------------
This issue was found by Ramya while testing HADOOP-5850. Statement by Ramya on that JIRA follows:
With the above fix, when a job (writing to DFS) with 0 maps and >0 reduces is submitted, the cluster hangs completely.
The TT logs show "INFO org.apache.hadoop.mapred.TaskTracker: Resending 'status' to <jt>' with reponseId 'ID" infinitely and the JT throws java.io.IOException: java.lang.ArithmeticException forever.
Below is the stacktrace:
2009-05-25 08:13:00,124 INFO org.apache.hadoop.ipc.Server: IPC Server handler 37 on <portno>, call heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@14d128c, false, false, true, 3231) from <ip>:<port> error: java.io.IOException:
java.lang.ArithmeticException: / by zero
java.io.IOException: java.lang.ArithmeticException: / by zero
at org.apache.hadoop.mapred.ResourceEstimator.getEstimatedMapOutputSize(ResourceEstimator.java:85)
at org.apache.hadoop.mapred.JobInProgress.findNewMapTask(JobInProgress.java:1729)
at org.apache.hadoop.mapred.JobInProgress.obtainNewMapTask(JobInProgress.java:978)
at org.apache.hadoop.mapred.CapacityTaskScheduler$MapSchedulingMgr.obtainNewTask(CapacityTaskScheduler.java:572)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.getTaskFromQueue(CapacityTaskScheduler.java:418)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.assignTasks(CapacityTaskScheduler.java:498)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.access$500(CapacityTaskScheduler.java:277)
at org.apache.hadoop.mapred.CapacityTaskScheduler.assignTasks(CapacityTaskScheduler.java:977)
at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2605)
at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
In such a case, all the jobs hang infinitely without progressing and the cluster is completely down.
This problem is solved only when the no-map job is killed. Once the job is killed the cluster is back running and the other jobs proceed smoothly.
The TT logs show "INFO org.apache.hadoop.mapred.TaskTracker: Resending 'status' to <jt>' with reponseId 'ID" infinitely and the JT throws java.io.IOException: java.lang.ArithmeticException forever. Below is the stacktrace:
2009-05-25 08:13:00,124 INFO org.apache.hadoop.ipc.Server: IPC Server handler 37 on <portno>, call heartbeat(org.apache.hadoop.mapred.TaskTrackerStatus@14d128c, false, false, true, 3231) from <ip>:<port> error: java.io.IOException:
java.lang.ArithmeticException: / by zero
java.io.IOException: java.lang.ArithmeticException: / by zero
at org.apache.hadoop.mapred.ResourceEstimator.getEstimatedMapOutputSize(ResourceEstimator.java:85)
at org.apache.hadoop.mapred.JobInProgress.findNewMapTask(JobInProgress.java:1729)
at org.apache.hadoop.mapred.JobInProgress.obtainNewMapTask(JobInProgress.java:978)
at org.apache.hadoop.mapred.CapacityTaskScheduler$MapSchedulingMgr.obtainNewTask(CapacityTaskScheduler.java:572)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.getTaskFromQueue(CapacityTaskScheduler.java:418)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.assignTasks(CapacityTaskScheduler.java:498)
at org.apache.hadoop.mapred.CapacityTaskScheduler$TaskSchedulingMgr.access$500(CapacityTaskScheduler.java:277)
at org.apache.hadoop.mapred.CapacityTaskScheduler.assignTasks(CapacityTaskScheduler.java:977)
at org.apache.hadoop.mapred.JobTracker.heartbeat(JobTracker.java:2605)
at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)
In such a case, all the jobs hang infinitely without progressing and the cluster is completely down. This problem is solved only when the no-map job is killed. Once the job is killed the cluster is back running and the other jobs proceed smoothly.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714706#action_12714706 ]
Amar Kamat commented on HADOOP-5908:
------------------------------------
test-patch and ant tests passed on my box.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.1.patch
Attaching a new patch that short circuits the scheduling of maps/reducers = 0. Testing in progress.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V reassigned HADOOP-5908:
---------------------------------
Assignee: Amar Kamat
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: HADOOP-5908-v3.2.patch
Attaching a correct patch.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-5908:
-------------------------------
Attachment: (was: HADOOP-5908-v3.2.patch)
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12712702#action_12712702 ]
Vinod K V commented on HADOOP-5908:
-----------------------------------
This situation occurs if scheduler is invoked and it calls job.obtainNewMapTask() while the job-clean-up task of this job is still running. Discussed with this Devaraj who concurs that obtainNewMapTask()/obtainNewReduceTask() should return immediately, doing nothing, when job-cleanup is running.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-5908:
------------------------------------
Attachment: HADOOP-5908-v3.2.20.patch
Attached alternate 0.20 patch that is not to be committed to the branch.
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Fix For: 0.20.1
>
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.20.patch, HADOOP-5908-v3.2.patch, HADOOP-5908-v3.3-branch20.patch, HADOOP-5908-v3.3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-5908) ArithmeticException in heartbeats
with zero map jobs
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das resolved HADOOP-5908.
---------------------------------
Resolution: Fixed
Fix Version/s: 0.20.1
Hadoop Flags: [Reviewed]
I just committed this. Thanks, Amar!
> ArithmeticException in heartbeats with zero map jobs
> ----------------------------------------------------
>
> Key: HADOOP-5908
> URL: https://issues.apache.org/jira/browse/HADOOP-5908
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Vinod K V
> Assignee: Amar Kamat
> Fix For: 0.20.1
>
> Attachments: HADOOP-5908-v3.0.patch, HADOOP-5908-v3.1.patch, HADOOP-5908-v3.2.patch, HADOOP-5908-v3.3-branch20.patch, HADOOP-5908-v3.3.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.