You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Karam Singh (JIRA)" <ji...@apache.org> on 2008/09/26 13:27:44 UTC
[jira] Created: (HADOOP-4290) In jobdetails.jsp page the values of
Pending and Complete tasks for map keeps on interchanging with each other.
In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
---------------------------------------------------------------------------------------------------------------
Key: HADOOP-4290
URL: https://issues.apache.org/jira/browse/HADOOP-4290
Project: Hadoop Core
Issue Type: Bug
Components: contrib/capacity-sched
Affects Versions: 0.19.0
Reporter: Karam Singh
In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4290) In jobdetails.jsp page the values
of Pending and Complete tasks for map keeps on interchanging with each
other.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634823#action_12634823 ]
Amar Kamat commented on HADOOP-4290:
------------------------------------
bq. Also If taks are failed or killed then in the column Failed/Killed the value is shown 0/0.
I think this is the cause of the confusion. Ideally tasks move from competed to pending only when the tracker is lost or the task is killed.
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
> ---------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4290
> URL: https://issues.apache.org/jira/browse/HADOOP-4290
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
>
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4290) In jobdetails.jsp page the values
of Pending and Complete tasks for map keeps on interchanging with each
other.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639031#action_12639031 ]
Vinod K V commented on HADOOP-4290:
-----------------------------------
HADOOP-4288 is fixed. Karam, can you please verify if this issue still persists?
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
> ---------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4290
> URL: https://issues.apache.org/jira/browse/HADOOP-4290
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
>
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4290) In jobdetails.jsp page the values
of Pending and Complete tasks for map keeps on interchanging with each
other.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635673#action_12635673 ]
Vinod K V commented on HADOOP-4290:
-----------------------------------
Changing the issue dependencies, I've found out the actual reason to be HADOOP-4288. Because of HADOOP-4288, a tasktracker that gets a NullPointerException in its heartbeat resends the heartbeat repetitively for ever. And, on each heartbeat, JT finds a completed task reported by the TT to be already marked as completed in its data-structures, so marks it as killed and thus the state toggle happens repetitively. (JobInProgress.java +619).
It wasn't mentioned earlier, but, note that this issue surfaces only after applying HADOOP-4053, which in turn triggers HADOOP-4288.
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
> ---------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4290
> URL: https://issues.apache.org/jira/browse/HADOOP-4290
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
>
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-4290) In jobdetails.jsp page the values of
Pending and Complete tasks for map keeps on interchanging with each other.
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V resolved HADOOP-4290.
-------------------------------
Resolution: Duplicate
Karam reported offline that he is not seeing this issue any longer. HADOOP-4288 duplicates this.
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
> ---------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4290
> URL: https://issues.apache.org/jira/browse/HADOOP-4290
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
>
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4290) In jobdetails.jsp page the values
of Pending and Complete tasks for map keeps on interchanging with each
other.
Posted by "Karam Singh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634819#action_12634819 ]
Karam Singh commented on HADOOP-4290:
-------------------------------------
This issue is not a consistent behavior. We have seen it sometimes.
For example, for a particular job we see following values for map task
Status: Running
Started at: Fri Sep 26 10:28:47 UTC 2008
Running for: 47mins, 48sec
Job Cleanup: Pending
Kind % Complete Num Tasks Pending Running Complete Killed Failed/Killed Task Attempts
map 49.90% 216 77 59 80 0 0 / 0
reduce 0.00% 1 0 1 0 0 0 / 0
-------------------
Status: Running
Started at: Fri Sep 26 10:28:47 UTC 2008
Running for: 48mins, 56sec
Job Cleanup: Pending
Kind % Complete Num Tasks Pending Running Complete Killed Failed/Killed Task Attempts
map 49.90% 216 84 59 73 0 0 / 0
reduce 0.00% 1 0 1 0 0 0 / 0
-------------------
Status: Running
Started at: Fri Sep 26 10:28:47 UTC 2008
Running for: 49mins, 30sec
Job Cleanup: Pending
Kind % Complete Num Tasks Pending Running Complete Killed Failed/Killed Task Attempts
map 49.90% 216 76 59 81 0 0 / 0
reduce 0.00% 1 0 1 0 0 0 / 0
-----------------------
Status: Running
Started at: Fri Sep 26 10:28:47 UTC 2008
Running for: 49mins, 56sec
Job Cleanup: Pending
Kind % Complete Num Tasks Pending Running Complete Killed Failed/Killed Task Attempts
map 49.90% 216 85 59 72 0 0 / 0
reduce 0.00% 1 0 1 0 0 0 / 0
-----------------------------
Also If taks are failed or killed then in the column Failed/Killed the value is shown 0/0.
Note-:
We have not verified if the same issue exists for reducer task.
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
> ---------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4290
> URL: https://issues.apache.org/jira/browse/HADOOP-4290
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/capacity-sched
> Affects Versions: 0.19.0
> Reporter: Karam Singh
>
> In jobdetails.jsp page the values of Pending and Complete tasks for map keeps on interchanging with each other.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.