You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tian Chao (JIRA)" <ji...@apache.org> on 2009/01/07 08:04:44 UTC

[jira] Created: (HADOOP-4987) One more illegal map task been launched when the job almost complete

One more illegal map task been launched when the job almost complete
--------------------------------------------------------------------

                 Key: HADOOP-4987
                 URL: https://issues.apache.org/jira/browse/HADOOP-4987
             Project: Hadoop Core
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.19.0
         Environment: hadoop 0.19.0
            Reporter: Tian Chao


When the job nearly complete, the JobTracker launched one more  map task and quickly complete.
The Last map task is useless and illegal actually. In the following examples, the job should have 101 map tasks and the taskID begin from "attempt_200901071109_0001_m_000000". So the TaskID "attempt_200901071109_0001_m_000101" is out of range.



2009-01-07 11:16:04,435 INFO org.apache.hadoop.mapred.JobTracker: Adding task 'attempt_200901071109_0001_m_000101_0' to tip task_200901071109_0001_m_000101, for tracker 'tracker_ict.vega2010.org:127.0.0.1/127.0.0.1:40668'
2009-01-07 11:16:05,230 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_200901071109_0001_m_000101_0' has completed task_200901071109_0001_m_000101 successfully.
2009-01-07 11:16:05,231 INFO org.apache.hadoop.mapred.JobInProgress: Job job_200901071109_0001 has completed successfully.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4987) One more illegal map task been launched when the job almost complete

Posted by "Tian Chao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tian Chao updated HADOOP-4987:
------------------------------

    Attachment: hadoop-hdfs-jobtracker-vega2000.log

> One more illegal map task been launched when the job almost complete
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4987
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4987
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>         Environment: hadoop 0.19.0
>            Reporter: Tian Chao
>         Attachments: hadoop-hdfs-jobtracker-vega2000.log
>
>
> When the job nearly complete, the JobTracker launched one more  map task and quickly complete.
> The Last map task is useless and illegal actually. In the following examples, the job should have 101 map tasks and the taskID begin from "attempt_200901071109_0001_m_000000". So the TaskID "attempt_200901071109_0001_m_000101" is out of range.
> 2009-01-07 11:16:04,435 INFO org.apache.hadoop.mapred.JobTracker: Adding task 'attempt_200901071109_0001_m_000101_0' to tip task_200901071109_0001_m_000101, for tracker 'tracker_ict.vega2010.org:127.0.0.1/127.0.0.1:40668'
> 2009-01-07 11:16:05,230 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_200901071109_0001_m_000101_0' has completed task_200901071109_0001_m_000101 successfully.
> 2009-01-07 11:16:05,231 INFO org.apache.hadoop.mapred.JobInProgress: Job job_200901071109_0001 has completed successfully.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4987) One more illegal map task been launched when the job almost complete

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661475#action_12661475 ] 

Amareshwari Sriramadasu commented on HADOOP-4987:
-------------------------------------------------

This task is a job cleanup task  launched at the end of the job.  It is launched on the map slot of the tasktracker. See HADOOP-3150.
HADOOP-4421 looks at making the job cleanup and job setup tasks as first class tasks.

> One more illegal map task been launched when the job almost complete
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4987
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4987
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>         Environment: hadoop 0.19.0
>            Reporter: Tian Chao
>         Attachments: hadoop-hdfs-jobtracker-vega2000.log
>
>
> When the job nearly complete, the JobTracker launched one more  map task and quickly complete.
> The Last map task is useless and illegal actually. In the following examples, the job should have 101 map tasks and the taskID begin from "attempt_200901071109_0001_m_000000". So the TaskID "attempt_200901071109_0001_m_000101" is out of range.
> 2009-01-07 11:16:04,435 INFO org.apache.hadoop.mapred.JobTracker: Adding task 'attempt_200901071109_0001_m_000101_0' to tip task_200901071109_0001_m_000101, for tracker 'tracker_ict.vega2010.org:127.0.0.1/127.0.0.1:40668'
> 2009-01-07 11:16:05,230 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_200901071109_0001_m_000101_0' has completed task_200901071109_0001_m_000101 successfully.
> 2009-01-07 11:16:05,231 INFO org.apache.hadoop.mapred.JobInProgress: Job job_200901071109_0001 has completed successfully.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-4987) One more illegal map task been launched when the job almost complete

Posted by "Tian Chao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tian Chao resolved HADOOP-4987.
-------------------------------

    Resolution: Invalid

> One more illegal map task been launched when the job almost complete
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4987
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4987
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>         Environment: hadoop 0.19.0
>            Reporter: Tian Chao
>         Attachments: hadoop-hdfs-jobtracker-vega2000.log
>
>
> When the job nearly complete, the JobTracker launched one more  map task and quickly complete.
> The Last map task is useless and illegal actually. In the following examples, the job should have 101 map tasks and the taskID begin from "attempt_200901071109_0001_m_000000". So the TaskID "attempt_200901071109_0001_m_000101" is out of range.
> 2009-01-07 11:16:04,435 INFO org.apache.hadoop.mapred.JobTracker: Adding task 'attempt_200901071109_0001_m_000101_0' to tip task_200901071109_0001_m_000101, for tracker 'tracker_ict.vega2010.org:127.0.0.1/127.0.0.1:40668'
> 2009-01-07 11:16:05,230 INFO org.apache.hadoop.mapred.JobInProgress: Task 'attempt_200901071109_0001_m_000101_0' has completed task_200901071109_0001_m_000101 successfully.
> 2009-01-07 11:16:05,231 INFO org.apache.hadoop.mapred.JobInProgress: Job job_200901071109_0001 has completed successfully.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.