You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Harsh J (Resolved) (JIRA)" <ji...@apache.org> on 2011/12/29 07:56:32 UTC

[jira] [Resolved] (HADOOP-3386) the job directory of a failed task may stay forever on a tasktracker node

     [ https://issues.apache.org/jira/browse/HADOOP-3386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J resolved HADOOP-3386.
-----------------------------

    Resolution: Cannot Reproduce

I'm not seeing failed task dirs flood my local directories during runtime. Possibly was fixed long ago.
                
> the job directory of a failed task may stay forever on a tasktracker node
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-3386
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3386
>             Project: Hadoop Common
>          Issue Type: Bug
>            Reporter: Zheng Shao
>
> See https://issues.apache.org/jira/browse/HADOOP-3370 for details of the problem.
> A tasktracker only cleans out the job dir when the job tracker sends a "KILLJOB" action in the heartbeat response message.
> However, in a corner case, the job tracker will NOT send the "KILLJOB" action to the task tracker. The case is when there is only failed tasks of this job on this task tracker; no successful tasks of this job is on this task tracker.
> In this case, jobtracker.trackerToTaskMap will not contain an entry of this task tracker to any tasks of this job. As a result, the job tracker will not send a KILLJOB action to the task tracker.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira