[jira] [Comment Edited] (TEZ-2483) Tez should close task if processor fail

["Jeff Zhang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14558625#comment-14558625 ] 

Jeff Zhang edited comment on TEZ-2483 at 5/26/15 2:32 AM:
----------------------------------------------------------

Thanks [~daijy] I upload a new patch with minor change. close() can only be invoked when task in the state of RUNNING (after initialized).  [~sseth] [~rajesh.balamohan] Please help review


was (Author: zjffdu):
Thanks [~daijy] I upload a new patch with minor change. close() can only be invoked when task in the state of RUNNING (after initialized). 

> Tez should close task if processor fail
> ---------------------------------------
>
>                 Key: TEZ-2483
>                 URL: https://issues.apache.org/jira/browse/TEZ-2483
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Daniel Dai
>             Fix For: 0.7.1
>
>         Attachments: TEZ-2483-1.patch, TEZ-2483-2.patch
>
>
> The symptom is if PigProcessor fail, MRInput is not closed. On Windows, this creates a problem since Pig client cannot remove the input file.
> In general, if a task fail, Tez shall close all input/output handles in cleanup. MROutput is closed in MROutput.abort() which Pig invokes explicitly right now. Attach a demo patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)