[jira] [Commented] (TEZ-439) Fix commit flow

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772523#comment-13772523 ] 

Bikas Saha commented on TEZ-439:
--------------------------------

Removed commitPending since this is not a 2-phase protocol that is coordinating the commit across multiple tasks.
Task attempt calls canCommit(). The first task attempt to do so wins and is allowed to commit. Others are asked to wait. If the commit attempt succeeds then it triggers killing the rest. If the commit attempt fails/killed then its forgotten from commit. The next task attempt that calls canCommit() is chosen as the committer.
Fixed a couple of other minor bugs.
                
> Fix commit flow
> ---------------
>
>                 Key: TEZ-439
>                 URL: https://issues.apache.org/jira/browse/TEZ-439
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>         Attachments: TEZ-439.1.patch
>
>
> Commit flow needs to be improved. Decide if both commitPending and canCommit are needed or just the later will do. Implement canCommit() API in TezProcessorContext.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira