You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Jeff Zhang (JIRA)" <ji...@apache.org> on 2015/01/15 01:44:34 UTC

[jira] [Updated] (TEZ-1943) Move shared OutputCommiter to DAG

     [ https://issues.apache.org/jira/browse/TEZ-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeff Zhang updated TEZ-1943:
----------------------------
    Description: 
Currently, we will have one committer for each output of vertex even if it is a shared output in the case of Vertex Group. In this scenario, the method initialize and setupOutput of OutputCommiter of vertex group will been called multiple times. Although currently there is no issue on the current OutputCommitter impl, but this could cause potential issue for any customized OutputCommitter in the future.  
So this jira is for moving shared OutputCommiter to DAG and let DAG to control the share OutputCommitter.

  was:
Currently, we will have one committer for each output of vertex even if it is a shared output in the case of Vertex Group. In this scenario, the method initialize and setupOutput of OutputCommiter will been called multiple times. Although currently there is no issue on that, but this could cause potential issue for any customized OutputCommitter in the future.  
So this jira is for moving shared OutputCommiter to DAG and let DAG to control the share OutputCommitter.


> Move shared OutputCommiter to DAG
> ---------------------------------
>
>                 Key: TEZ-1943
>                 URL: https://issues.apache.org/jira/browse/TEZ-1943
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jeff Zhang
>            Assignee: Jeff Zhang
>
> Currently, we will have one committer for each output of vertex even if it is a shared output in the case of Vertex Group. In this scenario, the method initialize and setupOutput of OutputCommiter of vertex group will been called multiple times. Although currently there is no issue on the current OutputCommitter impl, but this could cause potential issue for any customized OutputCommitter in the future.  
> So this jira is for moving shared OutputCommiter to DAG and let DAG to control the share OutputCommitter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)