You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/05/24 22:30:13 UTC
[jira] [Commented] (PIG-4446) Support for vertex level commit for
parallel outputs in Tez
[ https://issues.apache.org/jira/browse/PIG-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15299057#comment-15299057 ]
Rohini Palaniswamy commented on PIG-4446:
-----------------------------------------
Enabling this is a matter of setting tez.amcommit-all-outputs-on-dag-success to false.
Code changes to capture stats properly in case of vertex commits is already done in PIG-4487.
> Support for vertex level commit for parallel outputs in Tez
> -----------------------------------------------------------
>
> Key: PIG-4446
> URL: https://issues.apache.org/jira/browse/PIG-4446
> Project: Pig
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
>
> By default, Tez does AM level commit controlled by the setting TEZ_AM_COMMIT_ALL_OUTPUTS_ON_DAG_SUCCESS. It has support for vertex level commit as well and that makes sense in some cases and Pig should support it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)