You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Marton Bod (Jira)" <ji...@apache.org> on 2021/01/13 08:35:00 UTC

[jira] [Assigned] (HIVE-24629) Invoke optional output committer in TezProcessor

     [ https://issues.apache.org/jira/browse/HIVE-24629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marton Bod reassigned HIVE-24629:
---------------------------------


> Invoke optional output committer in TezProcessor
> ------------------------------------------------
>
>                 Key: HIVE-24629
>                 URL: https://issues.apache.org/jira/browse/HIVE-24629
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>
> In order to enable Hive to write to Iceberg tables, we need to use an output committer which will fire at the end of each Tez task execution (commitTask) and the after the execution of each vertex (commitOutput/commitJob). This output committer will issue a commit containing the written-out data files to the Iceberg table, replacing its previous snapshot pointer with a new one.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)