You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/03/08 11:28:00 UTC

[jira] [Updated] (HIVE-24857) Trigger Tez output commit after close operation

     [ https://issues.apache.org/jira/browse/HIVE-24857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HIVE-24857:
----------------------------------
    Labels: pull-request-available  (was: )

> Trigger Tez output commit after close operation
> -----------------------------------------------
>
>                 Key: HIVE-24857
>                 URL: https://issues.apache.org/jira/browse/HIVE-24857
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently Tez triggers the OutputCommitter.commit() operation between the proc.run() and proc.close() operations in TezProcessor. However, when writing out data, calling the proc.close() operation may still produce some extra records, which would be missed by the output committer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)