[jira] [Resolved] (HIVE-24857) Trigger Tez output commit after close operation

["Peter Vary (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-24857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Vary resolved HIVE-24857.
-------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

Pushed to master.

Thanks for the patch [~Marton Bod]!

> Trigger Tez output commit after close operation
> -----------------------------------------------
>
>                 Key: HIVE-24857
>                 URL: https://issues.apache.org/jira/browse/HIVE-24857
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Currently Tez triggers the OutputCommitter.commit() operation between the proc.run() and proc.close() operations in TezProcessor. However, when writing out data, calling the proc.close() operation may still produce some extra records, which would be missed by the output committer.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)