You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Marton Bod (Jira)" <ji...@apache.org> on 2021/04/30 11:19:00 UTC

[jira] [Resolved] (HIVE-25076) Get number of write tasks from jobConf for Iceberg commits

     [ https://issues.apache.org/jira/browse/HIVE-25076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marton Bod resolved HIVE-25076.
-------------------------------
    Resolution: Fixed

> Get number of write tasks from jobConf for Iceberg commits
> ----------------------------------------------------------
>
>                 Key: HIVE-25076
>                 URL: https://issues.apache.org/jira/browse/HIVE-25076
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> When writing empty data into Iceberg tables, we can end up with 0 succeeded task count number. With the current logic, we might then erroneously end up taking the number of mapper tasks in the commit logic, which would result in failures. We should instead save the number of succeeded task count into the JobConf under a specified key and retrieve it from there.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)