You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Marton Bod (Jira)" <ji...@apache.org> on 2021/04/29 12:00:00 UTC

[jira] [Created] (HIVE-25076) Get number of write tasks from jobConf for Iceberg commits

Marton Bod created HIVE-25076:
---------------------------------

             Summary: Get number of write tasks from jobConf for Iceberg commits
                 Key: HIVE-25076
                 URL: https://issues.apache.org/jira/browse/HIVE-25076
             Project: Hive
          Issue Type: Improvement
            Reporter: Marton Bod
            Assignee: Marton Bod


When writing empty data into Iceberg tables, we can end up with 0 succeeded task count number. With the current logic, we might then erroneously end up taking the number of mapper tasks in the commit logic, which would result in failures. We should instead save the number of succeeded task count into the JobConf under a specified key and retrieve it from there.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)