You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2018/05/07 18:36:00 UTC

[jira] [Created] (HIVE-19442) convert Hive stats to deltas

Sergey Shelukhin created HIVE-19442:
---------------------------------------

             Summary: convert Hive stats to deltas
                 Key: HIVE-19442
                 URL: https://issues.apache.org/jira/browse/HIVE-19442
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin


This would allow for
1) Accurate stats after partial operations like inserts.
2) Better ACID integration.

The idea is for partition stats and table stats to be written as deltas, with a flag that indicates this is a delta (i.e. "this insert wrote 500 rows").
The flag like this would also allow us to avoid converting old stats.
Thats can be merged after the query if appropriate locking is present and the table is not transactional, or by compactor, based on ACID watermarks, when the table is transactional.





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)