You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2017/01/20 02:41:26 UTC

[jira] [Created] (HIVE-15670) column_stats_accurate may not fit in PARTITION_PARAMS.VALUE

Sergey Shelukhin created HIVE-15670:
---------------------------------------

             Summary: column_stats_accurate may not fit in PARTITION_PARAMS.VALUE
                 Key: HIVE-15670
                 URL: https://issues.apache.org/jira/browse/HIVE-15670
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin


The JSON can be too big with many columns.
We can make JSON more compact by only storing the list of columns with true values. Or we can even store a bitmask in a dedicated column, and adjust it when altering table (rare enough). Or we can just change the VALUE column to text blob (might be a painful change wrt upgrade scripts, and supporting all the DBs' varied blob implementations, esp. in directsql).
Storing denormalized flags in a separate table will probably be slow, comparatively.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)