You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Matt McCline (JIRA)" <ji...@apache.org> on 2015/09/28 22:07:04 UTC

[jira] [Created] (HIVE-11981) ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)

Matt McCline created HIVE-11981:
-----------------------------------

             Summary: ORC Schema Evolution Issues (Vectorized, ACID, and Non-Vectorized)
                 Key: HIVE-11981
                 URL: https://issues.apache.org/jira/browse/HIVE-11981
             Project: Hive
          Issue Type: Bug
          Components: Hive, Transactions
            Reporter: Matt McCline
            Assignee: Matt McCline
            Priority: Critical


High priority issues with schema evolution for the ORC file format.

Schema evolution here is limited to adding new columns and a few cases of column type-widening (e.g. int to bigint).

Renaming columns, deleting column, moving columns and other schema evolution were not pursued due to lack of importance and lack of time.  Also, it appears a much more sophisticated metadata would be needed to support them.

The biggest issues for users have been adding new columns for ACID table (HIVE-11421 Support Schema evolution for ACID tables) and vectorization (HIVE-10598 Vectorization borks when column is added to table).




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)