[jira] [Updated] (HIVE-12159) Create vectorized readers for the complex types

["Owen O'Malley (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HIVE-12159:
---------------------------------
    Attachment: HIVE-12159.patch

This patch adds support for reading complex types to the vectorized ORC reader.

Important changes:
* RecordReader.nextBatch now requires a non-null batch. This simplifies life in the recursive case when the TreeReader doesn't have enough information to create the appropriate value.
* RecordReader.nextBatch now returns a boolean so that it is easy to embed as the loop condition.
* ORC's SchemaEvolution can handle adding or removing columns from the end of internal structs.
* Created tree readers for union, list, and map types.
* TreeReader.nextVector now takes an isNull mask since it can cascade from the outer structs.
* A new TreeReader fills in null values for null columns caused by schema evolution.
* The TimestampTreeReader does not use the row by row reader internally.
* The TreeReaderFactory now gets the file & reader types.
* TestVectorOrcFile now uses the vectorized reader exclusively.
* The reader passes down the TypeDescription for the file to the RecordReader.
* TypeDescription can now be placed into hash tables.


> Create vectorized readers for the complex types
> -----------------------------------------------
>
>                 Key: HIVE-12159
>                 URL: https://issues.apache.org/jira/browse/HIVE-12159
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: HIVE-12159.patch
>
>
> We need vectorized readers for the complex types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)