[jira] [Comment Edited] (HIVE-19214) High throughput ingest ORC format

["Prasanth Jayachandran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16445354#comment-16445354 ] 

Prasanth Jayachandran edited comment on HIVE-19214 at 4/20/18 5:54 AM:
-----------------------------------------------------------------------

Added the changes under config. 
PPD changes when no stripe stats are available for delta files.
LLAP IO changes to deal with no row indexes and hence no positional information (treat this as entire column read)
[~gopalv] can you please take another look? For streaming, will enable it by default in the new endpoint API.


was (Author: prasanth_j):
Added the changes under config. 
[~gopalv] can you please take another look? For streaming, will enable it by default in the new endpoint API.

> High throughput ingest ORC format
> ---------------------------------
>
>                 Key: HIVE-19214
>                 URL: https://issues.apache.org/jira/browse/HIVE-19214
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Streaming
>    Affects Versions: 3.0.0, 3.1.0
>            Reporter: Gopal V
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-19214.1.patch, HIVE-19214.2.patch, HIVE-19214.3.patch
>
>
> Create delta files with all ORC overhead disabled (no index, no compression, no dictionary). Compactor will recreate the orc files with index, compression and dictionary encoding.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)