[jira] Commented: (HIVE-1540) Read-only, columnar data file for nested data structures

["Joydeep Sen Sarma (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899199#action_12899199 ] 

Joydeep Sen Sarma commented on HIVE-1540:
-----------------------------------------

are there a lot of use cases for nested data structures? Google's approach is motivated by widespread use of Protocol Buffers. At Facebook - thrift serialized data sets (that motivated the initial support for nested data types) hasn't taken off.

I think what's much more common is json serialized data (or map types more restrictively). it would be much more worthwhile, to begin with, to have optimized codecs and deserializers for map types.

> Read-only, columnar data file for nested data structures
> --------------------------------------------------------
>
>                 Key: HIVE-1540
>                 URL: https://issues.apache.org/jira/browse/HIVE-1540
>             Project: Hadoop Hive
>          Issue Type: New Feature
>            Reporter: Jeff Hammerbacher
>
> RCFile is a great start on an optimized layout for working with structured data with Hive. Given that Hive's data model supports nested lists and maps, and taking inspiration from the recent work by Google on Dremel, it may be useful for the Hive community to think about how to improve the RCFile format for nested data structures.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.