You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2013/01/07 23:42:16 UTC

[jira] [Comment Edited] (HIVE-3585) Integrate Trevni as another columnar oriented file format

    [ https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13546348#comment-13546348 ] 

He Yongqiang edited comment on HIVE-3585 at 1/7/13 10:40 PM:
-------------------------------------------------------------

contrib is a good place for any projects that is not mature. There are so many custom data formats out there, it does not make sense to support all of them in core hive code base. contrib is a good place for them to grow. 

>From http://incubator.apache.org/hcatalog/docs/r0.4.0/, another good place i can think of is the hcatalog project. But i don't know if hcatalog itself includes custom data format support or not.
                
      was (Author: he yongqiang):
    contrib is a good place for any projects that is not mature. There are so many custom data formats out there, it does not make sense to support all of them in core hive code base. contrib is a good place for them to grow. 

Another good place i can think of is the hcatalog project.  

                  
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
>                 Key: HIVE-3585
>                 URL: https://issues.apache.org/jira/browse/HIVE-3585
>             Project: Hive
>          Issue Type: Improvement
>          Components: Serializers/Deserializers
>    Affects Versions: 0.10.0
>            Reporter: alex gemini
>            Assignee: Mark Wagner
>            Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format need a columnar SerDe,seems fastutil is a good choice.the shark project use fastutil library as columnar serde library but it seems too large (almost 15m) for just a few primitive array collection.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira