[jira] [Issue Comment Edited] (CASSANDRA-2387) Make it possible for pig to understand packed data

["Jeremy Hanna (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13012300#comment-13012300 ] 

Jeremy Hanna edited comment on CASSANDRA-2387 at 3/29/11 1:00 AM:
------------------------------------------------------------------

The beginnings of getting it to work with packed data. Added a call to get the schema through thrift when the pig load is performed. Then it uses the udf context to get the schema when it needs to in columnToTuple (as part of getNext).

With this patch:
* only column values of type UTF8, int, and long are converted
* the comparator class for column names is not currently converted
* super columns' subcolumns do not deal with packed data

      was (Author: jeromatron):
    The beginnings of getting it to work with packed data. Added a call to get the schema through thrift when the pig load is performed. Then it uses the udf context to get the schema when it needs to in columnToTuple (as part of getNext).
  
> Make it possible for pig to understand packed data
> --------------------------------------------------
>
>                 Key: CASSANDRA-2387
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2387
>             Project: Cassandra
>          Issue Type: Improvement
>            Reporter: Jeremy Hanna
>            Assignee: Jeremy Hanna
>              Labels: contrib, hadoop, pig
>         Attachments: 2387-1.txt, loadstorecaster-patch.txt
>
>
> Packed values are throwing off pig. This ticket is to make it so pig can interpret packed values. Originally we thought we could just use a loadcaster.  However, the only way we know how we can do it now is to get the schema through thrift and essentially perform the function of the loadcaster in the getNext method.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira