You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hcatalog-commits@incubator.apache.org by "Alan Gates (JIRA)" <ji...@apache.org> on 2011/06/01 15:32:47 UTC

[jira] [Commented] (HCATALOG-36) Support Writing Out to Multiple Tables in HCatOutputFormat

    [ https://issues.apache.org/jira/browse/HCATALOG-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042235#comment-13042235 ] 

Alan Gates commented on HCATALOG-36:
------------------------------------

Writing to multiple partitions is slated for 0.2, see https://cwiki.apache.org/confluence/display/HCATALOG/HCatalogJournal  

I'd like to understand the use case for writing to multiple tables.  You want to be able to split the output stream to different tables as it's being written?  How would the split be determined?  Can you give me an example of a job that would want to do this?  Also, using Pig's split operator and HCatStorer this should already work in Pig.  Would an extending MultipleOutputFormat do what you want?

> Support Writing Out to Multiple Tables in HCatOutputFormat
> ----------------------------------------------------------
>
>                 Key: HCATALOG-36
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-36
>             Project: HCatalog
>          Issue Type: Improvement
>            Reporter: Ranjit Mathew
>         Attachments: multihcat.tgz
>
>
> HCatOutputFormat does not support writing out to multiple tables (or partitions for that matter).
> Add this support to HCatalog.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira