[jira] [Updated] (FLUME-1734) Create a Hive Sink based on the new Hive Streaming support

["Roshan Naik (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLUME-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roshan Naik updated FLUME-1734:
-------------------------------

    Attachment: FLUME-1734.v2.patch

Uploading new patch v2 :
 - fleshed out the tests some more
 - fixed issues related to recovering from intermittent HDFS and Hive failures.

> Create a Hive Sink based on the new Hive Streaming support
> ----------------------------------------------------------
>
>                 Key: FLUME-1734
>                 URL: https://issues.apache.org/jira/browse/FLUME-1734
>             Project: Flume
>          Issue Type: New Feature
>          Components: Sinks+Sources
>    Affects Versions: v1.2.0
>            Reporter: Roshan Naik
>            Assignee: Roshan Naik
>              Labels: features
>         Attachments: FLUME-1734.draft.1.patch, FLUME-1734.draft.2.patch, FLUME-1734.v1.patch, FLUME-1734.v2.patch
>
>
> Create a sink that would stream data into HCatalog partitions. The primary goal being that once the data is loaded into Hadoop, it should be automatically queryable (using say Hive or Pig) without requiring additional post processing steps on behalf of the users. Sink should manage the creation of new partitions and committing them periodically. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)