You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flume.apache.org by "Roshan Naik (JIRA)" <ji...@apache.org> on 2014/02/12 16:16:19 UTC

[jira] [Commented] (FLUME-1734) Create a HCatalog Sink

    [ https://issues.apache.org/jira/browse/FLUME-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899177#comment-13899177 ] 

Roshan Naik commented on FLUME-1734:
------------------------------------

Update: 
 The HCatalog based streaming support (HIVE-4196) in Hive has been abandoned in favor of a different approach (HIVE-5687) based on Hive native ACID transactions support.

So planning to rename this JIRA to "create a hive sink."

> Create a HCatalog Sink 
> -----------------------
>
>                 Key: FLUME-1734
>                 URL: https://issues.apache.org/jira/browse/FLUME-1734
>             Project: Flume
>          Issue Type: New Feature
>          Components: Sinks+Sources
>    Affects Versions: v1.2.0
>            Reporter: Roshan Naik
>            Assignee: Roshan Naik
>              Labels: features
>
> Create a sink that would stream data into HCatalog partitions. The primary goal being that once the data is loaded into Hadoop, it should be automatically queryable (using say Hive or Pig) without requiring additional post processing steps on behalf of the users. Sink should manage the creation of new partitions and committing them periodically. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)