[jira] [Resolved] (FLUME-1150) Need a way to specify bucket in HDFSEventSink from client

["Mubarak Seyed (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLUME-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mubarak Seyed resolved FLUME-1150.
----------------------------------

    Resolution: Won't Fix

It is configuration related. We can use multiple channels or multiple HDFS sinks to create different buckets.
                
> Need a way to specify bucket in HDFSEventSink from client
> ---------------------------------------------------------
>
>                 Key: FLUME-1150
>                 URL: https://issues.apache.org/jira/browse/FLUME-1150
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>            Reporter: Mubarak Seyed
>
> We need a way to specify the bucket when event is streamed from client.
> For instance, if i have 5 different log categories (like category [1-5]), if i use single source->channel->hdfsSink then all the logs goes to one specified directory in HDFS (/logs/<destination>) but we need something like
> /logs/category1
>      /category2
>      /category3
>      /category4
>      /category5
> I can use multiplexing (1 source, N channel, and N sinks) but i need to use a multiplexing channel processor to route the events(categories) to the proper sink. 
> What i am thinking is if i specify the category name in header in Event, HDFSEventSink (and its helper classes) can create a bucket based on header value (and then escape-sequence needs to be honored). 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira