You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org> on 2011/11/03 06:13:33 UTC

[jira] [Commented] (FLUME-814) Add support for multiple channels to sources

    [ https://issues.apache.org/jira/browse/FLUME-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13142844#comment-13142844 ] 

jiraposter@reviews.apache.org commented on FLUME-814:
-----------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/2701/
-----------------------------------------------------------

Review request for Arvind Prabhakar and Eric Sammer.


Summary
-------

A new fanout channel is added that contains list of underlying channels and performs the given operation on all those. A new method added to channelfactory to create the fanout channel from a list of channels. One can specify a comma separated list of channels for a sink to create the fanout  


This addresses bug Flume-814.
    https://issues.apache.org/jira/browse/Flume-814


Diffs
-----

  flume-ng-core/src/main/java/org/apache/flume/ChannelFactory.java 23194a9 
  flume-ng-core/src/main/java/org/apache/flume/channel/DefaultChannelFactory.java a41085f 
  flume-ng-core/src/main/java/org/apache/flume/channel/FanoutChannel.java PRE-CREATION 
  flume-ng-core/src/test/java/org/apache/flume/channel/TestFanoutChannel.java PRE-CREATION 
  flume-ng-node/src/main/java/org/apache/flume/conf/properties/PropertiesFileConfigurationProvider.java 975eafd 
  flume-ng-node/src/main/java/org/apache/flume/node/Application.java 4004cba 

Diff: https://reviews.apache.org/r/2701/diff


Testing
-------

ran all unit tests, added new test for the fanout channel


Thanks,

Prasad


                
> Add support for multiple channels to sources
> --------------------------------------------
>
>                 Key: FLUME-814
>                 URL: https://issues.apache.org/jira/browse/FLUME-814
>             Project: Flume
>          Issue Type: New Feature
>          Components: Sinks+Sources
>    Affects Versions: NG alpha 1
>            Reporter: E. Sammer
>            Assignee: Prasad Mujumdar
>             Fix For: NG alpha 2
>
>
> Flume NG's architecture and configuration claim sources support multiple channels but this isn't currently true. The current implementation limits sources to a single channel which precludes fanout behavior.
> This will be a fairly invasive change as it impacts the Source interface.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira