You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Goden YAO (JIRA)" <ji...@apache.org> on 2015/01/18 23:39:34 UTC

[jira] [Commented] (FLUME-1585) Document the load balancing sink processor

    [ https://issues.apache.org/jira/browse/FLUME-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14281988#comment-14281988 ] 

Goden YAO commented on FLUME-1585:
----------------------------------

Official documentation isn't clear about load_balance behavior vs. fail_over

Also there's no explanation about "default" behavior if processor.type=default or omitted in config file - the doc simply says default, it only chooses one sink, what if I have multiple sinks, which one does it choose? randomly?

> Document the load balancing sink processor
> ------------------------------------------
>
>                 Key: FLUME-1585
>                 URL: https://issues.apache.org/jira/browse/FLUME-1585
>             Project: Flume
>          Issue Type: Documentation
>            Reporter: Mike Percy
>            Assignee: Ashish Paliwal
>
> We need to document the load balancing sink processor, including backoff options.
> Example config:
> {noformat}
> # test file
> agent.channels = ch-0
> agent.sources = src-0
> agent.sinks = sink-0 sink-1 sink-2
> agent.sinkgroups = group-0
> agent.channels.ch-0.type = memory
> agent.channels.ch-0.capacity = 10000
> agent.sources.src-0.type = netcat
> agent.sources.src-0.channels = ch-0
> agent.sources.src-0.bind = 0.0.0.0
> agent.sources.src-0.port = 10002
> agent.sinkgroups.group-0.sinks = sink-0 sink-1 sink-2
> agent.sinkgroups.group-0.processor.type = load_balance
> agent.sinkgroups.group-0.processor.selector = round_robin
> agent.sinkgroups.group-0.processor.backoff = true
> agent.sinks.sink-0.type = avro
> agent.sinks.sink-0.channel = ch-0
> agent.sinks.sink-0.hostname = 127.0.0.1
> agent.sinks.sink-0.port = 999
> agent.sinks.sink-1.type = avro
> agent.sinks.sink-1.channel = ch-0
> agent.sinks.sink-1.hostname = 127.0.0.1
> agent.sinks.sink-1.port = 999
> agent.sinks.sink-2.type = logger
> agent.sinks.sink-2.channel = ch-0
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)