You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jordan Hambleton (JIRA)" <ji...@apache.org> on 2016/10/27 21:55:58 UTC

[jira] [Updated] (FLUME-2877) Add ability to configure avro sinks with a LoadBalancing RPC client

     [ https://issues.apache.org/jira/browse/FLUME-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jordan Hambleton updated FLUME-2877:
------------------------------------
    Issue Type: New Feature  (was: Bug)

> Add ability to configure avro sinks with a LoadBalancing RPC client
> -------------------------------------------------------------------
>
>                 Key: FLUME-2877
>                 URL: https://issues.apache.org/jira/browse/FLUME-2877
>             Project: Flume
>          Issue Type: New Feature
>          Components: Configuration, Sinks+Sources
>    Affects Versions: v1.5.0
>            Reporter: Jordan Hambleton
>
> In addition to load balancing sink groups, have the ability to utilize LoadBalancing RPC client as a sink. This minimizes configuration from n^2 to n sink specifications to enable load balancing. 
> A sample of what the configuration would look like would be the below.
> <agentName>.sinks.<sinkName>.channel = ch1
> <agentName>.sinks.<sinkName>.type = avro
> <agentName>.sinks.<sinkName>.client.type = default_loadbalance
> <agentName>.sinks.<sinkName>.hosts = h1 h2 h3
> <agentName>.sinks.<sinkName>.hosts.h1 = host1.domain.com:19211
> <agentName>.sinks.<sinkName>.hosts.h2 = host2.domain.com:19211
> <agentName>.sinks.<sinkName>.hosts.h3 = host3.domain.com:19211
> <agentName>.sinks.<sinkName>.host-selector = random
> <agentName>.sinks.<sinkName>.backoff = true
> <agentName>.sinks.<sinkName>.batch-size = 100
> <agentName>.sinks.<sinkName>.connect-timeout=30000
> <agentName>.sinks.<sinkName>.request-timeout=30000



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)