You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jordan Hambleton (JIRA)" <ji...@apache.org> on 2016/10/27 21:55:58 UTC
[jira] [Updated] (FLUME-2877) Add ability to configure avro sinks
with a LoadBalancing RPC client
[ https://issues.apache.org/jira/browse/FLUME-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jordan Hambleton updated FLUME-2877:
------------------------------------
Issue Type: New Feature (was: Bug)
> Add ability to configure avro sinks with a LoadBalancing RPC client
> -------------------------------------------------------------------
>
> Key: FLUME-2877
> URL: https://issues.apache.org/jira/browse/FLUME-2877
> Project: Flume
> Issue Type: New Feature
> Components: Configuration, Sinks+Sources
> Affects Versions: v1.5.0
> Reporter: Jordan Hambleton
>
> In addition to load balancing sink groups, have the ability to utilize LoadBalancing RPC client as a sink. This minimizes configuration from n^2 to n sink specifications to enable load balancing.
> A sample of what the configuration would look like would be the below.
> <agentName>.sinks.<sinkName>.channel = ch1
> <agentName>.sinks.<sinkName>.type = avro
> <agentName>.sinks.<sinkName>.client.type = default_loadbalance
> <agentName>.sinks.<sinkName>.hosts = h1 h2 h3
> <agentName>.sinks.<sinkName>.hosts.h1 = host1.domain.com:19211
> <agentName>.sinks.<sinkName>.hosts.h2 = host2.domain.com:19211
> <agentName>.sinks.<sinkName>.hosts.h3 = host3.domain.com:19211
> <agentName>.sinks.<sinkName>.host-selector = random
> <agentName>.sinks.<sinkName>.backoff = true
> <agentName>.sinks.<sinkName>.batch-size = 100
> <agentName>.sinks.<sinkName>.connect-timeout=30000
> <agentName>.sinks.<sinkName>.request-timeout=30000
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)