[jira] [Commented] (FLUME-2430) Losing events with multiple agents flow

["Tigran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-2430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105280#comment-14105280 ] 

Tigran commented on FLUME-2430:
-------------------------------

Can you set-up metrics (https://flume.apache.org/FlumeUserGuide.html#json-reporting) and tell the result?

> Losing events with multiple agents flow
> ---------------------------------------
>
>                 Key: FLUME-2430
>                 URL: https://issues.apache.org/jira/browse/FLUME-2430
>             Project: Flume
>          Issue Type: Bug
>    Affects Versions: v1.5.0, v1.5.0.1
>         Environment: Win7 64bit, Cygwin
>            Reporter: Vitaly
>
> Not all events are delivered and persisted to file when using multi agent flow:
>   
> agent1.sources = avroSource1
> agent1.sinks = avroSync
> agent1.channels = memoryChannel
> agent1.sources.avroSource1.type = avro
> agent1.sources.avroSource1.bind = localhost
> agent1.sources.avroSource1.port = 41414
> agent1.sinks.avroSync.type = avro
> agent1.sinks.avroSync.hostname = localhost
> agent1.sinks.avroSync.port = 4444
> agent1.channels.memoryChannel.type = memory
> agent1.channels.memoryChannel.capacity = 10000
> agent1.channels.memoryChannel.transactionCapacity = 1000
> agent1.sources.avroSource1.channels = memoryChannel
> agent1.sinks.avroSync.channel = memoryChannel
> agent2.sources = avroSource
> agent2.sinks = fileRollSink 
> agent2.channels = memoryChannel
> agent2.sources.avroSource.type = avro
> agent2.sources.avroSource.bind = localhost
> agent2.sources.avroSource.port = 4444
> agent2.sinks.fileRollSink.type = file_roll
> agent2.sinks.fileRollSink.sink.directory = C:\\Users\\flume\\flumeFileAgent
> agent2.sinks.fileRollSink.sink.rollInterval=0
> agent2.channels.memoryChannel.type = memory
> agent2.channels.memoryChannel.capacity = 10000
> agent2.channels.memoryChannel.transactionCapacity = 1000
> agent2.sources.avroSource.channels = memoryChannel
> agent2.sinks.fileRollSink.channel = memoryChannel
> For example I am passing 1000 events to the first "agent1" but "agent2" doesn't receive from "agent1" all of them, only 800 or 700 are stored in file. No exceptions are thrown by flume agents.



--
This message was sent by Atlassian JIRA
(v6.2#6252)