You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Jonathan <jo...@gmail.com> on 2011/09/19 22:46:39 UTC

Getting duplicates using Thrift and C# on Windows

Hi,

I have managed to get my .net app to send logs over the Flume into HDFS
(thanks Eran for your help). I am still getting duplicates, I am pretty sure
the reason is that the events are getting correctly logged to the tmp/sent
dir but they are never moving to the tmp/done dir. Is this a bug with the
windows implementation of flume or am I doing something wrong with how I am
interfacing with thrift?

Thanks for your help
Jonathan

Re: Getting duplicates using Thrift and C# on Windows

Posted by Eran Kutner <er...@gigya.com>.

I'm not sure but it may be related to the transmission mode you use. Try
using agentBEChain when sending to the collector.

-eran



On Mon, Sep 19, 2011 at 23:46, Jonathan <jo...@gmail.com> wrote:

> Hi,
>
> I have managed to get my .net app to send logs over the Flume into HDFS
> (thanks Eran for your help). I am still getting duplicates, I am pretty sure
> the reason is that the events are getting correctly logged to the tmp/sent
> dir but they are never moving to the tmp/done dir. Is this a bug with the
> windows implementation of flume or am I doing something wrong with how I am
> interfacing with thrift?
>
> Thanks for your help
> Jonathan
>