You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Mohit Anchlia <mo...@gmail.com> on 2012/06/07 02:40:30 UTC
syslog help
I need to record continuous flow of data with flume syslog source. However,
this data is coming from REST api using our REST service. Now how do I
write to syslog without writing to log4j? Essentially skip writing locally
and write to syslog node that flume is listening on. Is there an api I can
leverage for this?
Re: syslog help
Posted by Mohit Anchlia <mo...@gmail.com>.
Is there a maven repo I can use? It looks like all I need to do is use
NettyAvroRpcClient.
On Thu, Jun 7, 2012 at 6:53 AM, Mohit Anchlia <mo...@gmail.com>wrote:
>
>
> On Wed, Jun 6, 2012 at 10:09 PM, Mike Percy <mp...@cloudera.com> wrote:
>
>> On Wednesday, June 6, 2012 at 5:40 PM, Mohit Anchlia wrote:
>>
>> I need to record continuous flow of data with flume syslog source.
>> However, this data is coming from REST api using our REST service. Now how
>> do I write to syslog without writing to log4j? Essentially skip writing
>> locally and write to syslog node that flume is listening on. Is there an
>> api I can leverage for this?
>>
>> Why would you use syslog source if you aren't doing legacy integration
>> with an existing syslog client?
>>
>> If you are going to be writing code or modifying your system, consider
>> using the Flume Client SDK library to talk to Flume over the reliable Avro
>> RPC interface.
>>
>> i.e.
>> https://people.apache.org/~mpercy/flume/flume-1.2.0-incubating-SNAPSHOT/docs/FlumeDeveloperGuide.html#client
>>
>
> Thanks I'll take a look at it. I was suggested using syslog and it seemed
> like easiest way to write events. When data gets written I am assuming it's
> not in Avro serialized format but rather gets written as sequence of
> characters.
>
>>
>> Mike
>>
>>
>>
>
Re: syslog help
Posted by Mohit Anchlia <mo...@gmail.com>.
On Wed, Jun 6, 2012 at 10:09 PM, Mike Percy <mp...@cloudera.com> wrote:
> On Wednesday, June 6, 2012 at 5:40 PM, Mohit Anchlia wrote:
>
> I need to record continuous flow of data with flume syslog source.
> However, this data is coming from REST api using our REST service. Now how
> do I write to syslog without writing to log4j? Essentially skip writing
> locally and write to syslog node that flume is listening on. Is there an
> api I can leverage for this?
>
> Why would you use syslog source if you aren't doing legacy integration
> with an existing syslog client?
>
> If you are going to be writing code or modifying your system, consider
> using the Flume Client SDK library to talk to Flume over the reliable Avro
> RPC interface.
>
> i.e.
> https://people.apache.org/~mpercy/flume/flume-1.2.0-incubating-SNAPSHOT/docs/FlumeDeveloperGuide.html#client
>
Thanks I'll take a look at it. I was suggested using syslog and it seemed
like easiest way to write events. When data gets written I am assuming it's
not in Avro serialized format but rather gets written as sequence of
characters.
>
> Mike
>
>
>
Re: syslog help
Posted by Mike Percy <mp...@cloudera.com>.
On Wednesday, June 6, 2012 at 5:40 PM, Mohit Anchlia wrote:
> I need to record continuous flow of data with flume syslog source. However, this data is coming from REST api using our REST service. Now how do I write to syslog without writing to log4j? Essentially skip writing locally and write to syslog node that flume is listening on. Is there an api I can leverage for this?
>
Why would you use syslog source if you aren't doing legacy integration with an existing syslog client?
If you are going to be writing code or modifying your system, consider using the Flume Client SDK library to talk to Flume over the reliable Avro RPC interface.
i.e. https://people.apache.org/~mpercy/flume/flume-1.2.0-incubating-SNAPSHOT/docs/FlumeDeveloperGuide.html#client
Mike