calling avro RPC in a customized sink

[terreyshih <te...@gmail.com>]

Hi,

It seems to me that the intention of the flume is to be used for intermediate aggregation/processing of data which is to be dropped in some type of data storage.

However, what is preventing us from implementing a customized sink that talks to a remote program vic RPC (such as avro RPC)

Has anybody done this ?

thanks,
-terrey

Re: calling avro RPC in a customized sink

[terrey shih <te...@gmail.com>]

thanks. Sharninder


On Tue, Aug 12, 2014 at 1:26 AM, Sharninder <sh...@gmail.com> wrote:

> The purpose of a sink is to take events from a channel and pass it on to a
> further destination. That destination can be anything, including your
> another program listening on rpc.
>
>
>
> On Tue, Aug 12, 2014 at 1:26 PM, terreyshih <te...@gmail.com> wrote:
>
>> Hi,
>>
>> It seems to me that the intention of the flume is to be used for
>> intermediate aggregation/processing of data which is to be dropped in some
>> type of data storage.
>>
>> However, what is preventing us from implementing a customized sink that
>> talks to a remote program vic RPC (such as avro RPC)
>>
>> Has anybody done this ?
>>
>> thanks,
>> -terrey
>
>
>

Re: calling avro RPC in a customized sink

[Sharninder <sh...@gmail.com>]

The purpose of a sink is to take events from a channel and pass it on to a
further destination. That destination can be anything, including your
another program listening on rpc.


On Tue, Aug 12, 2014 at 1:26 PM, terreyshih <te...@gmail.com> wrote:

> Hi,
>
> It seems to me that the intention of the flume is to be used for
> intermediate aggregation/processing of data which is to be dropped in some
> type of data storage.
>
> However, what is preventing us from implementing a customized sink that
> talks to a remote program vic RPC (such as avro RPC)
>
> Has anybody done this ?
>
> thanks,
> -terrey