Usage of Flume in JAVA code

[Nithesh Kb <ni...@gmail.com>]

Hi Flume Masters,
I'm new to flume please help me to get some idea on this query.
I saw in Apache developers guide that

'' Specifically the source used is a special embedded source and events
should be send to the source via the put, putAll methods on the
EmbeddedAgent object"

suppose if i want to use exec as source and roll_file as sink, how do i
configure this in JAVA code ?

Thanks,
Nithesh

Re: Usage of Flume in JAVA code

[Johny Rufus <jr...@cloudera.com>]

yes,  you can find additional details on configuring and starting the agent
here - https://cwiki.apache.org/confluence/display/FLUME/Getting+Started

Thanks,
Rufus

On Wed, Jun 17, 2015 at 9:11 AM, Nithesh Kb <ni...@gmail.com> wrote:

> Thanks Rufus for your reply.
>
> So i think, i need have a script to start flume agent in this case rite ?
>
>  Thanks,
> Nithesh
>
> On Wed, Jun 17, 2015 at 3:54 AM, Johny Rufus <jr...@cloudera.com> wrote:
>
>> An embedded agent only supports Embedded source/Avro sink combination, as
>> it is mainly used to send data generated by an application to a next level
>> flume agent running Avro source.
>> For your case, you need to setup a Flume agent configured with an exec
>> source and roll file sink. (as the data is generated by a command which you
>> are executing and not by your java application )
>>
>> Thanks,
>> Rufus
>>
>> On Tue, Jun 16, 2015 at 11:14 AM, Nithesh Kb <ni...@gmail.com>
>> wrote:
>>
>>> Hi Flume Masters,
>>> I'm new to flume please help me to get some idea on this query.
>>> I saw in Apache developers guide that
>>>
>>> '' Specifically the source used is a special embedded source and events
>>> should be send to the source via the put, putAll methods on the
>>> EmbeddedAgent object"
>>>
>>> suppose if i want to use exec as source and roll_file as sink, how do i
>>> configure this in JAVA code ?
>>>
>>> Thanks,
>>> Nithesh
>>>
>>
>>
>

Re: Usage of Flume in JAVA code

[Nithesh Kb <ni...@gmail.com>]

Thanks Rufus for your reply.

So i think, i need have a script to start flume agent in this case rite ?

 Thanks,
Nithesh

On Wed, Jun 17, 2015 at 3:54 AM, Johny Rufus <jr...@cloudera.com> wrote:

> An embedded agent only supports Embedded source/Avro sink combination, as
> it is mainly used to send data generated by an application to a next level
> flume agent running Avro source.
> For your case, you need to setup a Flume agent configured with an exec
> source and roll file sink. (as the data is generated by a command which you
> are executing and not by your java application )
>
> Thanks,
> Rufus
>
> On Tue, Jun 16, 2015 at 11:14 AM, Nithesh Kb <ni...@gmail.com>
> wrote:
>
>> Hi Flume Masters,
>> I'm new to flume please help me to get some idea on this query.
>> I saw in Apache developers guide that
>>
>> '' Specifically the source used is a special embedded source and events
>> should be send to the source via the put, putAll methods on the
>> EmbeddedAgent object"
>>
>> suppose if i want to use exec as source and roll_file as sink, how do i
>> configure this in JAVA code ?
>>
>> Thanks,
>> Nithesh
>>
>
>

Re: Usage of Flume in JAVA code

[Johny Rufus <jr...@cloudera.com>]

An embedded agent only supports Embedded source/Avro sink combination, as
it is mainly used to send data generated by an application to a next level
flume agent running Avro source.
For your case, you need to setup a Flume agent configured with an exec
source and roll file sink. (as the data is generated by a command which you
are executing and not by your java application )

Thanks,
Rufus

On Tue, Jun 16, 2015 at 11:14 AM, Nithesh Kb <ni...@gmail.com> wrote:

> Hi Flume Masters,
> I'm new to flume please help me to get some idea on this query.
> I saw in Apache developers guide that
>
> '' Specifically the source used is a special embedded source and events
> should be send to the source via the put, putAll methods on the
> EmbeddedAgent object"
>
> suppose if i want to use exec as source and roll_file as sink, how do i
> configure this in JAVA code ?
>
> Thanks,
> Nithesh
>