You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Sanjath Shringeri <sa...@claritics.com> on 2013/06/18 02:09:53 UTC
In Flume-NG (1.3), is there a way to check the heartbeat on the http agent
I would like to point ELB to the flume agents having httpsource, I was not
sure how to check the heartbeat without sending an event.
--
___________________________________
Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence. Now.
408.796.1287 |
Re: In Flume-NG (1.3), is there a way to check the heartbeat on the
http agent
Posted by Ashish <pa...@gmail.com>.
Nope, adding extra node wouldn't serve the purpose. You need to enable HTTP
monitoring for each HTTP Source, as you mentioned.
My understanding is that you have client(s) which are fronted by ELB and
send HTTP data, consumed by HTTP Source. And you would like to have a
mechanism when to remove that source from ELB.
Here is the reference that might be of help
http://flume.apache.org/FlumeUserGuide.html#custom-reporting
On Tue, Jun 18, 2013 at 10:29 PM, Sanjath Shringeri
<sa...@claritics.com>wrote:
> Thanks. Any pointer on how to enable the http monitoring? I am bit
> confused on whether I should create an extra node in the topology just to
> make it work as http monitor or the node that has the http source can
> itself be enabled for http monitor. This section(
> http://flume.apache.org/FlumeUserGuide.html#monitoring) seem to indicate
> that a given node can be configured to talk to another node that acts as
> http monitor, right?
>
>
> On Mon, Jun 17, 2013 at 10:36 PM, Ashish <pa...@gmail.com> wrote:
>
>> FWIK, there is no direct way. However you can enable HTTP monitoring and
>> have your ELB point to the URL.
>> HTTP 200 Ok can be used to keep the HTTP source enabled in VIP.
>>
>> HTH !
>>
>>
>> On Tue, Jun 18, 2013 at 5:39 AM, Sanjath Shringeri <sanjath@claritics.com
>> > wrote:
>>
>>> I would like to point ELB to the flume agents having httpsource, I was
>>> not sure how to check the heartbeat without sending an event.
>>>
>>> --
>>> ___________________________________
>>> Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence.
>>> Now.
>>> 408.796.1287 |
>>>
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>
>
>
>
> --
> ___________________________________
> Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence. Now.
>
> 408.796.1287 |
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
Re: In Flume-NG (1.3), is there a way to check the heartbeat on the
http agent
Posted by Sanjath Shringeri <sa...@claritics.com>.
Thanks. Any pointer on how to enable the http monitoring? I am bit confused
on whether I should create an extra node in the topology just to make it
work as http monitor or the node that has the http source can itself be
enabled for http monitor. This section(
http://flume.apache.org/FlumeUserGuide.html#monitoring) seem to indicate
that a given node can be configured to talk to another node that acts as
http monitor, right?
On Mon, Jun 17, 2013 at 10:36 PM, Ashish <pa...@gmail.com> wrote:
> FWIK, there is no direct way. However you can enable HTTP monitoring and
> have your ELB point to the URL.
> HTTP 200 Ok can be used to keep the HTTP source enabled in VIP.
>
> HTH !
>
>
> On Tue, Jun 18, 2013 at 5:39 AM, Sanjath Shringeri <sa...@claritics.com>wrote:
>
>> I would like to point ELB to the flume agents having httpsource, I was
>> not sure how to check the heartbeat without sending an event.
>>
>> --
>> ___________________________________
>> Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence.
>> Now.
>> 408.796.1287 |
>>
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>
--
___________________________________
Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence. Now.
408.796.1287 |
Re: In Flume-NG (1.3), is there a way to check the heartbeat on the
http agent
Posted by Ashish <pa...@gmail.com>.
FWIK, there is no direct way. However you can enable HTTP monitoring and
have your ELB point to the URL.
HTTP 200 Ok can be used to keep the HTTP source enabled in VIP.
HTH !
On Tue, Jun 18, 2013 at 5:39 AM, Sanjath Shringeri <sa...@claritics.com>wrote:
> I would like to point ELB to the flume agents having httpsource, I was not
> sure how to check the heartbeat without sending an event.
>
> --
> ___________________________________
> Sanjath Shringeri | VP, Engineering | claritics | User. Intelligence. Now.
>
> 408.796.1287 |
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal