You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Guy Doulberg <gu...@conduit.com> on 2012/07/10 17:21:23 UTC
"Dry" topics
Hi guys,
How do you monitor a topic, and alert if it has no messages for some time?
I would like to monitor a topic , and report to Nagios so I could get
an alert when something is wrong.
What do you think?
Re: "Dry" topics
Posted by Guy Doulberg <gu...@conduit.com>.
Hi guys,
I built a tool in my kafka tools repository that gets a topic a zookeepr
and file, and checks for each topic/partition if the topic is "DRY".
It basically writes to the file the current offsets in each broker, if
the combination of the (topic,broker,partition) existed in the file
prior to the run, it will compare the current offset of the
(topic,broker,partition) with the in the file (previous), if it didn't
got larger it will return the status stuck for this
(topic,broker,partition), otherwise (1. there was no file 2. the
(topic,broker,partition) was not reported 3. the value of the previous
(topic,broker,partition) is lesser than the current) it returns the
status OK
This output can be processed by a monitoring tool such as Nagios,
Thanks
On 07/11/2012 09:21 AM, Guy Doulberg wrote:
> I will do so,
> After I will do so, I will publish this code for anyone use
>
>
> On 07/10/2012 06:36 PM, Jun Rao wrote:
>> You can potentially build alerting using our tool ConsumerOffsetChecker.
>> See http://incubator.apache.org/kafka/faq.html on how to use the tool.
>>
>> Thanks,
>>
>> Jun
>>
>> On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <gu...@conduit.com>wrote:
>>
>>> Hi guys,
>>>
>>> How do you monitor a topic, and alert if it has no messages for some time?
>>>
>>> I would like to monitor a topic , and report to Nagios so I could get
>>> an alert when something is wrong.
>>>
>>>
>>> What do you think?
>>>
>>>
>>>
>
Re: "Dry" topics
Posted by Guy Doulberg <gu...@conduit.com>.
I will do so,
After I will do so, I will publish this code for anyone use
On 07/10/2012 06:36 PM, Jun Rao wrote:
> You can potentially build alerting using our tool ConsumerOffsetChecker.
> See http://incubator.apache.org/kafka/faq.html on how to use the tool.
>
> Thanks,
>
> Jun
>
> On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <gu...@conduit.com>wrote:
>
>> Hi guys,
>>
>> How do you monitor a topic, and alert if it has no messages for some time?
>>
>> I would like to monitor a topic , and report to Nagios so I could get
>> an alert when something is wrong.
>>
>>
>> What do you think?
>>
>>
>>
Re: "Dry" topics
Posted by Jun Rao <ju...@gmail.com>.
You can potentially build alerting using our tool ConsumerOffsetChecker.
See http://incubator.apache.org/kafka/faq.html on how to use the tool.
Thanks,
Jun
On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <gu...@conduit.com>wrote:
> Hi guys,
>
> How do you monitor a topic, and alert if it has no messages for some time?
>
> I would like to monitor a topic , and report to Nagios so I could get
> an alert when something is wrong.
>
>
> What do you think?
>
>
>