You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by WangRamon <ra...@hotmail.com> on 2012/09/06 10:32:56 UTC
Is there a way to get notificaiton when the job is failed?
Hi Guys Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion. CheersRamon
Re: Is there a way to get notificaiton when the job is failed?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
We can reopen it if we wish it to be fixed in 1.0.
Thanks,
+Vinod
On Sep 6, 2012, at 4:49 AM, Rajiv Chittajallu wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
>> ________________________________
>> From: Hemanth Yamijala <yh...@thoughtworks.com>
>> To: user@hadoop.apache.org
>> Sent: Thursday, September 6, 2012 2:53 AM
>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>
>>
>> Hi,
>>
>>
>> I just tried it out on 1.0.x. It works fine.
>>
>>
>> Thanks
>> Hemanth
>>
>>
>> On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>> Hi hemanth
>>>
>>> Does it support Hadoop version 1.0.0? Thanks
>>>
>>> Cheers
>>> Ramon
>>>
>>>
>>>
>>> ________________________________
>>> Date: Thu, 6 Sep 2012 14:43:45 +0530
>>>
>>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>> From: yhemanth@thoughtworks.com
>>> To: user@hadoop.apache.org
>>>
>>>
>>> Hi,
>>>
>>>
>>> There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>>
>>>
>>> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>>
>>>
>>> The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>>
>>>
>>> Thanks
>>> hemanth
>>>
>>>
>>> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>>
>>> Hi Guys
>>>>
>>>> Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>>
>>>> Cheers
>>>> Ramon
>>>>
>>>>
>>>>
>>>
>>
>>
>>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
We can reopen it if we wish it to be fixed in 1.0.
Thanks,
+Vinod
On Sep 6, 2012, at 4:49 AM, Rajiv Chittajallu wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
>> ________________________________
>> From: Hemanth Yamijala <yh...@thoughtworks.com>
>> To: user@hadoop.apache.org
>> Sent: Thursday, September 6, 2012 2:53 AM
>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>
>>
>> Hi,
>>
>>
>> I just tried it out on 1.0.x. It works fine.
>>
>>
>> Thanks
>> Hemanth
>>
>>
>> On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>> Hi hemanth
>>>
>>> Does it support Hadoop version 1.0.0? Thanks
>>>
>>> Cheers
>>> Ramon
>>>
>>>
>>>
>>> ________________________________
>>> Date: Thu, 6 Sep 2012 14:43:45 +0530
>>>
>>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>> From: yhemanth@thoughtworks.com
>>> To: user@hadoop.apache.org
>>>
>>>
>>> Hi,
>>>
>>>
>>> There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>>
>>>
>>> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>>
>>>
>>> The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>>
>>>
>>> Thanks
>>> hemanth
>>>
>>>
>>> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>>
>>> Hi Guys
>>>>
>>>> Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>>
>>>> Cheers
>>>> Ramon
>>>>
>>>>
>>>>
>>>
>>
>>
>>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
We can reopen it if we wish it to be fixed in 1.0.
Thanks,
+Vinod
On Sep 6, 2012, at 4:49 AM, Rajiv Chittajallu wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
>> ________________________________
>> From: Hemanth Yamijala <yh...@thoughtworks.com>
>> To: user@hadoop.apache.org
>> Sent: Thursday, September 6, 2012 2:53 AM
>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>
>>
>> Hi,
>>
>>
>> I just tried it out on 1.0.x. It works fine.
>>
>>
>> Thanks
>> Hemanth
>>
>>
>> On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>> Hi hemanth
>>>
>>> Does it support Hadoop version 1.0.0? Thanks
>>>
>>> Cheers
>>> Ramon
>>>
>>>
>>>
>>> ________________________________
>>> Date: Thu, 6 Sep 2012 14:43:45 +0530
>>>
>>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>> From: yhemanth@thoughtworks.com
>>> To: user@hadoop.apache.org
>>>
>>>
>>> Hi,
>>>
>>>
>>> There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>>
>>>
>>> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>>
>>>
>>> The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>>
>>>
>>> Thanks
>>> hemanth
>>>
>>>
>>> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>>
>>> Hi Guys
>>>>
>>>> Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>>
>>>> Cheers
>>>> Ramon
>>>>
>>>>
>>>>
>>>
>>
>>
>>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi Rajiv,
Thanks for the heads-up ....
Looking at the JIRA, the gist is that with Hadoop 1.x, a badly configured
job (like with short retry interval and/or large number of retries) that
continuously fail (like a problematic web server or app) could potentially
block notifications of other jobs. Hence, is risky to use in general.
Hope Ramon will take this into account as well, if deciding to go down this
path.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 5:19 PM, Rajiv Chittajallu <ra...@yahoo-inc.com>wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688
> Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
> >________________________________
> > From: Hemanth Yamijala <yh...@thoughtworks.com>
> >To: user@hadoop.apache.org
> >Sent: Thursday, September 6, 2012 2:53 AM
> >Subject: Re: Is there a way to get notificaiton when the job is failed?
> >
> >
> >Hi,
> >
> >
> >I just tried it out on 1.0.x. It works fine.
> >
> >
> >Thanks
> >Hemanth
> >
> >
> >On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> >
> >Hi hemanth
> >>
> >>Does it support Hadoop version 1.0.0? Thanks
> >>
> >>Cheers
> >>Ramon
> >>
> >>
> >>
> >>________________________________
> >>Date: Thu, 6 Sep 2012 14:43:45 +0530
> >>
> >>Subject: Re: Is there a way to get notificaiton when the job is failed?
> >>From: yhemanth@thoughtworks.com
> >>To: user@hadoop.apache.org
> >>
> >>
> >>Hi,
> >>
> >>
> >>There is a provision to get job end notifications for a mapreduce job
> via an HTTP call. You have to set a parameter called
> job.end.notification.url to a http address in your Job's configuration. Or
> if the job implements the Tool interface it can be passed directly from
> command line without having to modify the job, like so:
> >>
> >>
> >>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
> >>
> >>
> >>The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
> >>
> >>
> >>Thanks
> >>hemanth
> >>
> >>
> >>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com>
> wrote:
> >>
> >>Hi Guys
> >>>
> >>>Is there some 3rd party monitor tool that i can use to monitor the
> hadoop cluster, especially that i can get a notification/email when there
> is a job failed? Thanks for any suggestion.
> >>>
> >>>Cheers
> >>>Ramon
> >>>
> >>>
> >>>
> >>
> >
> >
> >
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
We can reopen it if we wish it to be fixed in 1.0.
Thanks,
+Vinod
On Sep 6, 2012, at 4:49 AM, Rajiv Chittajallu wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
>> ________________________________
>> From: Hemanth Yamijala <yh...@thoughtworks.com>
>> To: user@hadoop.apache.org
>> Sent: Thursday, September 6, 2012 2:53 AM
>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>
>>
>> Hi,
>>
>>
>> I just tried it out on 1.0.x. It works fine.
>>
>>
>> Thanks
>> Hemanth
>>
>>
>> On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>> Hi hemanth
>>>
>>> Does it support Hadoop version 1.0.0? Thanks
>>>
>>> Cheers
>>> Ramon
>>>
>>>
>>>
>>> ________________________________
>>> Date: Thu, 6 Sep 2012 14:43:45 +0530
>>>
>>> Subject: Re: Is there a way to get notificaiton when the job is failed?
>>> From: yhemanth@thoughtworks.com
>>> To: user@hadoop.apache.org
>>>
>>>
>>> Hi,
>>>
>>>
>>> There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>>
>>>
>>> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>>
>>>
>>> The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>>
>>>
>>> Thanks
>>> hemanth
>>>
>>>
>>> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>>
>>> Hi Guys
>>>>
>>>> Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>>
>>>> Cheers
>>>> Ramon
>>>>
>>>>
>>>>
>>>
>>
>>
>>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi Rajiv,
Thanks for the heads-up ....
Looking at the JIRA, the gist is that with Hadoop 1.x, a badly configured
job (like with short retry interval and/or large number of retries) that
continuously fail (like a problematic web server or app) could potentially
block notifications of other jobs. Hence, is risky to use in general.
Hope Ramon will take this into account as well, if deciding to go down this
path.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 5:19 PM, Rajiv Chittajallu <ra...@yahoo-inc.com>wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688
> Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
> >________________________________
> > From: Hemanth Yamijala <yh...@thoughtworks.com>
> >To: user@hadoop.apache.org
> >Sent: Thursday, September 6, 2012 2:53 AM
> >Subject: Re: Is there a way to get notificaiton when the job is failed?
> >
> >
> >Hi,
> >
> >
> >I just tried it out on 1.0.x. It works fine.
> >
> >
> >Thanks
> >Hemanth
> >
> >
> >On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> >
> >Hi hemanth
> >>
> >>Does it support Hadoop version 1.0.0? Thanks
> >>
> >>Cheers
> >>Ramon
> >>
> >>
> >>
> >>________________________________
> >>Date: Thu, 6 Sep 2012 14:43:45 +0530
> >>
> >>Subject: Re: Is there a way to get notificaiton when the job is failed?
> >>From: yhemanth@thoughtworks.com
> >>To: user@hadoop.apache.org
> >>
> >>
> >>Hi,
> >>
> >>
> >>There is a provision to get job end notifications for a mapreduce job
> via an HTTP call. You have to set a parameter called
> job.end.notification.url to a http address in your Job's configuration. Or
> if the job implements the Tool interface it can be passed directly from
> command line without having to modify the job, like so:
> >>
> >>
> >>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
> >>
> >>
> >>The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
> >>
> >>
> >>Thanks
> >>hemanth
> >>
> >>
> >>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com>
> wrote:
> >>
> >>Hi Guys
> >>>
> >>>Is there some 3rd party monitor tool that i can use to monitor the
> hadoop cluster, especially that i can get a notification/email when there
> is a job failed? Thanks for any suggestion.
> >>>
> >>>Cheers
> >>>Ramon
> >>>
> >>>
> >>>
> >>
> >
> >
> >
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi Rajiv,
Thanks for the heads-up ....
Looking at the JIRA, the gist is that with Hadoop 1.x, a badly configured
job (like with short retry interval and/or large number of retries) that
continuously fail (like a problematic web server or app) could potentially
block notifications of other jobs. Hence, is risky to use in general.
Hope Ramon will take this into account as well, if deciding to go down this
path.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 5:19 PM, Rajiv Chittajallu <ra...@yahoo-inc.com>wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688
> Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
> >________________________________
> > From: Hemanth Yamijala <yh...@thoughtworks.com>
> >To: user@hadoop.apache.org
> >Sent: Thursday, September 6, 2012 2:53 AM
> >Subject: Re: Is there a way to get notificaiton when the job is failed?
> >
> >
> >Hi,
> >
> >
> >I just tried it out on 1.0.x. It works fine.
> >
> >
> >Thanks
> >Hemanth
> >
> >
> >On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> >
> >Hi hemanth
> >>
> >>Does it support Hadoop version 1.0.0? Thanks
> >>
> >>Cheers
> >>Ramon
> >>
> >>
> >>
> >>________________________________
> >>Date: Thu, 6 Sep 2012 14:43:45 +0530
> >>
> >>Subject: Re: Is there a way to get notificaiton when the job is failed?
> >>From: yhemanth@thoughtworks.com
> >>To: user@hadoop.apache.org
> >>
> >>
> >>Hi,
> >>
> >>
> >>There is a provision to get job end notifications for a mapreduce job
> via an HTTP call. You have to set a parameter called
> job.end.notification.url to a http address in your Job's configuration. Or
> if the job implements the Tool interface it can be passed directly from
> command line without having to modify the job, like so:
> >>
> >>
> >>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
> >>
> >>
> >>The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
> >>
> >>
> >>Thanks
> >>hemanth
> >>
> >>
> >>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com>
> wrote:
> >>
> >>Hi Guys
> >>>
> >>>Is there some 3rd party monitor tool that i can use to monitor the
> hadoop cluster, especially that i can get a notification/email when there
> is a job failed? Thanks for any suggestion.
> >>>
> >>>Cheers
> >>>Ramon
> >>>
> >>>
> >>>
> >>
> >
> >
> >
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi Rajiv,
Thanks for the heads-up ....
Looking at the JIRA, the gist is that with Hadoop 1.x, a badly configured
job (like with short retry interval and/or large number of retries) that
continuously fail (like a problematic web server or app) could potentially
block notifications of other jobs. Hence, is risky to use in general.
Hope Ramon will take this into account as well, if deciding to go down this
path.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 5:19 PM, Rajiv Chittajallu <ra...@yahoo-inc.com>wrote:
> Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688
> Not sure why its closed as dupe of an yarn feature.
>
>
> (hey hemanth, welcome back..)
>
> >________________________________
> > From: Hemanth Yamijala <yh...@thoughtworks.com>
> >To: user@hadoop.apache.org
> >Sent: Thursday, September 6, 2012 2:53 AM
> >Subject: Re: Is there a way to get notificaiton when the job is failed?
> >
> >
> >Hi,
> >
> >
> >I just tried it out on 1.0.x. It works fine.
> >
> >
> >Thanks
> >Hemanth
> >
> >
> >On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> >
> >Hi hemanth
> >>
> >>Does it support Hadoop version 1.0.0? Thanks
> >>
> >>Cheers
> >>Ramon
> >>
> >>
> >>
> >>________________________________
> >>Date: Thu, 6 Sep 2012 14:43:45 +0530
> >>
> >>Subject: Re: Is there a way to get notificaiton when the job is failed?
> >>From: yhemanth@thoughtworks.com
> >>To: user@hadoop.apache.org
> >>
> >>
> >>Hi,
> >>
> >>
> >>There is a provision to get job end notifications for a mapreduce job
> via an HTTP call. You have to set a parameter called
> job.end.notification.url to a http address in your Job's configuration. Or
> if the job implements the Tool interface it can be passed directly from
> command line without having to modify the job, like so:
> >>
> >>
> >>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
> >>
> >>
> >>The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
> >>
> >>
> >>Thanks
> >>hemanth
> >>
> >>
> >>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com>
> wrote:
> >>
> >>Hi Guys
> >>>
> >>>Is there some 3rd party monitor tool that i can use to monitor the
> hadoop cluster, especially that i can get a notification/email when there
> is a job failed? Thanks for any suggestion.
> >>>
> >>>Cheers
> >>>Ramon
> >>>
> >>>
> >>>
> >>
> >
> >
> >
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Rajiv Chittajallu <ra...@yahoo-inc.com>.
Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
(hey hemanth, welcome back..)
>________________________________
> From: Hemanth Yamijala <yh...@thoughtworks.com>
>To: user@hadoop.apache.org
>Sent: Thursday, September 6, 2012 2:53 AM
>Subject: Re: Is there a way to get notificaiton when the job is failed?
>
>
>Hi,
>
>
>I just tried it out on 1.0.x. It works fine.
>
>
>Thanks
>Hemanth
>
>
>On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>
>Hi hemanth
>>
>>Does it support Hadoop version 1.0.0? Thanks
>>
>>Cheers
>>Ramon
>>
>>
>>
>>________________________________
>>Date: Thu, 6 Sep 2012 14:43:45 +0530
>>
>>Subject: Re: Is there a way to get notificaiton when the job is failed?
>>From: yhemanth@thoughtworks.com
>>To: user@hadoop.apache.org
>>
>>
>>Hi,
>>
>>
>>There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>
>>
>>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>
>>
>>The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>
>>
>>Thanks
>>hemanth
>>
>>
>>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>>Hi Guys
>>>
>>>Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>
>>>Cheers
>>>Ramon
>>>
>>>
>>>
>>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Rajiv Chittajallu <ra...@yahoo-inc.com>.
Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
(hey hemanth, welcome back..)
>________________________________
> From: Hemanth Yamijala <yh...@thoughtworks.com>
>To: user@hadoop.apache.org
>Sent: Thursday, September 6, 2012 2:53 AM
>Subject: Re: Is there a way to get notificaiton when the job is failed?
>
>
>Hi,
>
>
>I just tried it out on 1.0.x. It works fine.
>
>
>Thanks
>Hemanth
>
>
>On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>
>Hi hemanth
>>
>>Does it support Hadoop version 1.0.0? Thanks
>>
>>Cheers
>>Ramon
>>
>>
>>
>>________________________________
>>Date: Thu, 6 Sep 2012 14:43:45 +0530
>>
>>Subject: Re: Is there a way to get notificaiton when the job is failed?
>>From: yhemanth@thoughtworks.com
>>To: user@hadoop.apache.org
>>
>>
>>Hi,
>>
>>
>>There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>
>>
>>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>
>>
>>The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>
>>
>>Thanks
>>hemanth
>>
>>
>>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>>Hi Guys
>>>
>>>Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>
>>>Cheers
>>>Ramon
>>>
>>>
>>>
>>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Rajiv Chittajallu <ra...@yahoo-inc.com>.
Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
(hey hemanth, welcome back..)
>________________________________
> From: Hemanth Yamijala <yh...@thoughtworks.com>
>To: user@hadoop.apache.org
>Sent: Thursday, September 6, 2012 2:53 AM
>Subject: Re: Is there a way to get notificaiton when the job is failed?
>
>
>Hi,
>
>
>I just tried it out on 1.0.x. It works fine.
>
>
>Thanks
>Hemanth
>
>
>On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>
>Hi hemanth
>>
>>Does it support Hadoop version 1.0.0? Thanks
>>
>>Cheers
>>Ramon
>>
>>
>>
>>________________________________
>>Date: Thu, 6 Sep 2012 14:43:45 +0530
>>
>>Subject: Re: Is there a way to get notificaiton when the job is failed?
>>From: yhemanth@thoughtworks.com
>>To: user@hadoop.apache.org
>>
>>
>>Hi,
>>
>>
>>There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>
>>
>>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>
>>
>>The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>
>>
>>Thanks
>>hemanth
>>
>>
>>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>>Hi Guys
>>>
>>>Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>
>>>Cheers
>>>Ramon
>>>
>>>
>>>
>>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Rajiv Chittajallu <ra...@yahoo-inc.com>.
Notifications are sequential and doesn't have timeouts - MAPREDUCE-1688 Not sure why its closed as dupe of an yarn feature.
(hey hemanth, welcome back..)
>________________________________
> From: Hemanth Yamijala <yh...@thoughtworks.com>
>To: user@hadoop.apache.org
>Sent: Thursday, September 6, 2012 2:53 AM
>Subject: Re: Is there a way to get notificaiton when the job is failed?
>
>
>Hi,
>
>
>I just tried it out on 1.0.x. It works fine.
>
>
>Thanks
>Hemanth
>
>
>On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
>
>Hi hemanth
>>
>>Does it support Hadoop version 1.0.0? Thanks
>>
>>Cheers
>>Ramon
>>
>>
>>
>>________________________________
>>Date: Thu, 6 Sep 2012 14:43:45 +0530
>>
>>Subject: Re: Is there a way to get notificaiton when the job is failed?
>>From: yhemanth@thoughtworks.com
>>To: user@hadoop.apache.org
>>
>>
>>Hi,
>>
>>
>>There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
>>
>>
>>hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
>>
>>
>>The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
>>
>>
>>Thanks
>>hemanth
>>
>>
>>On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>>
>>Hi Guys
>>>
>>>Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
>>>
>>>Cheers
>>>Ramon
>>>
>>>
>>>
>>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
I just tried it out on 1.0.x. It works fine.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi hemanth
>
> Does it support Hadoop version 1.0.0? Thanks
>
> Cheers
> Ramon
>
> ------------------------------
> Date: Thu, 6 Sep 2012 14:43:45 +0530
>
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Hi,
>
> There is a provision to get job end notifications for a mapreduce job via
> an HTTP call. You have to set a parameter called job.end.notification.url
> to a http address in your Job's configuration. Or if the job implements the
> Tool interface it can be passed directly from command line without having
> to modify the job, like so:
>
> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
>
> The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
>
> Thanks
> hemanth
>
> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
I just tried it out on 1.0.x. It works fine.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi hemanth
>
> Does it support Hadoop version 1.0.0? Thanks
>
> Cheers
> Ramon
>
> ------------------------------
> Date: Thu, 6 Sep 2012 14:43:45 +0530
>
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Hi,
>
> There is a provision to get job end notifications for a mapreduce job via
> an HTTP call. You have to set a parameter called job.end.notification.url
> to a http address in your Job's configuration. Or if the job implements the
> Tool interface it can be passed directly from command line without having
> to modify the job, like so:
>
> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
>
> The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
>
> Thanks
> hemanth
>
> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
I just tried it out on 1.0.x. It works fine.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi hemanth
>
> Does it support Hadoop version 1.0.0? Thanks
>
> Cheers
> Ramon
>
> ------------------------------
> Date: Thu, 6 Sep 2012 14:43:45 +0530
>
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Hi,
>
> There is a provision to get job end notifications for a mapreduce job via
> an HTTP call. You have to set a parameter called job.end.notification.url
> to a http address in your Job's configuration. Or if the job implements the
> Tool interface it can be passed directly from command line without having
> to modify the job, like so:
>
> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
>
> The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
>
> Thanks
> hemanth
>
> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
I just tried it out on 1.0.x. It works fine.
Thanks
Hemanth
On Thu, Sep 6, 2012 at 2:56 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi hemanth
>
> Does it support Hadoop version 1.0.0? Thanks
>
> Cheers
> Ramon
>
> ------------------------------
> Date: Thu, 6 Sep 2012 14:43:45 +0530
>
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Hi,
>
> There is a provision to get job end notifications for a mapreduce job via
> an HTTP call. You have to set a parameter called job.end.notification.url
> to a http address in your Job's configuration. Or if the job implements the
> Tool interface it can be passed directly from command line without having
> to modify the job, like so:
>
> hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url>
> ...
>
> The URL can contain two special strings $jobId and $jobStatus which will
> be replaced with the actual values for the job. Then, your web application
> can implement any notification as required.
>
> Thanks
> hemanth
>
> On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
>
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
>
>
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi hemanth Does it support Hadoop version 1.0.0? Thanks CheersRamon
Date: Thu, 6 Sep 2012 14:43:45 +0530
Subject: Re: Is there a way to get notificaiton when the job is failed?
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Hi,
There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
Thankshemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
Hi Guys
Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
Cheers
Ramon
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi hemanth Does it support Hadoop version 1.0.0? Thanks CheersRamon
Date: Thu, 6 Sep 2012 14:43:45 +0530
Subject: Re: Is there a way to get notificaiton when the job is failed?
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Hi,
There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
Thankshemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
Hi Guys
Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
Cheers
Ramon
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi hemanth Does it support Hadoop version 1.0.0? Thanks CheersRamon
Date: Thu, 6 Sep 2012 14:43:45 +0530
Subject: Re: Is there a way to get notificaiton when the job is failed?
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Hi,
There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
Thankshemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
Hi Guys
Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
Cheers
Ramon
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi hemanth Does it support Hadoop version 1.0.0? Thanks CheersRamon
Date: Thu, 6 Sep 2012 14:43:45 +0530
Subject: Re: Is there a way to get notificaiton when the job is failed?
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Hi,
There is a provision to get job end notifications for a mapreduce job via an HTTP call. You have to set a parameter called job.end.notification.url to a http address in your Job's configuration. Or if the job implements the Tool interface it can be passed directly from command line without having to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be replaced with the actual values for the job. Then, your web application can implement any notification as required.
Thankshemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
Hi Guys
Is there some 3rd party monitor tool that i can use to monitor the hadoop cluster, especially that i can get a notification/email when there is a job failed? Thanks for any suggestion.
Cheers
Ramon
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
There is a provision to get job end notifications for a mapreduce job via
an HTTP call. You have to set a parameter called job.end.notification.url
to a http address in your Job's configuration. Or if the job implements the
Tool interface it can be passed directly from command line without having
to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be
replaced with the actual values for the job. Then, your web application can
implement any notification as required.
Thanks
hemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
There is a provision to get job end notifications for a mapreduce job via
an HTTP call. You have to set a parameter called job.end.notification.url
to a http address in your Job's configuration. Or if the job implements the
Tool interface it can be passed directly from command line without having
to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be
replaced with the actual values for the job. Then, your web application can
implement any notification as required.
Thanks
hemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
There is a provision to get job end notifications for a mapreduce job via
an HTTP call. You have to set a parameter called job.end.notification.url
to a http address in your Job's configuration. Or if the job implements the
Tool interface it can be passed directly from command line without having
to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be
replaced with the actual values for the job. Then, your web application can
implement any notification as required.
Thanks
hemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi Julien It's interesting, thanks, we will have a look at it. CheersRamon
> From: julien.muller@ezako.com
> Date: Thu, 6 Sep 2012 10:53:53 +0200
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> To: user@hadoop.apache.org
>
> Hi,
>
> We use oozie for this kind of notification. Not really a monitoring
> tool, it is a workflow system.
>
> http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
>
> Julien
>
> 2012/9/6 WangRamon <ra...@hotmail.com>:
> > Hi Guys
> >
> > Is there some 3rd party monitor tool that i can use to monitor the hadoop
> > cluster, especially that i can get a notification/email when there is a job
> > failed? Thanks for any suggestion.
> >
> > Cheers
> > Ramon
> >
> >
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi Julien It's interesting, thanks, we will have a look at it. CheersRamon
> From: julien.muller@ezako.com
> Date: Thu, 6 Sep 2012 10:53:53 +0200
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> To: user@hadoop.apache.org
>
> Hi,
>
> We use oozie for this kind of notification. Not really a monitoring
> tool, it is a workflow system.
>
> http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
>
> Julien
>
> 2012/9/6 WangRamon <ra...@hotmail.com>:
> > Hi Guys
> >
> > Is there some 3rd party monitor tool that i can use to monitor the hadoop
> > cluster, especially that i can get a notification/email when there is a job
> > failed? Thanks for any suggestion.
> >
> > Cheers
> > Ramon
> >
> >
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi Julien It's interesting, thanks, we will have a look at it. CheersRamon
> From: julien.muller@ezako.com
> Date: Thu, 6 Sep 2012 10:53:53 +0200
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> To: user@hadoop.apache.org
>
> Hi,
>
> We use oozie for this kind of notification. Not really a monitoring
> tool, it is a workflow system.
>
> http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
>
> Julien
>
> 2012/9/6 WangRamon <ra...@hotmail.com>:
> > Hi Guys
> >
> > Is there some 3rd party monitor tool that i can use to monitor the hadoop
> > cluster, especially that i can get a notification/email when there is a job
> > failed? Thanks for any suggestion.
> >
> > Cheers
> > Ramon
> >
> >
RE: Is there a way to get notificaiton when the job is failed?
Posted by WangRamon <ra...@hotmail.com>.
Hi Julien It's interesting, thanks, we will have a look at it. CheersRamon
> From: julien.muller@ezako.com
> Date: Thu, 6 Sep 2012 10:53:53 +0200
> Subject: Re: Is there a way to get notificaiton when the job is failed?
> To: user@hadoop.apache.org
>
> Hi,
>
> We use oozie for this kind of notification. Not really a monitoring
> tool, it is a workflow system.
>
> http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
>
> Julien
>
> 2012/9/6 WangRamon <ra...@hotmail.com>:
> > Hi Guys
> >
> > Is there some 3rd party monitor tool that i can use to monitor the hadoop
> > cluster, especially that i can get a notification/email when there is a job
> > failed? Thanks for any suggestion.
> >
> > Cheers
> > Ramon
> >
> >
Re: Is there a way to get notificaiton when the job is failed?
Posted by Julien Muller <ju...@ezako.com>.
Hi,
We use oozie for this kind of notification. Not really a monitoring
tool, it is a workflow system.
http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
Julien
2012/9/6 WangRamon <ra...@hotmail.com>:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Julien Muller <ju...@ezako.com>.
Hi,
We use oozie for this kind of notification. Not really a monitoring
tool, it is a workflow system.
http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
Julien
2012/9/6 WangRamon <ra...@hotmail.com>:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Julien Muller <ju...@ezako.com>.
Hi,
We use oozie for this kind of notification. Not really a monitoring
tool, it is a workflow system.
http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
Julien
2012/9/6 WangRamon <ra...@hotmail.com>:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,
There is a provision to get job end notifications for a mapreduce job via
an HTTP call. You have to set a parameter called job.end.notification.url
to a http address in your Job's configuration. Or if the job implements the
Tool interface it can be passed directly from command line without having
to modify the job, like so:
hadoop jar <jar-name> <class-name> -Djob.end.notification.url=<http-url> ...
The URL can contain two special strings $jobId and $jobStatus which will be
replaced with the actual values for the job. Then, your web application can
implement any notification as required.
Thanks
hemanth
On Thu, Sep 6, 2012 at 2:02 PM, WangRamon <ra...@hotmail.com> wrote:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>
>
Re: Is there a way to get notificaiton when the job is failed?
Posted by Julien Muller <ju...@ezako.com>.
Hi,
We use oozie for this kind of notification. Not really a monitoring
tool, it is a workflow system.
http://incubator.apache.org/oozie/docs/3.1.3/docs/DG_EmailActionExtension.html
Julien
2012/9/6 WangRamon <ra...@hotmail.com>:
> Hi Guys
>
> Is there some 3rd party monitor tool that i can use to monitor the hadoop
> cluster, especially that i can get a notification/email when there is a job
> failed? Thanks for any suggestion.
>
> Cheers
> Ramon
>
>