You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2016/06/22 16:01:04 UTC
Alerts
Hi,
Curious to know, do we have any alerting mechanism available with Apex like emails on application status and Data quality alerts..etc.. .??
Thanks.
Regards,
Raja.
Re: Alerts
Posted by David Yan <da...@datatorrent.com>.
Hi Raja,
Apache Apex itself does not have that capability. But if you're using
dtGateway in DataTorrent RTS, you have the following options:
1) Write your own program to poll dtGateway's REST API and write your logic
based on the return values and fire an alert email when certain conditions
are met.
2) Use the somewhat hidden "systemAlerts" feature of the dtGateway REST
API. Take a look at the REST API documentation here
http://docs.datatorrent.com/dtgateway_api/ and search for the "PUT
/ws/v2/systemAlerts/alerts/{name}". This will send out an email when a
condition is met, and the condition can be written in JavaScript using the
_topic object.
David
On Wed, Jun 22, 2016 at 9:01 AM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
> Hi,
>
> Curious to know, do we have any alerting mechanism available with Apex
> like emails on application status and Data quality alerts..etc.. .??
>
> Thanks.
>
>
> Regards,
> Raja.
Re: Alerts
Posted by "Raja.Aravapalli" <Ra...@target.com>.
Thanks for the response Thomas.
Just a thought to share, I heard about "StreamSet", which is also a streaming data ingestion platform, which does support this style of alerting on the fly :).
Regards,
Raja.
From: Thomas Weise <th...@gmail.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, June 22, 2016 at 3:36 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: Alerts
You can obtain the application status from YARN. But that's not detailed enough to diagnose what is happening within the application. For that, you can use the Apex app master REST API. If you are using the DT community edition, you get both through the gateway REST API. More information about the gateway can be found here:
http://www.slideshare.net/ApacheApex/dtgateway-making-apache-apex-operable
Thanks,
Thomas
On Wed, Jun 22, 2016 at 1:05 PM, Raja.Aravapalli <Ra...@target.com>> wrote:
Thanks Sandesh for your response!
What I am actually out for is, an alert email, when ever my application dies/kills I would like to get a notification. Is there any operator already available for this ?
Regards,
Raja.
From: Sandesh Hegde <sa...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, June 22, 2016 at 1:32 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: Alerts
Create an error port in the operator, which needs to send the alerts and connect it to output operators. Take a look at SMTP operator in Malhar for sending mails.
Another combination would be to have the rules operator before the alert sending Output operator.
On Wed, Jun 22, 2016 at 9:06 AM Raja.Aravapalli <Ra...@target.com>> wrote:
Hi,
Curious to know, do we have any alerting mechanism available with Apex like emails on application status and Data quality alerts..etc.. .??
Thanks.
Regards,
Raja.
Re: Alerts
Posted by Thomas Weise <th...@gmail.com>.
You can obtain the application status from YARN. But that's not detailed
enough to diagnose what is happening within the application. For that, you
can use the Apex app master REST API. If you are using the DT community
edition, you get both through the gateway REST API. More information about
the gateway can be found here:
http://www.slideshare.net/ApacheApex/dtgateway-making-apache-apex-operable
Thanks,
Thomas
On Wed, Jun 22, 2016 at 1:05 PM, Raja.Aravapalli <Raja.Aravapalli@target.com
> wrote:
>
> Thanks Sandesh for your response!
>
> What I am actually out for is, an alert email, when ever my application
> dies/kills I would like to get a notification. Is there any operator
> already available for this ?
>
>
> Regards,
> Raja.
>
> From: Sandesh Hegde <sa...@datatorrent.com>
> Reply-To: "users@apex.apache.org" <us...@apex.apache.org>
> Date: Wednesday, June 22, 2016 at 1:32 PM
> To: "users@apex.apache.org" <us...@apex.apache.org>
> Subject: Re: Alerts
>
> Create an error port in the operator, which needs to send the alerts and
> connect it to output operators. Take a look at SMTP operator in Malhar for
> sending mails.
> Another combination would be to have the rules operator before the alert
> sending Output operator.
>
>
>
>
> On Wed, Jun 22, 2016 at 9:06 AM Raja.Aravapalli <
> Raja.Aravapalli@target.com> wrote:
>
>> Hi,
>>
>> Curious to know, do we have any alerting mechanism available with Apex
>> like emails on application status and Data quality alerts..etc.. .??
>>
>> Thanks.
>>
>>
>> Regards,
>> Raja.
>
>
Re: Alerts
Posted by "Raja.Aravapalli" <Ra...@target.com>.
Thanks Sandesh for your response!
What I am actually out for is, an alert email, when ever my application dies/kills I would like to get a notification. Is there any operator already available for this ?
Regards,
Raja.
From: Sandesh Hegde <sa...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, June 22, 2016 at 1:32 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: Alerts
Create an error port in the operator, which needs to send the alerts and connect it to output operators. Take a look at SMTP operator in Malhar for sending mails.
Another combination would be to have the rules operator before the alert sending Output operator.
On Wed, Jun 22, 2016 at 9:06 AM Raja.Aravapalli <Ra...@target.com>> wrote:
Hi,
Curious to know, do we have any alerting mechanism available with Apex like emails on application status and Data quality alerts..etc.. .??
Thanks.
Regards,
Raja.
Re: Alerts
Posted by Sandesh Hegde <sa...@datatorrent.com>.
Create an error port in the operator, which needs to send the alerts and
connect it to output operators. Take a look at SMTP operator in Malhar for
sending mails.
Another combination would be to have the rules operator before the alert
sending Output operator.
On Wed, Jun 22, 2016 at 9:06 AM Raja.Aravapalli <Ra...@target.com>
wrote:
> Hi,
>
> Curious to know, do we have any alerting mechanism available with Apex
> like emails on application status and Data quality alerts..etc.. .??
>
> Thanks.
>
>
> Regards,
> Raja.