You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Sutanu Das <sd...@att.com> on 2016/02/24 19:06:33 UTC

Rest API for Spark Streaming

Hi Community,

Is there a Rest API for Spark Streaming?

We are looking to monitor and send pager alert notification using rest api json messages when our streaming job Active Batches are getting 'queued'

We looked at http://localhost:4040/api/v1/applications/ap-status/stages/ but this info is not there and http://spark.apache.org/docs/latest/monitoring.html has no specific info on Batch Status

Any help will be appreciated.
Active Batches (11)
Batch Time

Input Size

Scheduling Delay (?)

Processing Time (?)

Status

2016/02/24 17:56:00 <http://has-dal-0004:4040/streaming/batch?id=1456336560000>

9062 events

-

-

queued

2016/02/24 17:54:00 <http://has-dal-0004:4040/streaming/batch?id=1456336440000>

8522 events

-

-

queued

2016/02/24 17:52:00 <http://has-dal-0004:4040/streaming/batch?id=1456336320000>

7982 events

-

-

queued