Visualization/Summary tools for Spark Streaming data

[Subodh Nijsure <su...@sigsensetech.com>]

Hi,

This is my second week of working with Spark, pardon if this is elementary
question in spark domain.

I am looking for ways to render output of Spark Streaming.

First let me describe problem set. I am monitoring (push from devices every
minute) temperature/humidity and other environmental parameters across 1000
installations. This data comes to me via Kafka and goes into Spark
Streaming for processing.

There I am querying my own mySQL database to find out if specific location
is exceeding thresholds configured for specific site if it does, it spits
out "alarm" which is stored in mySQL DB. For all mySQL access I am using
java odbc interface.

Now the question all the trend data that I am saving for various
environmental parameters how do I graph/visualize them. Are there any
examples of how folks are doing visualization of data collected/refined by
Spark Streaming.

I watched the DataBricks presentation (
https://www.youtube.com/watch?v=dJQ5lV5Tldw) , that is the kind of system I
am looking for, but they are under limited beta so no way for me to get
hands on that tech. Are there any other platforms that offer similar
functionality for visualizing data under Apache Spark?

Regards,
-Subodh

Re: Visualization/Summary tools for Spark Streaming data

[bryanv <br...@ftml.net>]

You might check out Bokeh ( http://bokeh.pydata.org <http://bokeh.pydata.org> 
) which is a python (and other languages) system for streaming and big data
vis targeting the browser. I just gave a talk at SciPy 2014 where you can
hear more and see examples: https://www.youtube.com/watch?v=B9NpLOyp-dI



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Visualization-Summary-tools-for-Spark-Streaming-data-tp10200p10207.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.