You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "David Winters (JIRA)" <ji...@apache.org> on 2018/08/17 00:13:00 UTC
[jira] [Commented] (SPARK-24299) UI for Structured Streaming
Monitoring
[ https://issues.apache.org/jira/browse/SPARK-24299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16583207#comment-16583207 ]
David Winters commented on SPARK-24299:
---------------------------------------
+1
The "Streaming" tab in the Spark UI is the main way that we can visually understand the status of our several dozen Spark Streaming applications. We were rather surprised when we started to investigate the migration of our Spark Streaming apps to Structured Streaming that there wasn't any UI available in the Spark UI. We realize that there is a Structured Streaming metrics API, but it was nice that Spark Streaming had a fairly robust UI to visually monitor jobs out of the box without having to write code to create our own dashboards.
> UI for Structured Streaming Monitoring
> --------------------------------------
>
> Key: SPARK-24299
> URL: https://issues.apache.org/jira/browse/SPARK-24299
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming, Web UI
> Affects Versions: 2.3.0
> Reporter: Tomasz Gawęda
> Priority: Major
>
> Old Streaming module had a helpful Web UI for monitoring. It would be very helpful to have such UI for Structured Streaming
>
> I'm aware that we can read a lot from SQL visualization, but still dedicated page with metrics for queries will be useful.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org