You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/05/25 00:25:01 UTC
[GitHub] [spark] xuanyuanking commented on a change in pull request #28609: [SPARK-31792][DOCS] Introduce the structured streaming UI in the Web UI doc
xuanyuanking commented on a change in pull request #28609:
URL: https://github.com/apache/spark/pull/28609#discussion_r429690474
##########
File path: docs/web-ui.md
##########
@@ -407,6 +407,20 @@ Here is the list of SQL metrics:
</table>
+## Structured Streaming Tab
+When running Structured Streaming jobs in micro-batch mode, a Structured Streaming tab will be
+available on the Web UI. You can check the statistics of a running query or a completed query
+via clicking a run id on the Streaming Query overview page.
+
+<p style="text-align: center;">
+ <img src="img/webui-structured-streaming-detail.png" title="Structured Streaming Query Statistics" alt="Structured Streaming Query Statistics">
+</p>
+
+The statistics page displays some useful metrics (e.g., how many records received per second and
+the time used for different stages of a micro-batch execution) for insight into the status of your
Review comment:
How about adding a section for the metrics in operation duration histogram?
##########
File path: docs/web-ui.md
##########
@@ -407,6 +407,20 @@ Here is the list of SQL metrics:
</table>
+## Structured Streaming Tab
+When running Structured Streaming jobs in micro-batch mode, a Structured Streaming tab will be
+available on the Web UI. You can check the statistics of a running query or a completed query
+via clicking a run id on the Streaming Query overview page.
Review comment:
We can also check the latest exception for the failed query.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org