You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gabor Somogyi (Jira)" <ji...@apache.org> on 2021/03/01 09:53:00 UTC
[jira] [Commented] (SPARK-34580) Provide the relationship between
batch ID and SQL executions (and/or Jobs) in SS UI page
[ https://issues.apache.org/jira/browse/SPARK-34580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17292787#comment-17292787 ]
Gabor Somogyi commented on SPARK-34580:
---------------------------------------
cc [~kabhwan] [~hyukjin.kwon] [~zsxwing] [~viirya]
It requires some time to come up with a makes sense solution but started.
> Provide the relationship between batch ID and SQL executions (and/or Jobs) in SS UI page
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-34580
> URL: https://issues.apache.org/jira/browse/SPARK-34580
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.1.1
> Reporter: Gabor Somogyi
> Priority: Major
>
> The current SS UI page focuses to show the trends among the batches, which is great to figure out whether the streaming query is running healthy or not, and the oddness of specific batch.
> One thing still bugging you is that what you can get from here is the batch ID (number), which means you have to find out related SQL executions and Jobs manually with the batch ID. It's high likely bound to the recent runs of SQL executions/Jobs so you may not need to find it with searching on lots of pages, but the fact you need to find it by yourself manually is still annoying.
> It would be nice if we can provide the relationship between batch ID and SQL executions (probably Jobs as well if the space is enough) and links to these pages, like we see job page links from SQL execution page.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org