You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Imran Rashid (JIRA)" <ji...@apache.org> on 2018/05/14 21:36:00 UTC
[jira] [Updated] (SPARK-24274) Job UI should make stage
dependencies clear in a complex DAG
[ https://issues.apache.org/jira/browse/SPARK-24274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Imran Rashid updated SPARK-24274:
---------------------------------
Attachment: q95_job17.tgz
> Job UI should make stage dependencies clear in a complex DAG
> ------------------------------------------------------------
>
> Key: SPARK-24274
> URL: https://issues.apache.org/jira/browse/SPARK-24274
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 2.3.0
> Reporter: Imran Rashid
> Priority: Major
> Attachments: q95_job17.tgz
>
>
> When there is a complex dag, its really hard to tell in the UI the relationship between the stages in a job, even with the "DAG Visualization". I'll attach an example page from tpc-ds q95 -- its really hard to tell what the inputs are to stage 19.
> its actually extremely useful to know the relationship between the stage, especially when there is a failure. I want to know what the total shuffle input *would* have been to stage 19, even though it failed. If I could tell what the input stages were, then this would be easy.
> I dunno the best way to do this -- some ideas:
> * tooltips on the DAG
> * a list of parents with links on the stage page
> * stage tables on the job page could include a list of parents
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org