You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/04/25 14:52:47 UTC
[GitHub] [spark] pengbo opened a new pull request #24460:
[SPARK-27565][SQL][Web UI]: Show job info of WholeStageCodegen node on
SparkSQL UI page
pengbo opened a new pull request #24460: [SPARK-27565][SQL][Web UI]: Show job info of WholeStageCodegen node on SparkSQL UI page
URL: https://github.com/apache/spark/pull/24460
## What changes were proposed in this pull request?
Currently it's really hard to link SQL plan to Spark jobs on SparkSQL UI page. When one job failed, which `PhysicalPlan` nodes are involved are difficult to be located. This PR is to show the job info of `WholeStageCodegen` node on SparkSQL UI page to make life easier.
Each `WholeStageCodegen` node has a task metric `PIPELINE_DURATION_METRIC` which records the total duration time shown in the top right. The idea is to put the job info into its metric value during metric aggregation.
## How was this patch tested?
Existing tests & new test has been added
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org