[GitHub] [spark] pengbo opened a new pull request #24389: [SPARK-27482][SQL][Web UI]: Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page

[GitBox <gi...@apache.org>]

pengbo opened a new pull request #24389: [SPARK-27482][SQL][Web UI]: Show BroadcastHashJoinExec numOutputRows statistics info on SparkSQL UI page
URL: https://github.com/apache/spark/pull/24389
 
 
   ## What changes were proposed in this pull request?
   Currently, the SparkSQL UI page shows only actual metric info in each SparkPlan node. However with `statistics` info may help us understand how the plan is designed and the reason it runs slowly. This PR is to show `BroadcastHashJoinExec` `numOutputRows` `statistic` info on SparkSQL UI page first when it's available. 
   
   The main changes:
   1. Add `stats` field in `SparkPlan`
   2. Initialize `BroadcastHashJoinExec` with the `stats` in `Join` `LogicalPlan`
   3. Add `stats` field in `SQLMetric` and show it on UI page when it's available
   
   ## How was this patch tested?
   Regarding unit test has been added, manual UI test has been tested
   
   <img width="311" alt="SPARK-27482-1" src="https://user-images.githubusercontent.com/1247590/56264561-7d8d4e00-6119-11e9-9ea3-9b19634ab9b6.png">
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org