You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Karen Coppage (JIRA)" <ji...@apache.org> on 2017/08/25 13:23:00 UTC

[jira] [Updated] (HIVE-17388) Spark Stats for the WebUI Query Plan

     [ https://issues.apache.org/jira/browse/HIVE-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karen Coppage updated HIVE-17388:
---------------------------------
    Description: 
Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark task progress as well as the log file path will be displayed if hive.server2.webui.show.stats=true.
If the task is successful, SparkStatistics will also be shown.

Issues:
* SparkStatistics aren't shown if task fails or is running.
* Will need rebasing after HIVE-17300 is committed (current patch includes HIVE-17300 changes)
* Will need testing upstream. 

Suggestion
* It would be really easy to incorporate a progress bar to follow Spark progress, with only a few tweaks to the JavaScript in:
service/src/resources/hive-webapps/static/js/query-plan-graph.js

  was:
Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark task progress as well as the log file path will be displayed if hive.server2.webui.show.stats=true.
If the task is successful, SparkStatistics will also be shown.

Issues:
* SparkStatistics aren't shown if task fails or is running.
* Will need rebasing after HIVE-17300 is committed (current patch includes HIVE-17300 changes)
* Will need testing upstream. 


> Spark Stats for the WebUI Query Plan
> ------------------------------------
>
>                 Key: HIVE-17388
>                 URL: https://issues.apache.org/jira/browse/HIVE-17388
>             Project: Hive
>          Issue Type: Improvement
>          Components: Web UI
>            Reporter: Karen Coppage
>            Priority: Minor
>              Labels: features, patch
>
> Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark task progress as well as the log file path will be displayed if hive.server2.webui.show.stats=true.
> If the task is successful, SparkStatistics will also be shown.
> Issues:
> * SparkStatistics aren't shown if task fails or is running.
> * Will need rebasing after HIVE-17300 is committed (current patch includes HIVE-17300 changes)
> * Will need testing upstream. 
> Suggestion
> * It would be really easy to incorporate a progress bar to follow Spark progress, with only a few tweaks to the JavaScript in:
> service/src/resources/hive-webapps/static/js/query-plan-graph.js



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)