[jira] [Commented] (IMPALA-11970) Add query timeline display to Impala WebUI

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17709972#comment-17709972 ] 

ASF subversion and git services commented on IMPALA-11970:
----------------------------------------------------------

Commit 5f95bc2421888747822e1daad4db4f42d7e335dd in impala's branch refs/heads/master from Kurt Deschler
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=5f95bc242 ]

IMPALA-11970: Add query timeline display to Impala WebUI

This change adds a chart to the Impala WebUI for displaying query
fragments and plan node timings. The chart list execution timings in a
compact form with the plan/fragment tree shown on the left side and a
Gantt chart with bars for each execution phase on the right side.

Plan node labels are color-coded by fragment. The node list will scroll
for large plans so that the scale and legend always stay visible.
Exchange nodes have dotted boxes that show when rows are sent from the
corresponding senders below. Additionally, 'X' and 'O' symbols are used
to node where join builds arrive.

By default, fragments are printed with nodes grouped within each fragment
for easier timing analysis. A checkbox is provided that changes the
ordering so that nodes are printed in plan order similar to the Summary
tab.

The length of each colored phase interval depicts the longest instance
time while instances that complete earlier are shown as grey lines within
the phase interval.

On the server side, the query profile handler has been modified to return
the profile JSON as a document element instead of document content as it
is for JSON profile download. This allows the profile to be accessed in
full using scripts in templates.

Dense profiles will not render correctly as they currently do not contain
the necessary timestamps. This limitation will be addressed at a later
time with corresponding changes to the dense profile.

Example output is attached to the IMPALA-11970 ticket

Testing: Manual validation of rendering using TPC-H and TPC-DS queries
Will look into adding tests to test_web_pages.py and
test_observability.py in a subsequent patch

Change-Id: I8b5826107af0f5a7fe306cb986a875cff261d9db
Reviewed-on: http://gerrit.cloudera.org:8080/19583
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Wenzhe Zhou <wz...@cloudera.com>


> Add query timeline display to Impala WebUI
> ------------------------------------------
>
>                 Key: IMPALA-11970
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11970
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>            Reporter: Kurt Deschler
>            Assignee: Kurt Deschler
>            Priority: Major
>         Attachments: image-2023-03-23-10-29-47-827.png, image-2023-03-23-10-35-24-078.png, timing_mt_dop_off.png, timing_mt_dop_on.png
>
>
> Query profiles contain timing information for fragments and plan nodes that is difficult to analyze in a text format, especially for complex and highly-parallel execution plans. A graphical display in the WebUI that renders timing information in Gantt chart form will make the execution timing and dependencies much easier to follow.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org