You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/03/23 23:40:00 UTC

[jira] [Commented] (IMPALA-6852) Add a section to the query profile covering number of fragments instances and total bytes scanned per host

    [ https://issues.apache.org/jira/browse/IMPALA-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16799853#comment-16799853 ] 

ASF subversion and git services commented on IMPALA-6852:
---------------------------------------------------------

Commit 54c440a5597cc40c9ecfce0dbf42954660d0d20a in impala's branch refs/heads/master from Alice Fan
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=54c440a ]

IMPALA-6852: Add number of fragment instances per host to query profile

Query profile is updated to include number of fragment instances
per host. Example from "select count (*) from functional.alltypes":
    - Per Host Number of Fragment Instances: afan-box-7060:22000(2)
      afan-box-7060:22001(1) afan-box-7060:22002(1)

Added a basic observability test to ensure that the expected section
appears in the query profile.

Change-Id: I9556d7f1d56fd5c68cc2fb60df6f745a74cd4879
Reviewed-on: http://gerrit.cloudera.org:8080/12831
Reviewed-by: Bikramjeet Vig <bi...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Add a section to the query profile covering number of fragments instances and total bytes scanned per host
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: IMPALA-6852
>                 URL: https://issues.apache.org/jira/browse/IMPALA-6852
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>    Affects Versions: Impala 2.13.0
>            Reporter: Mostafa Mokhtar
>            Assignee: Alice Fan
>            Priority: Major
>              Labels: ramp-up, supportability
>
> Root causing performance issues usually comes down to skew in terms of work done across hosts. Un-even assignment of fragments or bytes scanned per host is a common.
> Making this information readily available in the query profile will help speedup RCA.
> Proposal is to add two tables to the query profile that cover
> * Number of fragments per host
> * Number of bytes scanned per host



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org