[jira] [Assigned] (IMPALA-12029) Query can be under parallelized in multi executor group set setup

["Riza Suminto (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-12029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Riza Suminto reassigned IMPALA-12029:
-------------------------------------

    Assignee: Riza Suminto

> Query can be under parallelized in multi executor group set setup
> -----------------------------------------------------------------
>
>                 Key: IMPALA-12029
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12029
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Frontend
>    Affects Versions: Impala 4.2.0
>            Reporter: Riza Suminto
>            Assignee: Riza Suminto
>            Priority: Major
>
> In multiple executor group set setup, Frontend will try to match a query with the smallest executor group set that can fit the memory and cpu requirement of the compiled query. There are kind of query where the compiled plan will fit to any executor group set but not necessarily deliver the best performance. An example for this is Impala's COMPUTE STATS query. It does full table scan and aggregate the stats, have fairly simple query plan shape, but can benefit from higher scan parallelism.
> Planner needs to give additional feedback to Frontend that the query might be under parallelized under current executor group. Frontend can then make judgement whether to assign the compiled plan to current executor group anyway, or try step up to the next larger executor group and increase parallelism.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org