You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/03/24 16:20:00 UTC

[jira] [Commented] (IMPALA-12023) Consider skipping resource checking on last executor group set.

    [ https://issues.apache.org/jira/browse/IMPALA-12023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17704691#comment-17704691 ] 

ASF subversion and git services commented on IMPALA-12023:
----------------------------------------------------------

Commit 1eb6ed6f2901aad6af66c206d446f8aebf4529fe in impala's branch refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1eb6ed6f2 ]

IMPALA-12023: Skip resource checking on last executor group set

This patch adds flag skip_resource_checking_on_last_executor_group_set.
If this backend flag is set to true, memory and cpu resource checking
will be skipped when a query is being planned against the last (largest)
executor group set. Setting true will ensure that query will always get
admitted into the last executor group set if it does not fit in any
other group set.

Testing
- Tune test_query_cpu_count_divisor_fraction to run two test case:
  cpu within limit, and cpu outside limit.
- Add test_no_skip_resource_checking

Change-Id: I5848e4f67939d3dd2fb105c1ae4ca8e15f2e556f
Reviewed-on: http://gerrit.cloudera.org:8080/19649
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Wenzhe Zhou <wz...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Consider skipping resource checking on last executor group set.
> ---------------------------------------------------------------
>
>                 Key: IMPALA-12023
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12023
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Riza Suminto
>            Assignee: Riza Suminto
>            Priority: Major
>
> On multiple executor group setup, we should consider skipping resource checking on last (largest) executor group. This help ensure that query still get admitted in case planner overestimate the query resource requirement.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org