You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "YifanZhang (Jira)" <ji...@apache.org> on 2023/03/17 08:44:00 UTC

[jira] [Commented] (IMPALA-8731) Balance queries between executor groups

    [ https://issues.apache.org/jira/browse/IMPALA-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17701579#comment-17701579 ] 

YifanZhang commented on IMPALA-8731:
------------------------------------

Now all the executor groups are processed in alphanumerically sorted order: [https://github.com/apache/impala/blob/a6333aed6b0fe2cf355aeaa1952735b9208b2f43/be/src/scheduling/admission-controller.cc#L2566-L2568|https://github.com/apache/impala/blob/a6333aed6b0fe2cf355aeaa1952735b9208b2f43/be/src/scheduling/admission-controller.cc#L2566-L2568.]

We can improve this by sorting them based on their available resource(memory and slots).

> Balance queries between executor groups
> ---------------------------------------
>
>                 Key: IMPALA-8731
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8731
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>    Affects Versions: Impala 3.3.0
>            Reporter: Lars Volker
>            Priority: Major
>              Labels: admission-control, scalability
>
> After IMPALA-8484, we should revisit the assignment policy that we use to distribute queries to executor groups. In particular we should implement a policy that balances queries across executor groups instead of filling them up one by one.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org