You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "YifanZhang (Jira)" <ji...@apache.org> on 2023/02/01 16:09:00 UTC

[jira] [Created] (IMPALA-11891) Update executor group min size without restarting coordinators

YifanZhang created IMPALA-11891:
-----------------------------------

             Summary: Update executor group min size without restarting coordinators
                 Key: IMPALA-11891
                 URL: https://issues.apache.org/jira/browse/IMPALA-11891
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.2.0
            Reporter: YifanZhang


Currently, when updating an executor group's min size, we need to restart all executors in this executor group and all coordinators. Restarting coordinators will interrupt queries running on all executor groups.

It is necessary to restart coordinators because inconsistent executor group configurations will be ignored: [https://github.com/apache/impala/blob/c3ed44268838f4a00624e7e7fbf6e614f0a54a48/be/src/scheduling/executor-group.cc#L90] 

We can improve this by removing empty/unused executor groups from the cluster, and then new configurations of the same group names can be applied.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)