You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Abhishek Rawat (Jira)" <ji...@apache.org> on 2023/10/11 17:06:00 UTC
[jira] [Updated] (IMPALA-12494) Clamp MEM_LIMIT_EXECUTORS and MEM_LIMIT_COORDINATORS
[ https://issues.apache.org/jira/browse/IMPALA-12494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhishek Rawat updated IMPALA-12494:
------------------------------------
Description:
The MEM_LIMIT_EXECUTORS and MEM_LIMIT_COORDINATORS are not clamped to the pool's 'min_query_mem_limit' and 'max_query_mem_limit', when 'clamp_mem_limit_query_option' pool setting is set. It would be good to also clamp these memory limits.
We should also introduce a new 'min-query-mem-limit-coordinator' option for the pool configs. This is useful for dedicated coordinators which should have separate minimum memory limit. The maximum query memory limit should probably still be same for both executors and coordinators ('max-query-mem-limit').
was:
The MEM_LIMIT_EXECUTORS and MEM_LIMIT_COORDINATORS are not clamped to the pool's min_query_mem_limit and max_query_mem_limit, when 'clamp_mem_limit_query_option' pool setting is set. It would be good to also clamp these memory limits.
We should also introduce a new 'min-query-mem-limit-coordinator' option for the pool configs. This is useful for dedicated coordinators which should have separate minimum memory limit. The maximum query memory limit should probably still be same for both executors and coordinators ('max-query-mem-limit').
> Clamp MEM_LIMIT_EXECUTORS and MEM_LIMIT_COORDINATORS
> ----------------------------------------------------
>
> Key: IMPALA-12494
> URL: https://issues.apache.org/jira/browse/IMPALA-12494
> Project: IMPALA
> Issue Type: Task
> Components: Backend
> Reporter: Abhishek Rawat
> Assignee: Abhishek Rawat
> Priority: Critical
>
> The MEM_LIMIT_EXECUTORS and MEM_LIMIT_COORDINATORS are not clamped to the pool's 'min_query_mem_limit' and 'max_query_mem_limit', when 'clamp_mem_limit_query_option' pool setting is set. It would be good to also clamp these memory limits.
> We should also introduce a new 'min-query-mem-limit-coordinator' option for the pool configs. This is useful for dedicated coordinators which should have separate minimum memory limit. The maximum query memory limit should probably still be same for both executors and coordinators ('max-query-mem-limit').
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org