[jira] [Comment Edited] (IMPALA-10036) Admission control incorrectly rejecting query based on coordinator limit

["Tim Armstrong (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169401#comment-17169401 ] 

Tim Armstrong edited comment on IMPALA-10036 at 8/1/20, 8:17 PM:
-----------------------------------------------------------------

 [^impalad.INFO.gz] is the coordinator log from the repro with vmodule settings for scheduler.

It is the coord_mem_to_admit that has the wrong value -

{noformat}
I0801 13:14:56.305307 31596 admission-controller.cc:760] b944ca1e1c374c6f:5ad64c6100000000] Checking coordinator mem with coord_mem_to_admit = 1610612736 and coord_admit_mem_limit.second = 314572800

{noformat}


was (Author: tarmstrong):
 [^impalad.INFO.gz] is the coordinator log from the repro with vmodule settings for scheduler.


> Admission control incorrectly rejecting query based on coordinator limit
> ------------------------------------------------------------------------
>
>                 Key: IMPALA-10036
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10036
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 4.0
>            Reporter: David Rorke
>            Assignee: Tim Armstrong
>            Priority: Major
>         Attachments: 23_profile.txt, backends-repro.png, impalad.INFO.gz, start-ded-coord-cluster.sh, tmp-fair-scheduler.xml, tmp-llama-site.xml
>
>
> Admission control rejected a query with the following error:
> {noformat}
> ERROR: Rejected query from pool root.default: request memory needed 50.00 GB is greater than memory available for admission 45.36 GB of coordinator-0:22050.
> {noformat}
> The query profile shows the following resource estimates:
> {noformat}
> Per-Host Resource Estimates: Memory=303.36GB
> Dedicated Coordinator Resource Estimate: Memory=136MB
> {noformat}
> The max query memory limit for the pool was configured as 50 GB.
> Based on the coordinator resource estimate of 136 MB the query should have easily fit in the available coordinator memory. [~tarmstrong] speculated that we might simply be comparing the wrong resource estimate to the coordinator limit.
> Profile attached.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org