You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/01/28 01:46:00 UTC

[jira] [Commented] (IMPALA-11604) Planner changes for CPU usage

    [ https://issues.apache.org/jira/browse/IMPALA-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681498#comment-17681498 ] 

ASF subversion and git services commented on IMPALA-11604:
----------------------------------------------------------

Commit 43928b190bb86b2a9d7378292c5825d3a4aac5fc in impala's branch refs/heads/master from wzhou-code
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=43928b190 ]

IMPALA-11617: Pool service should be made aware of cpu core limit

IMPALA-11604 enables the planner to compute CPU usage for certain
queries and to select suitable executor groups to run. The CPU usage is
expressed as the CPU cores required to process a query.

This patch added the CPU core limit, which is the maximum CPU core
available per node and coordinator for each executor group, to the pool
service.

Testing:
 - Passed core run.
 - Verified that CPU cores were shown on the admission and
   metrics pages of the Impala debug web server.

Change-Id: Id4c5ee519ce7c329b06ac821283e215a3560f525
Reviewed-on: http://gerrit.cloudera.org:8080/19366
Reviewed-by: Andrew Sherman <as...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Planner changes for CPU usage
> -----------------------------
>
>                 Key: IMPALA-11604
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11604
>             Project: IMPALA
>          Issue Type: Improvement
>            Reporter: Qifan Chen
>            Assignee: Qifan Chen
>            Priority: Major
>
> Plan scaling based on estimated peak memory has been enabled in 
> IMPALA-10992. However, it is sometime desirable to consider CPU-usage (such as the number of data processed) as a scaling factor. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org