You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tim Armstrong (Jira)" <ji...@apache.org> on 2019/10/08 15:45:00 UTC
[jira] [Work started] (IMPALA-9015) Use better algorithm for
allocating scan ranges to finstances within a daemon in schedule
[ https://issues.apache.org/jira/browse/IMPALA-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on IMPALA-9015 started by Tim Armstrong.
---------------------------------------------
> Use better algorithm for allocating scan ranges to finstances within a daemon in schedule
> ------------------------------------------------------------------------------------------
>
> Key: IMPALA-9015
> URL: https://issues.apache.org/jira/browse/IMPALA-9015
> Project: IMPALA
> Issue Type: Sub-task
> Components: Distributed Exec
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Major
>
> Currently the scheduler uses a single-pass algorithm to allocate scan ranges to nodes. It has several deficiencies:
> * It doesn't guarantee that the desired number of instances are created. E.g. if mt_dop is 4, there are 3 impalads and 9 scan ranges, it should create 3 instances per impala but doesn't reliably.
> * It tends to over-allocate to the first instances it visits.
> * The result depends quite a bit on the input order of the scan ranges.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org