You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Mostafa Mokhtar (JIRA)" <ji...@apache.org> on 2018/01/17 01:22:00 UTC
[jira] [Created] (IMPALA-6404) Evenly distribute local and remote
scan ranges across Impalad(s) when 100% locality is not achievable
Mostafa Mokhtar created IMPALA-6404:
---------------------------------------
Summary: Evenly distribute local and remote scan ranges across Impalad(s) when 100% locality is not achievable
Key: IMPALA-6404
URL: https://issues.apache.org/jira/browse/IMPALA-6404
Project: IMPALA
Issue Type: Improvement
Components: Distributed Exec
Reporter: Mostafa Mokhtar
Assignee: Lars Volker
Current scheduler tries to assign as many local reads as possible, this works well if 100% locality is achievable, but in cases where some nodes have locality while others don't an even scan ranges are assigned to the backends which results in execution skew.
Ideally the scheduler should create an even distribution of local and remote scan ranges to avoid skew.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)