You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Tim Armstrong (Jira)" <ji...@apache.org> on 2019/10/08 01:22:00 UTC

[jira] [Created] (IMPALA-9020) Move scan range queues to fragment-level and do dynamic scheduling within a node

Tim Armstrong created IMPALA-9020:
-------------------------------------

             Summary: Move scan range queues to fragment-level and do dynamic scheduling within a node
                 Key: IMPALA-9020
                 URL: https://issues.apache.org/jira/browse/IMPALA-9020
             Project: IMPALA
          Issue Type: Sub-task
          Components: Backend
            Reporter: Tim Armstrong


It would be nice to dynamically load balance scans between finstances on a node. There's no particular reason why we can't do that - the code is already set up, in HDFS, to pull scan ranges out of a queue.

I think this will be simpler to do once we don't have to support the "old" multithreaded scans, so I'm including this in later cleanup.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)