You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Yida Wu (Jira)" <ji...@apache.org> on 2021/12/21 01:09:00 UTC

[jira] [Created] (IMPALA-11064) Optimizing Temporary File Structure for Batching Reading

Yida Wu created IMPALA-11064:
--------------------------------

             Summary: Optimizing Temporary File Structure for Batching Reading
                 Key: IMPALA-11064
                 URL: https://issues.apache.org/jira/browse/IMPALA-11064
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Yida Wu
            Assignee: Yida Wu


Impala allows spilling to a remote filesystem, like S3. The rate of uploading the spilled data to the remote filesystem is fast, but the speed of reading from the remote is slow because each time only one page is read from the remote filesystem while we do per upload per file.

 

The task aims to improve the reading performance of the spilling to a remote filesystem by using batch reading.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)