You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Joe McDonnell (Jira)" <ji...@apache.org> on 2024/10/24 17:10:00 UTC

[jira] [Created] (IMPALA-13478) Don't sync tuple cache file contents to disk immediately

Joe McDonnell created IMPALA-13478:
--------------------------------------

             Summary: Don't sync tuple cache file contents to disk immediately
                 Key: IMPALA-13478
                 URL: https://issues.apache.org/jira/browse/IMPALA-13478
             Project: IMPALA
          Issue Type: Task
          Components: Backend
    Affects Versions: Impala 4.5.0
            Reporter: Joe McDonnell


Currently, the tuple cache file writer syncs the file contents to disk before closing the file. This slows down the write path considerably, especially if disks are slow. This should be moved off of the fast path and done asynchronously. As a first step, this can remove the sync call and close the file without syncing. Other readers are still able to access it, and the kernel will flush the buffers as needed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org