You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Peter Ebert (Jira)" <ji...@apache.org> on 2021/07/23 17:23:00 UTC

[jira] [Created] (IMPALA-10824) Persist Remote Read Cache when Restarting Impala Executors

Peter Ebert created IMPALA-10824:
------------------------------------

             Summary: Persist Remote Read Cache when Restarting Impala Executors
                 Key: IMPALA-10824
                 URL: https://issues.apache.org/jira/browse/IMPALA-10824
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Peter Ebert


Currently impala executors will delete the remote read cache at startup.  For users dependent on a warm cache for good performance, a restart might be needed to change a setting or fix an issue, which would then clear the cache, make queries slower, and hit the network.  If Impala instead wrote out the cache metadata on shutdown, and loaded on startup, this would keep the cache warm and not slow down subsequent queries.

 

I would envision this just for intentional shutdown/restarts, not unexpected failures/stops where consistency of the metadata would be difficult or impossible to maintain.  When loading on startup if any inconsistencies were found aborting and deleting the cache would be understandable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org