[jira] [Created] (IMPALA-11822) Optimize the Refresh/Invalidate event processing by skipping unnecessary events

["Sai Hemanth Gantasala (Jira)" <ji...@apache.org>]

Sai Hemanth Gantasala created IMPALA-11822:
----------------------------------------------

             Summary: Optimize the Refresh/Invalidate event processing by skipping unnecessary events
                 Key: IMPALA-11822
                 URL: https://issues.apache.org/jira/browse/IMPALA-11822
             Project: IMPALA
          Issue Type: Sub-task
          Components: Catalog
            Reporter: Sai Hemanth Gantasala
            Assignee: Sai Hemanth Gantasala


Optimize the Refresh/Invalidate event processing by skipping unnecessary events.

Currently, we process every event as a new event. Consider there are 5 refresh events of the same table in the event processor queue. We can process the first refresh event and skip the remaining 4 events by comparing the timestamp of the refreshed table and event time. This way we can greatly improve the performance by skipping unnecessary events.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org