You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2025/01/22 07:23:00 UTC

[jira] [Created] (IMPALA-13685) Consider throttling WaitForHmsEvent requests in catalogd

Quanlong Huang created IMPALA-13685:
---------------------------------------

             Summary: Consider throttling WaitForHmsEvent requests in catalogd
                 Key: IMPALA-13685
                 URL: https://issues.apache.org/jira/browse/IMPALA-13685
             Project: IMPALA
          Issue Type: Task
            Reporter: Quanlong Huang
            Assignee: Quanlong Huang


The WaitForHmsEvent RPC is added by IMPALA-12152 so coordinators can use it before query planning to wait until catalogd is in sync with HMS events. Each query with SYNC_HMS_EVENTS_WAIT_TIME_S > 0 triggers such a RPC to catalogd, which launches a sleeping thread in catalogd checking the event processing progress periodically. If these overload catalogd, we should throttle WaitForHmsEvent requests like what we have done on GetPartialCatalogObject requests. The time between coordinator sends the request and catalogd starts processing the request might be significant after that so it should also be accounted in the waiting timeout.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org