You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2025/01/22 07:23:00 UTC
[jira] [Created] (IMPALA-13685) Consider throttling WaitForHmsEvent requests in catalogd
Quanlong Huang created IMPALA-13685:
---------------------------------------
Summary: Consider throttling WaitForHmsEvent requests in catalogd
Key: IMPALA-13685
URL: https://issues.apache.org/jira/browse/IMPALA-13685
Project: IMPALA
Issue Type: Task
Reporter: Quanlong Huang
Assignee: Quanlong Huang
The WaitForHmsEvent RPC is added by IMPALA-12152 so coordinators can use it before query planning to wait until catalogd is in sync with HMS events. Each query with SYNC_HMS_EVENTS_WAIT_TIME_S > 0 triggers such a RPC to catalogd, which launches a sleeping thread in catalogd checking the event processing progress periodically. If these overload catalogd, we should throttle WaitForHmsEvent requests like what we have done on GetPartialCatalogObject requests. The time between coordinator sends the request and catalogd starts processing the request might be significant after that so it should also be accounted in the waiting timeout.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org