You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2023/10/16 18:48:00 UTC
[jira] [Commented] (IMPALA-12492) Add catalog metrics for total pending events and lag time of the event-processor
[ https://issues.apache.org/jira/browse/IMPALA-12492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775885#comment-17775885 ]
ASF subversion and git services commented on IMPALA-12492:
----------------------------------------------------------
Commit fbc4d701b1caa2c376c73a11e919d4ca38d64d48 in impala's branch refs/heads/master from stiga-huang
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=fbc4d701b ]
IMPALA-12492: Add metrics for total pending events and lag time of the event-processor
We have last-synced-event-time and latest-event-time on the catalogd
WebUI. It's tedious for users to calculate their difference to get the
lag time. This patch addes the lag in the WebUI directly. The unit is
set to TIME_S so it's shown in a human readable format. Also adds the
total pending events in the same page.
Tests
- Manually verify the metrics by generating lots of HMS events,
hard-code the EVENTS_BATCH_SIZE_PER_RPC to 5 and add some sleeps in
event processing. So it's more easy to show lags.
Change-Id: Id329879bfacba9c8415f920b57939dc571d1aad9
Reviewed-on: http://gerrit.cloudera.org:8080/20560
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Add catalog metrics for total pending events and lag time of the event-processor
> --------------------------------------------------------------------------------
>
> Key: IMPALA-12492
> URL: https://issues.apache.org/jira/browse/IMPALA-12492
> Project: IMPALA
> Issue Type: New Feature
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
>
> We have last-synced-event-time and latest-event-time on the catalogd WebUI. It's tedious for users to calculate their difference to get the lag time. It'd be useful if the WebUI shows the lag directly, especially in a human readable format.
> Showing the total number of pending events will also be useful.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org