You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Clara Xiong (Jira)" <ji...@apache.org> on 2023/10/04 17:58:00 UTC
[jira] [Created] (FLINK-33187) Don't send duplicate event to Kafka if no change
Clara Xiong created FLINK-33187:
-----------------------------------
Summary: Don't send duplicate event to Kafka if no change
Key: FLINK-33187
URL: https://issues.apache.org/jira/browse/FLINK-33187
Project: Flink
Issue Type: Improvement
Components: Autoscaler
Affects Versions: 1.17.1
Reporter: Clara Xiong
Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling is not enable,  which consists 99% of all Kafka events in our prod env. This wastes Kafka resources and cause performance  downstream.
Proposal:
Suppress duplicate event within an interval defined by a new operator dynamic config "suppress-event.interval" in second, defaulted to 30 min.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)