You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Clara Xiong (Jira)" <ji...@apache.org> on 2023/10/04 17:58:00 UTC

[jira] [Created] (FLINK-33187) Don't send duplicate event to Kafka if no change

Clara Xiong created FLINK-33187:
-----------------------------------

             Summary: Don't send duplicate event to Kafka if no change
                 Key: FLINK-33187
                 URL: https://issues.apache.org/jira/browse/FLINK-33187
             Project: Flink
          Issue Type: Improvement
          Components: Autoscaler
    Affects Versions: 1.17.1
            Reporter: Clara Xiong


Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling is not enable,  which consists 99% of all Kafka events in our prod env. This wastes Kafka resources and cause performance  downstream.

Proposal:
Suppress duplicate event within an interval defined by a new operator dynamic config "suppress-event.interval" in second, defaulted to 30 min.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)