You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Clara Xiong (Jira)" <ji...@apache.org> on 2023/10/04 18:54:00 UTC
[jira] [Updated] (FLINK-33187) Don't send duplicate event to Kafka if no change
[ https://issues.apache.org/jira/browse/FLINK-33187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Clara Xiong updated FLINK-33187:
--------------------------------
Description:
Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling is not enable, which consists 99% of all Kafka events in our prod env. This wastes Kafka resources and cause performance downstream.
Proposal:
Suppress duplicate event within an interval defined by a new operator dynamic config "suppress-event.interval" in second, defaulted to 0.
was:
Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling is not enable, which consists 99% of all Kafka events in our prod env. This wastes Kafka resources and cause performance downstream.
Proposal:
Suppress duplicate event within an interval defined by a new operator dynamic config "suppress-event.interval" in second, defaulted to 30 min.
> Don't send duplicate event to Kafka if no change
> ------------------------------------------------
>
> Key: FLINK-33187
> URL: https://issues.apache.org/jira/browse/FLINK-33187
> Project: Flink
> Issue Type: Improvement
> Components: Autoscaler
> Affects Versions: 1.17.1
> Reporter: Clara Xiong
> Priority: Major
>
> Problem:
> Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling is not enable, which consists 99% of all Kafka events in our prod env. This wastes Kafka resources and cause performance downstream.
> Proposal:
> Suppress duplicate event within an interval defined by a new operator dynamic config "suppress-event.interval" in second, defaulted to 0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)