You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias J. Sax (Jira)" <ji...@apache.org> on 2020/04/30 20:40:00 UTC
[jira] [Comment Edited] (KAFKA-7748) Add wall clock TimeDefinition
for suppression of intermediate events
[ https://issues.apache.org/jira/browse/KAFKA-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096963#comment-17096963 ]
Matthias J. Sax edited comment on KAFKA-7748 at 4/30/20, 8:39 PM:
------------------------------------------------------------------
It's not dead if anybody picks it up again... The current proposal was not yet convincing and we still would need to figure out the design of this feature.
Sometime people start a KIP but drop it for unclear reasons.
was (Author: mjsax):
It's not dead if anybody picks it up again... The current proposal was not yet convincing and we still would need to figure out the design of this feature.
> Add wall clock TimeDefinition for suppression of intermediate events
> --------------------------------------------------------------------
>
> Key: KAFKA-7748
> URL: https://issues.apache.org/jira/browse/KAFKA-7748
> Project: Kafka
> Issue Type: New Feature
> Components: streams
> Affects Versions: 2.1.0
> Reporter: Jonathan Gordon
> Priority: Major
> Labels: needs-kip
>
> Currently, Kafka Streams offers the ability to suppress intermediate events based on either RecordTime or WindowEndTime, which are in turn defined by stream time:
> {{Suppressed.untilTimeLimit(final Duration timeToWaitForMoreEvents, final BufferConfig bufferConfig)}}
> It would be helpful to have another option that would allow suppression of intermediate events based on wall clock time. This would allow us to only produce a limited number of aggregates independent of their stream time (which in our case is event time).
> For reference, here's the relevant KIP:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-328%3A+Ability+to+suppress+updates+for+KTables#KIP-328:AbilitytosuppressupdatesforKTables-Best-effortratelimitperkey]
> And here's the relevant Confluent Slack thread:
> https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1544468349201700
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)