You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "John Roesler (JIRA)" <ji...@apache.org> on 2019/01/10 16:51:00 UTC

[jira] [Comment Edited] (KAFKA-7748) Add wall clock TimeDefinition for suppression of intermediate events

    [ https://issues.apache.org/jira/browse/KAFKA-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739601#comment-16739601 ] 

John Roesler edited comment on KAFKA-7748 at 1/10/19 4:50 PM:
--------------------------------------------------------------

This has been a big stumbling block for users of Suppress. It would be good to get it implemented ASAP.

This feature requires a KIP, but it would be a very small one.


was (Author: vvcephei):
This has been a big stumbling block for users of Suppress. It would be good to get it implemented ASAP.

> Add wall clock TimeDefinition for suppression of intermediate events
> --------------------------------------------------------------------
>
>                 Key: KAFKA-7748
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7748
>             Project: Kafka
>          Issue Type: New Feature
>          Components: streams
>    Affects Versions: 2.1.0
>            Reporter: Jonathan Gordon
>            Priority: Major
>              Labels: needs-kip
>
> Currently, Kafka Streams offers the ability to suppress intermediate events based on either RecordTime or WindowEndTime, which are in turn defined by stream time:
> {{Suppressed.untilTimeLimit(final Duration timeToWaitForMoreEvents, final BufferConfig bufferConfig)}}
> It would be helpful to have another option that would allow suppression of intermediate events based on wall clock time. This would allow us to only produce a limited number of aggregates independent of their stream time (which in our case is event time).
> For reference, here's the relevant KIP:
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-328%3A+Ability+to+suppress+updates+for+KTables#KIP-328:AbilitytosuppressupdatesforKTables-Best-effortratelimitperkey]
> And here's the relevant Confluent Slack thread:
> https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1544468349201700
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)