You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jonathan Gordon (JIRA)" <ji...@apache.org> on 2018/12/17 22:03:00 UTC
[jira] [Created] (KAFKA-7748) Add wall clock TimeDefinition for
suppression of intermediate events
Jonathan Gordon created KAFKA-7748:
--------------------------------------
Summary: Add wall clock TimeDefinition for suppression of intermediate events
Key: KAFKA-7748
URL: https://issues.apache.org/jira/browse/KAFKA-7748
Project: Kafka
Issue Type: New Feature
Components: streams
Affects Versions: 2.1.0
Reporter: Jonathan Gordon
Currently, Kafka Streams offers the ability to suppress intermediate events based on either RecordTime or WindowEndTime, which are in turn defined by stream time:
{{Suppressed.untilTimeLimit(final Duration timeToWaitForMoreEvents, final BufferConfig bufferConfig)}}
It would be helpful to have another option that would allow suppression of intermediate events based on wall clock time. This would allow us to only produce a limited number of aggregates independent of their stream time (which in our case is event time).
For reference, here's the relevant KIP:
[https://cwiki.apache.org/confluence/display/KAFKA/KIP-328%3A+Ability+to+suppress+updates+for+KTables#KIP-328:AbilitytosuppressupdatesforKTables-Best-effortratelimitperkey]
And here's the relevant Confluent Slack thread:
https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1544468349201700
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)