You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ismael Juma (JIRA)" <ji...@apache.org> on 2017/07/18 12:17:00 UTC

[jira] [Updated] (KAFKA-5533) Timestamp-based log compaction

     [ https://issues.apache.org/jira/browse/KAFKA-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismael Juma updated KAFKA-5533:
-------------------------------
    Fix Version/s:     (was: 0.11.0.1)
                   0.11.1.0

> Timestamp-based log compaction
> ------------------------------
>
>                 Key: KAFKA-5533
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5533
>             Project: Kafka
>          Issue Type: New Feature
>          Components: core
>    Affects Versions: 0.11.0.0
>            Reporter: Eno Thereska
>              Labels: kip
>             Fix For: 0.11.1.0
>
>
> Today log compaction is based on offsets, not timestamps. That means that a late arriving record with a small timestamp TS can over-write a record with a larger timestamp TL. This affects computations that depend on correct processing of timestamps. For example, in the streams library, this would mean that processing for KTables with late arriving data would not be correct.
> This JIRA will require a KIP.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)