You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Jun Rao (JIRA)" <ji...@apache.org> on 2018/04/11 22:14:00 UTC
[jira] [Commented] (KAFKA-6780) log cleaner shouldn't clean
messages beyond high watermark
[ https://issues.apache.org/jira/browse/KAFKA-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434646#comment-16434646 ]
Jun Rao commented on KAFKA-6780:
--------------------------------
The fix is probably to further bound firstUncleanableDirtyOffset by the high watermark.
> log cleaner shouldn't clean messages beyond high watermark
> ----------------------------------------------------------
>
> Key: KAFKA-6780
> URL: https://issues.apache.org/jira/browse/KAFKA-6780
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 1.1.0
> Reporter: Jun Rao
> Priority: Major
>
> Currently, the firstUncleanableDirtyOffset computed by the log cleaner is bounded by the first offset in the active segment. It's possible for the high watermark to be smaller than that. This may cause a committed record to be removed because of an uncommitted record.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)