[jira] [Commented] (KAFKA-6266) Kafka 1.0.0 : Repeated occurrence of WARN Resetting first dirty offset of __consumer_offsets-xx to log start offset 203569 since the checkpointed offset 120955 is invalid. (kafka.log.LogCleanerManager$)

["Jeff Widman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16440212#comment-16440212 ] 

Jeff Widman commented on KAFKA-6266:
------------------------------------

I am hitting this after upgrading a 0.10.0.1 broker to 1.0.1. 

the __consumer_offsets topic has the following config:
{code}
Topic:__consumer_offsets	PartitionCount:157	ReplicationFactor:2	Configs:segment.bytes=104857600,cleanup.policy=compact,compression.type=producer
{code}

Ignore the non-standard partition count, that is a byproduct of a bug from years ago. In this case, I think the only effect is that it makes it less likely that a partition within the __consumer_offsets topic gets produced to, which it sounds like would clear this error.

> Kafka 1.0.0 : Repeated occurrence of WARN Resetting first dirty offset of __consumer_offsets-xx to log start offset 203569 since the checkpointed offset 120955 is invalid. (kafka.log.LogCleanerManager$)
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-6266
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6266
>             Project: Kafka
>          Issue Type: Bug
>          Components: offset manager
>    Affects Versions: 1.0.0
>         Environment: CentOS 7, Apache kafka_2.12-1.0.0
>            Reporter: VinayKumar
>            Priority: Major
>
> I upgraded Kafka from 0.10.2.1 to 1.0.0 version. From then, I see the below warnings in the log.
>  I'm seeing these continuously in the log, and want these to be fixed- so that they wont repeat. Can someone please help me in fixing the below warnings.
> {code}
> WARN Resetting first dirty offset of __consumer_offsets-17 to log start offset 3346 since the checkpointed offset 3332 is invalid. (kafka.log.LogCleanerManager$)
>  WARN Resetting first dirty offset of __consumer_offsets-23 to log start offset 4 since the checkpointed offset 1 is invalid. (kafka.log.LogCleanerManager$)
>  WARN Resetting first dirty offset of __consumer_offsets-19 to log start offset 203569 since the checkpointed offset 120955 is invalid. (kafka.log.LogCleanerManager$)
>  WARN Resetting first dirty offset of __consumer_offsets-35 to log start offset 16957 since the checkpointed offset 7 is invalid. (kafka.log.LogCleanerManager$)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)