[jira] [Created] (KAFKA-13338) kafka upgrade 6.1.1 asking to change log.cleanup.policy from delete to compact

["Fátima Galera (Jira)" <ji...@apache.org>]

Fátima Galera created KAFKA-13338:
-------------------------------------

             Summary: kafka upgrade 6.1.1 asking to change log.cleanup.policy from delete to compact
                 Key: KAFKA-13338
                 URL: https://issues.apache.org/jira/browse/KAFKA-13338
             Project: Kafka
          Issue Type: Bug
          Components: log
            Reporter: Fátima Galera
         Attachments: image003.png

Hi all,

 

During kafka upgrade from 5.3.1 to 6.1.1.1 we get below error starting kafka-connector services

 

ERROR [Worker clientId=connect-1, groupId=connect-cluster] Uncaught exception in herder work thread, exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
87738-org.apache.kafka.common.config.ConfigException: Topic 'connect-offsets' supplied via the 'offset.storage.topic' property is required to have 'cleanup.policy=compact' to guarantee consistency and durability of source connector offsets, but found the topic currently has 'cleanup.policy=delete'. Continuing would likely result in eventually losing source connector offsets and problems restarting this Connect cluster in the future. Change the 'offset.storage.topic' property in the Connect worker configurations to use a topic with 'cleanup.policy=compact'.

 

After that error we added log.cleanup.policy=compact parameter on /etc/kafka/server.properties and kafka-connector service started but a few days later all the connectors are down with attached error.

 

Could you please let us know how we can resolved the issue?

 

Best regards and thanks

Fátima

NGA -Alight

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)