[jira] [Commented] (KAFKA-13223) Idempotent producer error with Kraft

["Colin McCabe (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403333#comment-17403333 ] 

Colin McCabe commented on KAFKA-13223:
--------------------------------------

Thanks for trying this out. EOS + kraft wasn't supported in CP 6.2.0, which was based on AK 2.8. What you're trying should work in the upcoming CP 7.0 release (based on AK 3.0).

> Idempotent producer error with Kraft 
> -------------------------------------
>
>                 Key: KAFKA-13223
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13223
>             Project: Kafka
>          Issue Type: Bug
>          Components: kraft, producer 
>            Reporter: Laurynas Butkus
>            Priority: Major
>
> I get an error *"The broker does not support INIT_PRODUCER_ID"* if I try to produce a message idempotence enabled.
> Result:
> {code:java}
> ➜  ./bin/kafka-console-producer.sh --bootstrap-server localhost:9092 --topic test --request-required-acks -1 --producer-property enable.idempotence=true
> >test
> >[2021-08-23 19:40:33,356] ERROR [Producer clientId=console-producer] Aborting producer batches due to fatal error (org.apache.kafka.clients.producer.internals.Sender)
> org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support INIT_PRODUCER_ID
> [2021-08-23 19:40:33,358] ERROR Error when sending message to topic test with key: null, value: 4 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
> org.apache.kafka.common.errors.UnsupportedVersionException: The broker does not support INIT_PRODUCER_ID
> {code}
>  
> It works fine with idempotence disabled. Also it works fine if using zookeeper.
> Tested with altered docker image: 
> {code:java}
> FROM confluentinc/cp-kafka:6.2.0
> RUN sed -i '/KAFKA_ZOOKEEPER_CONNECT/d' /etc/confluent/docker/configure && \
> # Docker workaround: Ignore cub zk-ready
> sed -i 's/cub zk-ready/echo ignore zk-ready/' /etc/confluent/docker/ensure && \
> # KRaft required step: Format the storage directory with a new cluster ID
> echo "kafka-storage format --ignore-formatted -t $(kafka-storage random-uuid) -c /etc/kafka/kafka.properties" >> /etc/confluent/docker/ensure
> {code}
> docker-compose.yml
> {code:java}
> version: '3.4'
> services:
>   kafka:
>     build: kafka
>     restart: unless-stopped
>     environment:
>       ALLOW_PLAINTEXT_LISTENER: "yes"
>       KAFKA_HEAP_OPTS: -Xms256m -Xmx256m
>       LOG4J_LOGGER_KAFKA: "WARN"
>       KAFKA_BROKER_ID: 1
>       KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: 'CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT'
>       KAFKA_ADVERTISED_LISTENERS: 'PLAINTEXT://kafka:29092,PLAINTEXT_HOST://127.0.0.1:9092'
>       KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
>       KAFKA_GROUP_INITIAL_REBALANCE_DELAY_MS: 0
>       KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1
>       KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
>       KAFKA_PROCESS_ROLES: 'broker,controller'
>       KAFKA_NODE_ID: 1
>       KAFKA_CONTROLLER_QUORUM_VOTERS: '1@kafka:29093'
>       KAFKA_LISTENERS: 'PLAINTEXT://kafka:29092,CONTROLLER://kafka:29093,PLAINTEXT_HOST://:9092'
>       KAFKA_INTER_BROKER_LISTENER_NAME: 'PLAINTEXT'
>       KAFKA_CONTROLLER_LISTENER_NAMES: 'CONTROLLER'
>       KAFKA_LOG_DIRS: '/tmp/kraft-combined-logs'
>     ports:
>       - "127.0.0.1:9092:9092/tcp"
>     command: "/etc/confluent/docker/run"
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)