You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Kristian Kolding Foged-Ladefoged (JIRA)" <ji...@apache.org> on 2018/07/12 08:20:00 UTC
[jira] [Created] (KAFKA-7153) Kafka commits transaction twice due
to LeaveGroup
Kristian Kolding Foged-Ladefoged created KAFKA-7153:
-------------------------------------------------------
Summary: Kafka commits transaction twice due to LeaveGroup
Key: KAFKA-7153
URL: https://issues.apache.org/jira/browse/KAFKA-7153
Project: Kafka
Issue Type: Bug
Reporter: Kristian Kolding Foged-Ladefoged
I am using transaction in kafka. I have provided my consumer container with a `ChainedKafkaTransactionManager` which consist of `JpaTransactionManager` and `KafkaTransactionManager`.
I am trying to learn how transactions are affected when a consumer is stuck and therefore send `LeaveGroup` and disables heartbeat thread.
I have set `max.poll.interval.ms` to 10 seconds.
I have not changed `session.timeout.ms`. It is 10 seconds per default.
I have two applications with one consumer each. Both consumers are transactional. Consumer A is rigged to process for 30 seconds and Consumer B process it within 1 second. Both consumers read from the same topic, which as 3 partitions.
1. Send a record to Kafka
2. Consumer A receives the record.
3. Consumer A starts to process the record.
4. Consumer A processing time exceed `max.poll.interval.ms`
5. Consumer A send LeaveGroup and heartbeat stops.
6. Kafka rebalances. All partitions are now assigned to Consumer B.
7. Consumer B receives the same record and process it.
8. Consumer B commits the transaction.
9. Consumer A has now finished processing(30 seconds).
10. Consumer A commits the transaction.
11. Kafka rebalances. Partitions are reassigned to both consumers.
The transaction is processed and committed twice. Both consumers should be idempotent to ensure processing the same record have no consequences.
My hypothesis was that Consumer A would throw an exception due to LeaveGroup and stopping the heartbeat. This is however not the case. I have tested this with unique transaction IDs and transaction ID being identical in both applications - same result.
Why does Consumer A commit the transaction after LeaveGroup has been sent?
*Log for Consumer A*
*2018-07-12 11:09:00.054 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 1 records
2018-07-12 11:09:00.055 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:00.056 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state READY to IN_TRANSACTION
2018-07-12 11:09:00.056 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka transaction on producer [brave.kafka.clients.TracingProducer@77b619a8]
2018-07-12 11:09:00.057 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] l.a.BatchMessagingMessageListenerAdapter : Processing [GenericMessage [payload=[data], headers=\{kafka_offset=[50], kafka_consumer=brave.kafka.clients.TracingConsumer@1a57f4f9, kafka_timestampType=[CREATE_TIME], kafka_receivedMessageKey=[null], kafka_receivedPartitionId=[2], kafka_receivedTopic=[trans-topic], kafka_receivedTimestamp=[1531382939970], kafka_batchConvertedHeaders=[{X-B3-SpanId=[B@556a1239, X-B3-ParentSpanId=[B@11ce7b87, X-B3-Sampled=[B@18d829c3, X-B3-TraceId=[B@3d0df61d}]}]]
2018-07-12 11:09:00.080 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 51 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=78)
2018-07-12 11:09:01.623 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:01.724 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:04.709 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:04.810 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:07.793 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:07.894 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:09.738 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending LeaveGroup request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:09.740 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Sending offsets to transaction: \{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}}
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Begin adding offsets \{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group mygrp42 to transaction
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42)
2018-07-12 11:09:15.126 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.128 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Successfully added partition for consumer group mygrp42 to transaction
2018-07-12 11:09:15.128 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=TxnOffsetCommitRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42, offsets=\{trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.129 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Successfully added offsets \{trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer group mygrp42 to transaction.
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction commit
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, result=COMMIT)
2018-07-12 11:09:15.130 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.131 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state COMMITTING_TRANSACTION to READY
2018-07-12 11:09:15.131 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:15.131 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Revoking previously assigned partitions [trans-topic-2]
2018-07-12 11:09:15.131 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions revoked: [trans-topic-2]
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:15.132 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] (Re-)joining group
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending JoinGroup ((type: JoinGroupRequest, groupId=mygrp42, sessionTimeout=15000, rebalanceTimeout=10000, memberId=, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@5edc7bc1)) to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:15.132 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] LeaveGroup request returned successfully
2018-07-12 11:09:16.580 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful JoinGroup response: org.apache.kafka.common.requests.JoinGroupResponse@518649f1
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending follower SyncGroup to coordinator localhost:9092 (id: 2147483647 rack: null): (type=SyncGroupRequest, groupId=mygrp42, generationId=128, memberId=consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247, groupAssignment=)
2018-07-12 11:09:16.582 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Successfully joined group with generation 128
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Enabling heartbeat thread
2018-07-12 11:09:16.583 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Setting newly assigned partitions [trans-topic-2]
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Fetching committed offsets for partitions: [trans-topic-2]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Resetting offset for partition trans-topic-2 to the committed offset 51
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing on assignment: \{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}}
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state READY to IN_TRANSACTION
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka transaction on producer [brave.kafka.clients.TracingProducer@1b458b1b]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Begin adding offsets \{trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group mygrp42 to transaction
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42)
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Successfully added partition for consumer group mygrp42 to transaction
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=TxnOffsetCommitRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, consumerGroupId=mygrp42, offsets=\{trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Successfully added offsets \{trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer group mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction commit
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Enqueuing transactional request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, result=COMMIT)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-1, transactionalId=transactionId420] Sending transactional request (type=EndTxnRequest, transactionalId=transactionId420, producerId=0, producerEpoch=83, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ad | producer-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-1, transactionalId=transactionId420] Transition from state COMMITTING_TRANSACTION to READY
2018-07-12 11:09:16.588 INFO [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions assigned: [trans-topic-2]
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.588 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.095 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:17.096 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.096 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:17.599 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.102 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:18.135 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
2018-07-12 11:09:18.135 DEBUG [kafka-transaction-microservice-example,,,] 55757 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}***
*Log for Consumer B*
{code:java}
2018-07-12 11:09:11.009 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 1 records
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state READY to IN_TRANSACTION
2018-07-12 11:09:11.010 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka transaction on producer [brave.kafka.clients.TracingProducer@aca7706]
2018-07-12 11:09:11.013 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] l.a.BatchMessagingMessageListenerAdapter : Processing [GenericMessage [payload=[data], headers={kafka_offset=[50], kafka_consumer=brave.kafka.clients.TracingConsumer@300b85c2, kafka_timestampType=[CREATE_TIME], kafka_receivedMessageKey=[null], kafka_receivedPartitionId=[2], kafka_receivedTopic=[trans-topic], kafka_receivedTimestamp=[1531382939970], kafka_batchConvertedHeaders=[{X-B3-SpanId=[B@44df9896, X-B3-ParentSpanId=[B@3a54aa3c, X-B3-Sampled=[B@118559f1, X-B3-TraceId=[B@7dcceb96}]}]]
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Sending offsets to transaction: {trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}}
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Begin adding offsets {trans-topic-2=OffsetAndMetadata{offset=51, metadata=''}} for consumer group mygrp42 to transaction
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42)
2018-07-12 11:09:11.016 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.018 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Successfully added partition for consumer group mygrp42 to transaction
2018-07-12 11:09:11.018 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=TxnOffsetCommitRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42, offsets={trans-topic-2=CommittedOffset(offset=51, metadata='')}) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Successfully added offsets {trans-topic-2=CommittedOffset(offset=51, metadata='')} from consumer group mygrp42 to transaction.
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction commit
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, result=COMMIT)
2018-07-12 11:09:11.019 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.021 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state COMMITTING_TRANSACTION to READY
2018-07-12 11:09:11.021 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:11.512 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.017 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:12.520 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.023 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.024 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.024 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.525 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.525 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.526 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:13.572 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:13.574 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful Heartbeat response
2018-07-12 11:09:14.024 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
2018-07-12 11:09:14.024 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.028 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:14.530 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.033 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.042 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.545 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:15.546 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.049 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.050 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 44 for partition trans-topic-1 returned fetch data (error=NONE, highWaterMark=44, lastStableOffset = -1, logStartOffset = 40, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 423 for partition trans-topic-0 returned fetch data (error=NONE, highWaterMark=423, lastStableOffset = -1, logStartOffset = 417, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Fetch READ_UNCOMMITTED at offset 52 for partition trans-topic-2 returned fetch data (error=NONE, highWaterMark=52, lastStableOffset = -1, logStartOffset = 48, abortedTransactions = null, recordsSizeInBytes=0)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-1 at offset 44 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-0 at offset 423 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Added READ_UNCOMMITTED fetch request for partition trans-topic-2 at offset 52 to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.553 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Sending READ_UNCOMMITTED fetch for partitions [trans-topic-1, trans-topic-0, trans-topic-2] to broker localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.576 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [hread | mygrp42] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending Heartbeat request to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Attempt to heartbeat failed since group is rebalancing
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Revoking previously assigned partitions [trans-topic-1, trans-topic-0, trans-topic-2]
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions revoked: [trans-topic-1, trans-topic-0, trans-topic-2]
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Commit list: {}
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Disabling heartbeat thread
2018-07-12 11:09:16.578 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] (Re-)joining group
2018-07-12 11:09:16.578 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending JoinGroup ((type: JoinGroupRequest, groupId=mygrp42, sessionTimeout=15000, rebalanceTimeout=10000, memberId=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@5f4ca2f4)) to coordinator localhost:9092 (id: 2147483647 rack: null)
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Received successful JoinGroup response: org.apache.kafka.common.requests.JoinGroupResponse@4825e9a2
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Performing assignment using strategy range with subscriptions {consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c=Subscription(topics=[trans-topic]), consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247=Subscription(topics=[trans-topic])}
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Finished assignment for group: {consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c=Assignment(partitions=[trans-topic-0, trans-topic-1]), consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247=Assignment(partitions=[trans-topic-2])}
2018-07-12 11:09:16.581 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Sending leader SyncGroup to coordinator localhost:9092 (id: 2147483647 rack: null): (type=SyncGroupRequest, groupId=mygrp42, generationId=128, memberId=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c, groupAssignment=consumer-1-041b7478-7f02-4aeb-9fd3-31c0898ecd5c,consumer-1-73cee281-2953-4657-9f6e-af5d5cb6e247)
2018-07-12 11:09:16.582 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Successfully joined group with generation 128
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Enabling heartbeat thread
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] org.apache.kafka.common.metrics.Metrics : Removed sensor with name trans-topic-2.records-lag
2018-07-12 11:09:16.583 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Setting newly assigned partitions [trans-topic-1, trans-topic-0]
2018-07-12 11:09:16.583 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=mygrp42] Fetching committed offsets for partitions: [trans-topic-1, trans-topic-0]
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Resetting offset for partition trans-topic-1 to the committed offset 43
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.consumer.internals.Fetcher : [Consumer clientId=consumer-1, groupId=mygrp42] Resetting offset for partition trans-topic-0 to the committed offset 422
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Committing on assignment: {trans-topic-1=OffsetAndMetadata{offset=43, metadata=''}, trans-topic-0=OffsetAndMetadata{offset=422, metadata=''}}
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Creating new transaction with name [null]: PROPAGATION_REQUIRED,ISOLATION_DEFAULT
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state READY to IN_TRANSACTION
2018-07-12 11:09:16.584 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Created Kafka transaction on producer [brave.kafka.clients.TracingProducer@58834673]
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Begin adding offsets {trans-topic-1=OffsetAndMetadata{offset=43, metadata=''}, trans-topic-0=OffsetAndMetadata{offset=422, metadata=''}} for consumer group mygrp42 to transaction
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42)
2018-07-12 11:09:16.585 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=AddOffsetsToTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Successfully added partition for consumer group mygrp42 to transaction
2018-07-12 11:09:16.586 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=TxnOffsetCommitRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, consumerGroupId=mygrp42, offsets={trans-topic-1=CommittedOffset(offset=43, metadata=''), trans-topic-0=CommittedOffset(offset=422, metadata='')}) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Successfully added offsets {trans-topic-1=CommittedOffset(offset=43, metadata=''), trans-topic-0=CommittedOffset(offset=422, metadata='')} from consumer group mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Successfully added offsets {trans-topic-0=CommittedOffset(offset=422, metadata='')} from consumer group mygrp42 to transaction.
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.t.KafkaTransactionManager : Initiating transaction commit
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state IN_TRANSACTION to COMMITTING_TRANSACTION
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Enqueuing transactional request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, result=COMMIT)
2018-07-12 11:09:16.587 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.clients.producer.internals.Sender : [Producer clientId=producer-2, transactionalId=transactionId421] Sending transactional request (type=EndTxnRequest, transactionalId=transactionId421, producerId=1, producerEpoch=16, result=COMMIT) to node localhost:9092 (id: 0 rack: null)
2018-07-12 11:09:16.595 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ad | producer-2] o.a.k.c.p.internals.TransactionManager : [Producer clientId=producer-2, transactionalId=transactionId421] Transition from state COMMITTING_TRANSACTION to READY
2018-07-12 11:09:16.596 INFO [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions assigned: [trans-topic-1, trans-topic-0]
2018-07-12 11:09:17.024 DEBUG [kafka-transaction-microservice-example,,,] 55753 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Received: 0 records
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)