You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Alexander Gavrilov (JIRA)" <ji...@apache.org> on 2018/05/01 17:47:00 UTC
[jira] [Created] (KAFKA-6842) initTransactions hangs when trying to
connect to non-existing broker
Alexander Gavrilov created KAFKA-6842:
-----------------------------------------
Summary: initTransactions hangs when trying to connect to non-existing broker
Key: KAFKA-6842
URL: https://issues.apache.org/jira/browse/KAFKA-6842
Project: Kafka
Issue Type: Bug
Components: producer
Affects Versions: 1.1.0
Reporter: Alexander Gavrilov
When I specify a non-existing broker as a bootstrap server, 'initTransactions' hangs forever. Here is a simple code to reproduce an issue:
{code:java}
Map<String, Object> props = new HashMap<>();
props.put(ProducerConfig.BOOTSTRAP_SERVERS_CONFIG, "example.com:49092");
props.put(ProducerConfig.ACKS_CONFIG, "all");
props.put(ProducerConfig.BATCH_SIZE_CONFIG, 16384);
props.put(ProducerConfig.LINGER_MS_CONFIG, 1);
props.put(ProducerConfig.BUFFER_MEMORY_CONFIG, 33554432);
props.put(ProducerConfig.MAX_BLOCK_MS_CONFIG, 3000);
props.put(ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG, 3000);
props.put(ProducerConfig.TRANSACTIONAL_ID_CONFIG, "test_transactional_id");
Producer<String, byte[]> producer = new KafkaProducer<>(props, new StringSerializer(), new ByteArraySerializer());
producer.initTransactions();
{code}
The trace log file:
{noformat}
979 [main] INFO org.apache.kafka.common.utils.AppInfoParser - Kafka version : 1.1.0
979 [main] INFO org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : fdcf75ea326b8e07
981 [main] DEBUG org.apache.kafka.clients.producer.KafkaProducer - [Producer clientId=producer-1, transactionalId=test_transactional_id] Kafka producer started
982 [main] DEBUG org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Transition from state UNINITIALIZED to INITIALIZING
982 [main] INFO org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] ProducerId set to -1 with epoch -1
1147 [main] DEBUG org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Enqueuing transactional request (type=InitProducerIdRequest, transactionalId=test_transactional_id, transactionTimeoutMs=60000)
1147 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Request (type=InitProducerIdRequest, transactionalId=test_transactional_id, transactionTimeoutMs=60000) dequeued for sending
1148 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Enqueuing transactional request (type=FindCoordinatorRequest, coordinatorKey=test_transactional_id, coordinatorType=TRANSACTION)
1148 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Enqueuing transactional request (type=InitProducerIdRequest, transactionalId=test_transactional_id, transactionTimeoutMs=60000)
1149 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.producer.internals.TransactionManager - [Producer clientId=producer-1, transactionalId=test_transactional_id] Request (type=FindCoordinatorRequest, coordinatorKey=test_transactional_id, coordinatorType=TRANSACTION) dequeued for sending
1149 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
1150 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Initiating connection to node example.com:49092 (id: -1 rack: null)
4250 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
4250 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
4250 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
4300 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
4351 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
4401 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
.... many similar message about 'Found least loaded node'
22087 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
22138 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
22154 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.common.metrics.Metrics - Added sensor with name node--1.bytes-sent
22155 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.common.metrics.Metrics - Added sensor with name node--1.bytes-received
22156 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.common.metrics.Metrics - Added sensor with name node--1.latency
22158 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.common.network.Selector - [Producer clientId=producer-1, transactionalId=test_transactional_id] Connection with example.com/93.184.216.34 disconnected
java.net.ConnectException: Connection timed out: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.kafka.common.network.PlaintextTransportLayer.finishConnect(PlaintextTransportLayer.java:50)
at org.apache.kafka.common.network.KafkaChannel.finishConnect(KafkaChannel.java:106)
at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:470)
at org.apache.kafka.common.network.Selector.poll(Selector.java:424)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460)
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:73)
at org.apache.kafka.clients.producer.internals.Sender.awaitLeastLoadedNodeReady(Sender.java:415)
at org.apache.kafka.clients.producer.internals.Sender.maybeSendTransactionalRequest(Sender.java:347)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:214)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:163)
at java.lang.Thread.run(Thread.java:748)
22162 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Node -1 disconnected.
22164 [kafka-producer-network-thread | producer-1] WARN org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Connection to node -1 could not be established. Broker may not be available.
22165 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.producer.internals.Sender - [Producer clientId=producer-1, transactionalId=test_transactional_id] Disconnect from null while trying to send request (type=FindCoordinatorRequest, coordinatorKey=test_transactional_id, coordinatorType=TRANSACTION). Going to back off and retry
22268 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
22269 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
22269 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Initialize connection to node example.com:49092 (id: -1 rack: null) for sending metadata request
22269 [kafka-producer-network-thread | producer-1] DEBUG org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Initiating connection to node example.com:49092 (id: -1 rack: null)
22270 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
22320 [kafka-producer-network-thread | producer-1] TRACE org.apache.kafka.clients.NetworkClient - [Producer clientId=producer-1, transactionalId=test_transactional_id] Found least loaded node example.com:49092 (id: -1 rack: null)
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)