You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Gert van Dijk (JIRA)" <ji...@apache.org> on 2019/02/12 20:22:00 UTC
[jira] [Updated] (KAFKA-7924) Kafka broker does not list nodes
first ~ 30s after startup
[ https://issues.apache.org/jira/browse/KAFKA-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gert van Dijk updated KAFKA-7924:
---------------------------------
Description:
Steps to reproduce:
# Start single Zookeeper instance.
# Start single Kafka instance.
# Validate that the line {noformat}INFO [KafkaServer id=0] started (kafka.server.KafkaServer){noformat} is printed.
# Connect using a Kafka client +with debug logging enabled+, right after seeing that line, _do not wait_.
# Observe that it is connected to the Kafka broker just fine, but that the broker lists an +empty lists of nodes+: {noformat}Updating cluster metadata to Cluster(id = xxx, nodes = [], [...]{noformat}
# Keep watching for about 30 seconds, seeing that log entry popping up hundreds of times on the client. Nothing happens in Kafka/Zookeeper logs in the meantime, but then suddenly the Kafka server start reporting nodes to the connected client: {noformat}[...] nodes = [kafka:9092 (id: 0 rack: null)], [...]
o.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Initiating connection to node [...]{noformat} and it connects all fine.
My expectation is that it should list itself rightaway after listening on the network as a broker. It should not take ~ 30 seconds for a Kafka client to be blocked waiting and timing out first.
Use case: I'm trying to create topics in a CI/CD pipeline and spinning up a clean Kafka for that. Right after it's started, it should be possible to create topics using an AdminClient, but currently experiencing {{TimeoutException: Timed out waiting for a node assignment}} errors unless I put a {{sleep 30}} between observing a Kafka reportedly ready and starting the topic creation process. Not very ideal.
was:
Steps to reproduce:
# Start single Zookeeper instance.
# Start single Kafka instance.
# Validate that the line {noformat}INFO [KafkaServer id=0] started (kafka.server.KafkaServer){noformat} is printed.
# Connect using a Kafka client +with debug logging enabled+, right after seeing that line, _do not wait_.
# Observe that it is connected to the Kafka broker just fine, but that the broker lists an empty lists of nodes: {noformat}Updating cluster metadata to Cluster(id = xxx, nodes = [], [...]{noformat}
# Keep watching for about 30 seconds, seeing that log entry popping up hundreds of times. Nothing happens in Kafka/Zookeeper logs in the meantime, but then suddenly the Kafka server start reporting nodes to the connected client: {noformat}[...] nodes = [kafka:9092 (id: 0 rack: null)], [...]
o.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Initiating connection to node [...]{noformat} and it connects all fine.
My expectation is that it should list itself rightaway after listening on the network as a broker. It should not take ~ 30 seconds for a Kafka client to be blocked waiting and timing out first.
Use case: I'm trying to create topics in a CI/CD pipeline and spinning up a clean Kafka for that. Right after it's started, it should be possible to create topics using an AdminClient, but currently experiencing {{TimeoutException: Timed out waiting for a node assignment}} errors unless I put a {{sleep 30}} between observing a Kafka reportedly ready and starting the topic creation process. Not very ideal.
> Kafka broker does not list nodes first ~ 30s after startup
> ----------------------------------------------------------
>
> Key: KAFKA-7924
> URL: https://issues.apache.org/jira/browse/KAFKA-7924
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 2.1.0
> Environment: Clean Docker environment, very simple everything single node.
> Reporter: Gert van Dijk
> Priority: Major
>
> Steps to reproduce:
> # Start single Zookeeper instance.
> # Start single Kafka instance.
> # Validate that the line {noformat}INFO [KafkaServer id=0] started (kafka.server.KafkaServer){noformat} is printed.
> # Connect using a Kafka client +with debug logging enabled+, right after seeing that line, _do not wait_.
> # Observe that it is connected to the Kafka broker just fine, but that the broker lists an +empty lists of nodes+: {noformat}Updating cluster metadata to Cluster(id = xxx, nodes = [], [...]{noformat}
> # Keep watching for about 30 seconds, seeing that log entry popping up hundreds of times on the client. Nothing happens in Kafka/Zookeeper logs in the meantime, but then suddenly the Kafka server start reporting nodes to the connected client: {noformat}[...] nodes = [kafka:9092 (id: 0 rack: null)], [...]
> o.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Initiating connection to node [...]{noformat} and it connects all fine.
> My expectation is that it should list itself rightaway after listening on the network as a broker. It should not take ~ 30 seconds for a Kafka client to be blocked waiting and timing out first.
> Use case: I'm trying to create topics in a CI/CD pipeline and spinning up a clean Kafka for that. Right after it's started, it should be possible to create topics using an AdminClient, but currently experiencing {{TimeoutException: Timed out waiting for a node assignment}} errors unless I put a {{sleep 30}} between observing a Kafka reportedly ready and starting the topic creation process. Not very ideal.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)