You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Deepak Dhakal <dd...@salesforce.com> on 2015/02/19 00:16:00 UTC
Kakfa question about starting kafka with same broker id
Hi,
My name is Deepak and I work for salesforce. We are using kafka 8.11 and
have a question about starting kafka with same broker id.
Steps:
Start a kakfa broker with broker id =1 -> it starts fine with external ZK
Start another kafka with same broker id =1 .. it does not start the kafka
which is expected but I am seeing the following log and it keeps retrying
forever.
Is there way to control how many time a broker tries to starts itself with
the same broker id ?
Thanks
Deepak
[2015-02-18 14:47:20,713] INFO conflict in /controller data:
{"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
{"version":1,"brokerid":19471,"timestamp":"1424288444314"}
(kafka.utils.ZkUtils$)
[2015-02-18 14:47:20,716] INFO I wrote this conflicted ephemeral node
[{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
a while back in a different session, hence I will backoff for this node to
be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
[2015-02-18 14:47:30,719] INFO conflict in /controller data:
{"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
{"version":1,"brokerid":19471,"timestamp":"1424288444314"}
(kafka.utils.ZkUtils$)
[2015-02-18 14:47:30,722] INFO I wrote this conflicted ephemeral node
[{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
a while back in a different session, hence I will backoff for this node to
be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
Re: Kakfa question about starting kafka with same broker id
Posted by Steve Morin <st...@gmail.com>.
Why would you want to ever do that?
> On Feb 18, 2015, at 15:16, Deepak Dhakal <dd...@salesforce.com> wrote:
>
> Hi,
>
> My name is Deepak and I work for salesforce. We are using kafka 8.11 and
> have a question about starting kafka with same broker id.
>
> Steps:
>
> Start a kakfa broker with broker id =1 -> it starts fine with external ZK
> Start another kafka with same broker id =1 .. it does not start the kafka
> which is expected but I am seeing the following log and it keeps retrying
> forever.
>
> Is there way to control how many time a broker tries to starts itself with
> the same broker id ?
>
>
> Thanks
> Deepak
>
> [2015-02-18 14:47:20,713] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:20,716] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
> a while back in a different session, hence I will backoff for this node to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,719] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,722] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
> a while back in a different session, hence I will backoff for this node to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
Re: Kakfa question about starting kafka with same broker id
Posted by Harsha <ka...@harsha.io>.
Deepak,
You should getting following error and kafka server will shutdown
itself it it sees same brokerid registered in zookeeper.
" Fatal error during KafkaServer startup. Prepare to shutdown
(kafka.server.KafkaServer)
java.lang.RuntimeException: A broker is already registered on the path
/brokers/ids/0. This probably indicates that you either have configured
a brokerid that is already in use, or else you have shutdown this broker
and restarted it faster than the zookeeper timeout so it appears to be
re-registering."
-Harsha
On Wed, Feb 18, 2015, at 03:16 PM, Deepak Dhakal wrote:
> Hi,
>
> My name is Deepak and I work for salesforce. We are using kafka 8.11 and
> have a question about starting kafka with same broker id.
>
> Steps:
>
> Start a kakfa broker with broker id =1 -> it starts fine with external ZK
> Start another kafka with same broker id =1 .. it does not start the kafka
> which is expected but I am seeing the following log and it keeps retrying
> forever.
>
> Is there way to control how many time a broker tries to starts itself
> with
> the same broker id ?
>
>
> Thanks
> Deepak
>
> [2015-02-18 14:47:20,713] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:20,716] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at
> /controller
> a while back in a different session, hence I will backoff for this node
> to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,719] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,722] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at
> /controller
> a while back in a different session, hence I will backoff for this node
> to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
Re: Kakfa question about starting kafka with same broker id
Posted by Jun Rao <ju...@confluent.io>.
This is likely caused by ZK client session expiration. Which version of ZK
are you using?
Thanks,
Jun
On Wed, Feb 18, 2015 at 3:16 PM, Deepak Dhakal <dd...@salesforce.com>
wrote:
> Hi,
>
> My name is Deepak and I work for salesforce. We are using kafka 8.11 and
> have a question about starting kafka with same broker id.
>
> Steps:
>
> Start a kakfa broker with broker id =1 -> it starts fine with external ZK
> Start another kafka with same broker id =1 .. it does not start the kafka
> which is expected but I am seeing the following log and it keeps retrying
> forever.
>
> Is there way to control how many time a broker tries to starts itself with
> the same broker id ?
>
>
> Thanks
> Deepak
>
> [2015-02-18 14:47:20,713] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:20,716] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
> a while back in a different session, hence I will backoff for this node to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,719] INFO conflict in /controller data:
> {"version":1,"brokerid":19471,"timestamp":"1424299100135"} stored data:
> {"version":1,"brokerid":19471,"timestamp":"1424288444314"}
> (kafka.utils.ZkUtils$)
>
> [2015-02-18 14:47:30,722] INFO I wrote this conflicted ephemeral node
> [{"version":1,"brokerid":19471,"timestamp":"1424299100135"}] at /controller
> a while back in a different session, hence I will backoff for this node to
> be deleted by Zookeeper and retry (kafka.utils.ZkUtils$)
>