You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Prasanna Kumar Jalakam <pr...@imimobile.com> on 2013/01/23 12:52:16 UTC
LeaderNotAvailable Exception
Hi All,
I am new to Apache Kafka. I am facing an issue while starting the producer.
kafka.common.LeaderNotAvailableException: Leader not local for topic test partition 0 on broker 0
at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
I have tried hard to find out. But I am unable to find the solution.
So, Please help me to out.
Thanks in advance.
Regards
J. Prasanna Kumar
Re: LeaderNotAvailable Exception
Posted by Neha Narkhede <ne...@gmail.com>.
> I have only one small doubt. Can we set requests to be consumed by only
> one consumer, means like a pull operation. Once consumed it shouldn't be
> available for other consumers. Is this possible?
It seems you want the data in a topic to be consumed by multiple consumers
in a mutually exclusive way. Kafka offers this via consumer groups using
the zookeeper based consumer. The consumers in a consumer group pull data
from the configured topics in a way that, at a time, no two consumers get
the same data.
Thanks,
Neha
Re: LeaderNotAvailable Exception
Posted by Prasanna Kumar Jalakam <pr...@imimobile.com>.
Hi Neha,
Previously I have tried with trunk branch. After I have tried with 0.7
stable version. Now I am able to run some samples.
Thanks for your immediate responses.
I have only one small doubt. Can we set requests to be consumed by only one
consumer, means like a pull operation. Once consumed it shouldn't be
available for other consumers. Is this possible?
I am very new to kafka, that's why I am asking this.
Thanks in advance.
Thanks,
PrasannaKumar.
-----Original Message-----
From: Neha Narkhede
Sent: Thursday, January 24, 2013 10:46 AM
To: users@kafka.apache.org
Subject: Re: LeaderNotAvailable Exception
That seems like a bug. Would you mind filing a JIRA and explaining your
test there so we can reproduce and fix the issue ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi Neha,
>
> On zookeeper console it is appearing only once. But in Kafka - server
> console I am getting the following exception continuously when ever
> application tries to send some request.
>
> kafka.common.**LeaderNotAvailableException: Leader not local for topic
> test2 partition 0 on broker 0
> at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
> ReplicaManager.scala:168)
> at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:271)
> at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:266)
> at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
> at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
> at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105)
>
> Is this related to zookeeper or kafka? I am trying to electing leader
> manually but I am not able to do it.
>
> Any basic thing I am missing?
>
> Thanks
>
> Prasanna
>
>
> -----Original Message----- From: Neha Narkhede
> Sent: Thursday, January 24, 2013 10:10 AM
>
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailable Exception
>
> Prasanna,
>
> This log message is expected to appear once. Do you see it more than once
> in your logs ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
> prasanna.j@imimobile.com> wrote:
>
> Hi,
>>
>> I am running zookeeper in stand alone mode only. There is only partition
>> in there. So no chance for leader election. I am getting the following
>> error in zookeeper console.
>>
>> Got user-level KeeperException when processing
>> sessionid:0x13c6ace526d0000
>> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
>> Error Path:/brokers/topics/test1/****partitions/0 Error:KeeperErrorCode =
>> NoNode for /brokers/topics/test1/****partitions/0
>> (org.apache.zookeeper.server.****PrepRequestProcessor)
>>
>>
>> Please help me to sort this out.
>>
>> Thanks,
>> Prasanna
>>
>> -----Original Message----- From: Neha Narkhede
>> Sent: Wednesday, January 23, 2013 10:07 PM
>> To: users@kafka.apache.org
>> Subject: Re: LeaderNotAvailable Exception
>>
>>
>> That means the leader for partition [test, 0] is currently unavailable
>> and
>> ideally should be under another leader election. Do you see a lot of
>> these
>> errors ?
>>
>> Thanks,
>> Neha
>>
>>
>> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
>> prasanna.j@imimobile.com> wrote:
>>
>> Hi All,
>>
>>>
>>> I am new to Apache Kafka. I am facing an issue while starting the
>>> producer.
>>>
>>> kafka.common.****LeaderNotAvailableException: Leader not local for topic
>>>
>>> test
>>> partition 0 on broker 0
>>>
>>> at
>>> kafka.server.ReplicaManager.****getLeaderReplicaIfLocal(**
>>> ReplicaManager.scala:168)
>>> at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:423)
>>> at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:418)
>>> at
>>> scala.collection.****TraversableLike$$anonfun$map$****
>>> 1.apply(TraversableLike.scala:****206)
>>>
>>>
>>> I have tried hard to find out. But I am unable to find the solution.
>>>
>>> So, Please help me to out.
>>>
>>> Thanks in advance.
>>>
>>> Regards
>>> J. Prasanna Kumar
>>>
>>>
>>
>>
>>
>
>
Re: LeaderNotAvailable Exception
Posted by Neha Narkhede <ne...@gmail.com>.
That seems like a bug. Would you mind filing a JIRA and explaining your
test there so we can reproduce and fix the issue ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 8:49 PM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi Neha,
>
> On zookeeper console it is appearing only once. But in Kafka - server
> console I am getting the following exception continuously when ever
> application tries to send some request.
>
> kafka.common.**LeaderNotAvailableException: Leader not local for topic
> test2 partition 0 on broker 0
> at kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
> ReplicaManager.scala:168)
> at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:271)
> at kafka.server.KafkaApis$$**anonfun$appendToLocalLog$2.**
> apply(KafkaApis.scala:266)
> at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
> at scala.collection.**TraversableLike$$anonfun$map$**
> 1.apply(TraversableLike.scala:**206)
> at scala.collection.immutable.**Map$Map1.foreach(Map.scala:**105)
>
> Is this related to zookeeper or kafka? I am trying to electing leader
> manually but I am not able to do it.
>
> Any basic thing I am missing?
>
> Thanks
>
> Prasanna
>
>
> -----Original Message----- From: Neha Narkhede
> Sent: Thursday, January 24, 2013 10:10 AM
>
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailable Exception
>
> Prasanna,
>
> This log message is expected to appear once. Do you see it more than once
> in your logs ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
> prasanna.j@imimobile.com> wrote:
>
> Hi,
>>
>> I am running zookeeper in stand alone mode only. There is only partition
>> in there. So no chance for leader election. I am getting the following
>> error in zookeeper console.
>>
>> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
>> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
>> Error Path:/brokers/topics/test1/****partitions/0 Error:KeeperErrorCode =
>> NoNode for /brokers/topics/test1/****partitions/0
>> (org.apache.zookeeper.server.****PrepRequestProcessor)
>>
>>
>> Please help me to sort this out.
>>
>> Thanks,
>> Prasanna
>>
>> -----Original Message----- From: Neha Narkhede
>> Sent: Wednesday, January 23, 2013 10:07 PM
>> To: users@kafka.apache.org
>> Subject: Re: LeaderNotAvailable Exception
>>
>>
>> That means the leader for partition [test, 0] is currently unavailable and
>> ideally should be under another leader election. Do you see a lot of these
>> errors ?
>>
>> Thanks,
>> Neha
>>
>>
>> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
>> prasanna.j@imimobile.com> wrote:
>>
>> Hi All,
>>
>>>
>>> I am new to Apache Kafka. I am facing an issue while starting the
>>> producer.
>>>
>>> kafka.common.****LeaderNotAvailableException: Leader not local for topic
>>>
>>> test
>>> partition 0 on broker 0
>>>
>>> at
>>> kafka.server.ReplicaManager.****getLeaderReplicaIfLocal(**
>>> ReplicaManager.scala:168)
>>> at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:423)
>>> at kafka.server.KafkaApis$$****anonfun$22.apply(KafkaApis.**
>>> scala:418)
>>> at
>>> scala.collection.****TraversableLike$$anonfun$map$****
>>> 1.apply(TraversableLike.scala:****206)
>>>
>>>
>>> I have tried hard to find out. But I am unable to find the solution.
>>>
>>> So, Please help me to out.
>>>
>>> Thanks in advance.
>>>
>>> Regards
>>> J. Prasanna Kumar
>>>
>>>
>>
>>
>>
>
>
Re: LeaderNotAvailable Exception
Posted by Prasanna Kumar Jalakam <pr...@imimobile.com>.
Hi Neha,
On zookeeper console it is appearing only once. But in Kafka - server
console I am getting the following exception continuously when ever
application tries to send some request.
kafka.common.LeaderNotAvailableException: Leader not local for topic test2
partition 0 on broker 0
at
kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:271)
at
kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:266)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
Is this related to zookeeper or kafka? I am trying to electing leader
manually but I am not able to do it.
Any basic thing I am missing?
Thanks
Prasanna
-----Original Message-----
From: Neha Narkhede
Sent: Thursday, January 24, 2013 10:10 AM
To: users@kafka.apache.org
Subject: Re: LeaderNotAvailable Exception
Prasanna,
This log message is expected to appear once. Do you see it more than once
in your logs ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi,
>
> I am running zookeeper in stand alone mode only. There is only partition
> in there. So no chance for leader election. I am getting the following
> error in zookeeper console.
>
> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
> Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode =
> NoNode for /brokers/topics/test1/**partitions/0
> (org.apache.zookeeper.server.**PrepRequestProcessor)
>
> Please help me to sort this out.
>
> Thanks,
> Prasanna
>
> -----Original Message----- From: Neha Narkhede
> Sent: Wednesday, January 23, 2013 10:07 PM
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailable Exception
>
>
> That means the leader for partition [test, 0] is currently unavailable and
> ideally should be under another leader election. Do you see a lot of these
> errors ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
> prasanna.j@imimobile.com> wrote:
>
> Hi All,
>>
>> I am new to Apache Kafka. I am facing an issue while starting the
>> producer.
>>
>> kafka.common.**LeaderNotAvailableException: Leader not local for topic
>> test
>> partition 0 on broker 0
>>
>> at
>> kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
>> ReplicaManager.scala:168)
>> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:423)
>> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:418)
>> at
>> scala.collection.**TraversableLike$$anonfun$map$**
>> 1.apply(TraversableLike.scala:**206)
>>
>> I have tried hard to find out. But I am unable to find the solution.
>>
>> So, Please help me to out.
>>
>> Thanks in advance.
>>
>> Regards
>> J. Prasanna Kumar
>>
>
>
>
Re: LeaderNotAvailable Exception
Posted by Neha Narkhede <ne...@gmail.com>.
Prasanna,
This log message is expected to appear once. Do you see it more than once
in your logs ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 8:38 PM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi,
>
> I am running zookeeper in stand alone mode only. There is only partition
> in there. So no chance for leader election. I am getting the following
> error in zookeeper console.
>
> Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
> type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
> Error Path:/brokers/topics/test1/**partitions/0 Error:KeeperErrorCode =
> NoNode for /brokers/topics/test1/**partitions/0
> (org.apache.zookeeper.server.**PrepRequestProcessor)
>
> Please help me to sort this out.
>
> Thanks,
> Prasanna
>
> -----Original Message----- From: Neha Narkhede
> Sent: Wednesday, January 23, 2013 10:07 PM
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailable Exception
>
>
> That means the leader for partition [test, 0] is currently unavailable and
> ideally should be under another leader election. Do you see a lot of these
> errors ?
>
> Thanks,
> Neha
>
>
> On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
> prasanna.j@imimobile.com> wrote:
>
> Hi All,
>>
>> I am new to Apache Kafka. I am facing an issue while starting the
>> producer.
>>
>> kafka.common.**LeaderNotAvailableException: Leader not local for topic
>> test
>> partition 0 on broker 0
>>
>> at
>> kafka.server.ReplicaManager.**getLeaderReplicaIfLocal(**
>> ReplicaManager.scala:168)
>> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:423)
>> at kafka.server.KafkaApis$$**anonfun$22.apply(KafkaApis.**
>> scala:418)
>> at
>> scala.collection.**TraversableLike$$anonfun$map$**
>> 1.apply(TraversableLike.scala:**206)
>>
>> I have tried hard to find out. But I am unable to find the solution.
>>
>> So, Please help me to out.
>>
>> Thanks in advance.
>>
>> Regards
>> J. Prasanna Kumar
>>
>
>
>
Re: LeaderNotAvailable Exception
Posted by Prasanna Kumar Jalakam <pr...@imimobile.com>.
Hi,
I am running zookeeper in stand alone mode only. There is only partition in
there. So no chance for leader election. I am getting the following error in
zookeeper console.
Got user-level KeeperException when processing sessionid:0x13c6ace526d0000
type:create cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a
Error Path:/brokers/topics/test1/partitions/0 Error:KeeperErrorCode = NoNode
for /brokers/topics/test1/partitions/0
(org.apache.zookeeper.server.PrepRequestProcessor)
Please help me to sort this out.
Thanks,
Prasanna
-----Original Message-----
From: Neha Narkhede
Sent: Wednesday, January 23, 2013 10:07 PM
To: users@kafka.apache.org
Subject: Re: LeaderNotAvailable Exception
That means the leader for partition [test, 0] is currently unavailable and
ideally should be under another leader election. Do you see a lot of these
errors ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi All,
>
> I am new to Apache Kafka. I am facing an issue while starting the
> producer.
>
> kafka.common.LeaderNotAvailableException: Leader not local for topic test
> partition 0 on broker 0
>
> at
> kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>
> I have tried hard to find out. But I am unable to find the solution.
>
> So, Please help me to out.
>
> Thanks in advance.
>
> Regards
> J. Prasanna Kumar
Re: LeaderNotAvailable Exception
Posted by Neha Narkhede <ne...@gmail.com>.
That means the leader for partition [test, 0] is currently unavailable and
ideally should be under another leader election. Do you see a lot of these
errors ?
Thanks,
Neha
On Wed, Jan 23, 2013 at 3:52 AM, Prasanna Kumar Jalakam <
prasanna.j@imimobile.com> wrote:
> Hi All,
>
> I am new to Apache Kafka. I am facing an issue while starting the producer.
>
> kafka.common.LeaderNotAvailableException: Leader not local for topic test
> partition 0 on broker 0
>
> at
> kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:168)
> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:423)
> at kafka.server.KafkaApis$$anonfun$22.apply(KafkaApis.scala:418)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>
> I have tried hard to find out. But I am unable to find the solution.
>
> So, Please help me to out.
>
> Thanks in advance.
>
> Regards
> J. Prasanna Kumar