You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Ott, Charles H." <CH...@saic.com> on 2013/03/11 20:30:22 UTC
NoBrokersForPartitionException
I am trying to do something like this:
1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to getKafka
service.
2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
3.) Producer (Server A) attempts to publish message to Kafka (Server
C) using IP resolved from zookeeper.
I am getting an error when attempting to write a message to a Kafka
topic.
kafka.common.NoBrokersForPartitionException: Partition = null
at
kafka.producer.Producer.kafka$producer$Producer$$getPartitionListForTopi
c(Producer.scala:167)
at kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
at kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
ala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
ala:206)
at
scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.s
cala:34)
at
scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at
scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
at kafka.producer.Producer.zkSend(Producer.scala:105)
at kafka.producer.Producer.send(Producer.scala:99)
at kafka.javaapi.producer.Producer.send(Producer.scala:103)
at
com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerConnect
ion.java:76)
I believe this implies that the Java Client cannot publish to the Kafka
server. How would I go about trouble shooting this? What does
NoBrokersForPartition mean? Currently I have a different Client (Server
D) that is able to publish messages with custom topic to Server C
without error.
Thanks,
Charles
Re: NoBrokersForPartitionException
Posted by Jun Rao <ju...@gmail.com>.
Casey,
I am not exactly sure what's causing this particular issue. However, a
bunch of produce side issues got fixed in 0.7.2.
Thanks,
Jun
On Mon, Jul 15, 2013 at 5:11 AM, Sybrandy, Casey <
Casey.Sybrandy@six3systems.com> wrote:
> Jun,
>
> Unfortunately, upgrades are slow to occur with respect to projects, so I
> don't know when this will occur. However, it looks like we will be
> upgrading over the next couple months to 0.7.2.
>
> Regardless, what is causing this? Is this a bug in Kafka or is it
> something that triggered by something we did? I only ask because it looked
> like the directories for the specific topic I was looking for disappeared,
> so it seemed like someone deleted them.
>
> Casey
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Thursday, July 11, 2013 1:17 AM
> To: users@kafka.apache.org
> Subject: Re: NoBrokersForPartitionException
>
> Could you try 0.7.2?
>
> Thanks,
>
> Jun
>
>
> On Wed, Jul 10, 2013 at 11:38 AM, Sybrandy, Casey <
> Casey.Sybrandy@six3systems.com> wrote:
>
> > Hello,
> >
> > Apologies for bringing this back from the dead, but I'm getting the
> > same exception using Kafka 0.7.0. What could be causing this?
> >
> > Thanks.
> >
> > Casey
> >
> > -----Original Message-----
> > From: Jun Rao [mailto:junrao@gmail.com]
> > Sent: Tuesday, March 12, 2013 12:14 AM
> > To: users@kafka.apache.org
> > Subject: Re: NoBrokersForPartitionException
> >
> > Which version of Kafka are you using?
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Mar 11, 2013 at 12:30 PM, Ott, Charles H.
> > <CHARLES.H.OTT@saic.com
> > >wrote:
> >
> > >
> > >
> > > I am trying to do something like this:
> > >
> > > 1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to
> getKafka
> > > service.
> > >
> > > 2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
> > >
> > > 3.) Producer (Server A) attempts to publish message to Kafka (Server
> > > C) using IP resolved from zookeeper.
> > >
> > >
> > >
> > > I am getting an error when attempting to write a message to a Kafka
> > > topic.
> > >
> > >
> > >
> > > kafka.common.NoBrokersForPartitionException: Partition = null
> > >
> > > at
> > > kafka.producer.Producer.kafka$producer$Producer$$getPartitionListFor
> > > To
> > > pi
> > > c(Producer.scala:167)
> > >
> > > at
> > > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
> > >
> > > at
> > > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
> > >
> > > at
> > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > > sc
> > > ala:206)
> > >
> > > at
> > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > > sc
> > > ala:206)
> > >
> > > at
> > > scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimiz
> > > ed
> > > .s
> > > cala:34)
> > >
> > > at
> > > scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
> > >
> > > at
> > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206
> > > )
> > >
> > > at
> > > scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
> > >
> > > at kafka.producer.Producer.zkSend(Producer.scala:105)
> > >
> > > at kafka.producer.Producer.send(Producer.scala:99)
> > >
> > > at kafka.javaapi.producer.Producer.send(Producer.scala:103)
> > >
> > > at
> > > com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerCon
> > > ne
> > > ct
> > > ion.java:76)
> > >
> > >
> > >
> > > I believe this implies that the Java Client cannot publish to the
> > > Kafka server. How would I go about trouble shooting this? What does
> > > NoBrokersForPartition mean? Currently I have a different Client
> > > (Server
> > > D) that is able to publish messages with custom topic to Server C
> > > without error.
> > >
> > >
> > >
> > > Thanks,
> > >
> > > Charles
> > >
> > >
> >
>
RE: NoBrokersForPartitionException
Posted by "Sybrandy, Casey" <Ca...@Six3Systems.com>.
Jun,
Unfortunately, upgrades are slow to occur with respect to projects, so I don't know when this will occur. However, it looks like we will be upgrading over the next couple months to 0.7.2.
Regardless, what is causing this? Is this a bug in Kafka or is it something that triggered by something we did? I only ask because it looked like the directories for the specific topic I was looking for disappeared, so it seemed like someone deleted them.
Casey
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Thursday, July 11, 2013 1:17 AM
To: users@kafka.apache.org
Subject: Re: NoBrokersForPartitionException
Could you try 0.7.2?
Thanks,
Jun
On Wed, Jul 10, 2013 at 11:38 AM, Sybrandy, Casey < Casey.Sybrandy@six3systems.com> wrote:
> Hello,
>
> Apologies for bringing this back from the dead, but I'm getting the
> same exception using Kafka 0.7.0. What could be causing this?
>
> Thanks.
>
> Casey
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Tuesday, March 12, 2013 12:14 AM
> To: users@kafka.apache.org
> Subject: Re: NoBrokersForPartitionException
>
> Which version of Kafka are you using?
>
> Thanks,
>
> Jun
>
> On Mon, Mar 11, 2013 at 12:30 PM, Ott, Charles H.
> <CHARLES.H.OTT@saic.com
> >wrote:
>
> >
> >
> > I am trying to do something like this:
> >
> > 1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to getKafka
> > service.
> >
> > 2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
> >
> > 3.) Producer (Server A) attempts to publish message to Kafka (Server
> > C) using IP resolved from zookeeper.
> >
> >
> >
> > I am getting an error when attempting to write a message to a Kafka
> > topic.
> >
> >
> >
> > kafka.common.NoBrokersForPartitionException: Partition = null
> >
> > at
> > kafka.producer.Producer.kafka$producer$Producer$$getPartitionListFor
> > To
> > pi
> > c(Producer.scala:167)
> >
> > at
> > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
> >
> > at
> > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
> >
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > sc
> > ala:206)
> >
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > sc
> > ala:206)
> >
> > at
> > scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimiz
> > ed
> > .s
> > cala:34)
> >
> > at
> > scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
> >
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206
> > )
> >
> > at
> > scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
> >
> > at kafka.producer.Producer.zkSend(Producer.scala:105)
> >
> > at kafka.producer.Producer.send(Producer.scala:99)
> >
> > at kafka.javaapi.producer.Producer.send(Producer.scala:103)
> >
> > at
> > com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerCon
> > ne
> > ct
> > ion.java:76)
> >
> >
> >
> > I believe this implies that the Java Client cannot publish to the
> > Kafka server. How would I go about trouble shooting this? What does
> > NoBrokersForPartition mean? Currently I have a different Client
> > (Server
> > D) that is able to publish messages with custom topic to Server C
> > without error.
> >
> >
> >
> > Thanks,
> >
> > Charles
> >
> >
>
Re: NoBrokersForPartitionException
Posted by Jun Rao <ju...@gmail.com>.
Could you try 0.7.2?
Thanks,
Jun
On Wed, Jul 10, 2013 at 11:38 AM, Sybrandy, Casey <
Casey.Sybrandy@six3systems.com> wrote:
> Hello,
>
> Apologies for bringing this back from the dead, but I'm getting the same
> exception using Kafka 0.7.0. What could be causing this?
>
> Thanks.
>
> Casey
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Tuesday, March 12, 2013 12:14 AM
> To: users@kafka.apache.org
> Subject: Re: NoBrokersForPartitionException
>
> Which version of Kafka are you using?
>
> Thanks,
>
> Jun
>
> On Mon, Mar 11, 2013 at 12:30 PM, Ott, Charles H. <CHARLES.H.OTT@saic.com
> >wrote:
>
> >
> >
> > I am trying to do something like this:
> >
> > 1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to getKafka
> > service.
> >
> > 2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
> >
> > 3.) Producer (Server A) attempts to publish message to Kafka (Server
> > C) using IP resolved from zookeeper.
> >
> >
> >
> > I am getting an error when attempting to write a message to a Kafka
> > topic.
> >
> >
> >
> > kafka.common.NoBrokersForPartitionException: Partition = null
> >
> > at
> > kafka.producer.Producer.kafka$producer$Producer$$getPartitionListForTo
> > pi
> > c(Producer.scala:167)
> >
> > at
> > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
> >
> > at
> > kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
> >
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > sc
> > ala:206)
> >
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> > sc
> > ala:206)
> >
> > at
> > scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized
> > .s
> > cala:34)
> >
> > at
> > scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
> >
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> >
> > at
> > scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
> >
> > at kafka.producer.Producer.zkSend(Producer.scala:105)
> >
> > at kafka.producer.Producer.send(Producer.scala:99)
> >
> > at kafka.javaapi.producer.Producer.send(Producer.scala:103)
> >
> > at
> > com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerConne
> > ct
> > ion.java:76)
> >
> >
> >
> > I believe this implies that the Java Client cannot publish to the
> > Kafka server. How would I go about trouble shooting this? What does
> > NoBrokersForPartition mean? Currently I have a different Client
> > (Server
> > D) that is able to publish messages with custom topic to Server C
> > without error.
> >
> >
> >
> > Thanks,
> >
> > Charles
> >
> >
>
RE: NoBrokersForPartitionException
Posted by "Sybrandy, Casey" <Ca...@Six3Systems.com>.
Hello,
Apologies for bringing this back from the dead, but I'm getting the same exception using Kafka 0.7.0. What could be causing this?
Thanks.
Casey
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Tuesday, March 12, 2013 12:14 AM
To: users@kafka.apache.org
Subject: Re: NoBrokersForPartitionException
Which version of Kafka are you using?
Thanks,
Jun
On Mon, Mar 11, 2013 at 12:30 PM, Ott, Charles H. <CH...@saic.com>wrote:
>
>
> I am trying to do something like this:
>
> 1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to getKafka
> service.
>
> 2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
>
> 3.) Producer (Server A) attempts to publish message to Kafka (Server
> C) using IP resolved from zookeeper.
>
>
>
> I am getting an error when attempting to write a message to a Kafka
> topic.
>
>
>
> kafka.common.NoBrokersForPartitionException: Partition = null
>
> at
> kafka.producer.Producer.kafka$producer$Producer$$getPartitionListForTo
> pi
> c(Producer.scala:167)
>
> at
> kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
>
> at
> kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> sc
> ala:206)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.
> sc
> ala:206)
>
> at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized
> .s
> cala:34)
>
> at
> scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
>
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
>
> at
> scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
>
> at kafka.producer.Producer.zkSend(Producer.scala:105)
>
> at kafka.producer.Producer.send(Producer.scala:99)
>
> at kafka.javaapi.producer.Producer.send(Producer.scala:103)
>
> at
> com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerConne
> ct
> ion.java:76)
>
>
>
> I believe this implies that the Java Client cannot publish to the
> Kafka server. How would I go about trouble shooting this? What does
> NoBrokersForPartition mean? Currently I have a different Client
> (Server
> D) that is able to publish messages with custom topic to Server C
> without error.
>
>
>
> Thanks,
>
> Charles
>
>
Re: NoBrokersForPartitionException
Posted by Jun Rao <ju...@gmail.com>.
Which version of Kafka are you using?
Thanks,
Jun
On Mon, Mar 11, 2013 at 12:30 PM, Ott, Charles H. <CH...@saic.com>wrote:
>
>
> I am trying to do something like this:
>
> 1.) Java Client Producer(Sever A) -> Zookeeper (Server B) to getKafka
> service.
>
> 2.) Zookeeper gives IP for Kafka (Server C) to Producer (Server A)
>
> 3.) Producer (Server A) attempts to publish message to Kafka (Server
> C) using IP resolved from zookeeper.
>
>
>
> I am getting an error when attempting to write a message to a Kafka
> topic.
>
>
>
> kafka.common.NoBrokersForPartitionException: Partition = null
>
> at
> kafka.producer.Producer.kafka$producer$Producer$$getPartitionListForTopi
> c(Producer.scala:167)
>
> at kafka.producer.Producer$$anonfun$3.apply(Producer.scala:116)
>
> at kafka.producer.Producer$$anonfun$3.apply(Producer.scala:105)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
> ala:206)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
> ala:206)
>
> at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.s
> cala:34)
>
> at
> scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
>
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
>
> at
> scala.collection.mutable.WrappedArray.map(WrappedArray.scala:32)
>
> at kafka.producer.Producer.zkSend(Producer.scala:105)
>
> at kafka.producer.Producer.send(Producer.scala:99)
>
> at kafka.javaapi.producer.Producer.send(Producer.scala:103)
>
> at
> com.saic.project.kafka.KafkaProducerConnection.push(KafkaProducerConnect
> ion.java:76)
>
>
>
> I believe this implies that the Java Client cannot publish to the Kafka
> server. How would I go about trouble shooting this? What does
> NoBrokersForPartition mean? Currently I have a different Client (Server
> D) that is able to publish messages with custom topic to Server C
> without error.
>
>
>
> Thanks,
>
> Charles
>
>