You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Krishna Raj <re...@gmail.com> on 2014/02/24 11:17:38 UTC
OffsetoutofRange Exception
Hi there,
I am a newbie to Kafka. I am trying to use the (
https://github.com/endgameinc/elasticsearch-river-kafka) plugin to pull the
messages from Kafka.
When I start the ElasticSearch, the 1st message gets pulled into the
cluster. And after no messages are pulled even there are enough messages
available.
I see the below exception continuously in kafka server log. Any information
is greatly appreciated.
Thanks !
[2014-02-24 02:12:20,832] ERROR [KafkaApi-0] Error when processing fetch
request for partition [asdaGro,0] offset 1318 from consumer with
correlation id 0 (kafka.server.KafkaApis)
kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
have log segments in the range 0 to 2.
at kafka.log.Log.read(Log.scala:429)
at
kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
at
kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
at
kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at
kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
at
kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:724)
[2014-02-24 02:12:21,833] ERROR [KafkaApi-0] Error when processing fetch
request for partition [asdaGro,0] offset 1318 from consumer with
correlation id 0 (kafka.server.KafkaApis)
kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
have log segments in the range 0 to 2.
at kafka.log.Log.read(Log.scala:429)
at
kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
at
kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
at
kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at
kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
at
kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:724)
Re: OffsetoutofRange Exception
Posted by Jun Rao <ju...@gmail.com>.
I am not sure how your plugin works. Does it use SimpleConsumer or the high
level consumer? Which version of Kafka is it on?
Thanks,
Jun
On Mon, Feb 24, 2014 at 12:28 PM, Krishna Raj <re...@gmail.com>wrote:
> Hi Jun,
>
> I have exactly 2 messages when I run the console consumer. I am totally
> confused why my API Consumer looks for 1318 offset.
>
> Any help is greatly appreciated !
>
> Thanks,
> KR
>
>
> On Mon, Feb 24, 2014 at 7:37 AM, Jun Rao <ju...@gmail.com> wrote:
>
> > The following log says there are only 2 messages in the log.
> >
> > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we
> only
> > have log segments in the range 0 to 2.
> >
> > If you run console consumer on that topic (using --from-beginning), how
> > many messages do you see?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Mon, Feb 24, 2014 at 2:17 AM, Krishna Raj <reach.krishnaraj@gmail.com
> > >wrote:
> >
> > > Hi there,
> > >
> > > I am a newbie to Kafka. I am trying to use the (
> > > https://github.com/endgameinc/elasticsearch-river-kafka) plugin to
> pull
> > > the
> > > messages from Kafka.
> > >
> > > When I start the ElasticSearch, the 1st message gets pulled into the
> > > cluster. And after no messages are pulled even there are enough
> messages
> > > available.
> > >
> > > I see the below exception continuously in kafka server log. Any
> > information
> > > is greatly appreciated.
> > >
> > > Thanks !
> > >
> > >
> > > [2014-02-24 02:12:20,832] ERROR [KafkaApi-0] Error when processing
> fetch
> > > request for partition [asdaGro,0] offset 1318 from consumer with
> > > correlation id 0 (kafka.server.KafkaApis)
> > > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we
> > only
> > > have log segments in the range 0 to 2.
> > > at kafka.log.Log.read(Log.scala:429)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> > > at
> > >
> > >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > > at
> > >
> > >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > > at
> > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> > > at
> kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> > > at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> > > at
> > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > > at java.lang.Thread.run(Thread.java:724)
> > > [2014-02-24 02:12:21,833] ERROR [KafkaApi-0] Error when processing
> fetch
> > > request for partition [asdaGro,0] offset 1318 from consumer with
> > > correlation id 0 (kafka.server.KafkaApis)
> > > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we
> > only
> > > have log segments in the range 0 to 2.
> > > at kafka.log.Log.read(Log.scala:429)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> > > at
> > >
> > >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > > at
> > >
> > >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > > at
> > > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > > at
> > >
> > >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> > > at
> kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> > > at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> > > at
> > > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > > at java.lang.Thread.run(Thread.java:724)
> > >
> >
>
Re: OffsetoutofRange Exception
Posted by Krishna Raj <re...@gmail.com>.
Hi Jun,
I have exactly 2 messages when I run the console consumer. I am totally
confused why my API Consumer looks for 1318 offset.
Any help is greatly appreciated !
Thanks,
KR
On Mon, Feb 24, 2014 at 7:37 AM, Jun Rao <ju...@gmail.com> wrote:
> The following log says there are only 2 messages in the log.
>
> kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
> have log segments in the range 0 to 2.
>
> If you run console consumer on that topic (using --from-beginning), how
> many messages do you see?
>
> Thanks,
>
> Jun
>
>
> On Mon, Feb 24, 2014 at 2:17 AM, Krishna Raj <reach.krishnaraj@gmail.com
> >wrote:
>
> > Hi there,
> >
> > I am a newbie to Kafka. I am trying to use the (
> > https://github.com/endgameinc/elasticsearch-river-kafka) plugin to pull
> > the
> > messages from Kafka.
> >
> > When I start the ElasticSearch, the 1st message gets pulled into the
> > cluster. And after no messages are pulled even there are enough messages
> > available.
> >
> > I see the below exception continuously in kafka server log. Any
> information
> > is greatly appreciated.
> >
> > Thanks !
> >
> >
> > [2014-02-24 02:12:20,832] ERROR [KafkaApi-0] Error when processing fetch
> > request for partition [asdaGro,0] offset 1318 from consumer with
> > correlation id 0 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we
> only
> > have log segments in the range 0 to 2.
> > at kafka.log.Log.read(Log.scala:429)
> > at
> >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> > at
> >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> > at
> >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> > at
> >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:724)
> > [2014-02-24 02:12:21,833] ERROR [KafkaApi-0] Error when processing fetch
> > request for partition [asdaGro,0] offset 1318 from consumer with
> > correlation id 0 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we
> only
> > have log segments in the range 0 to 2.
> > at kafka.log.Log.read(Log.scala:429)
> > at
> >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> > at
> >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> > at
> >
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> > at
> >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:724)
> >
>
Re: OffsetoutofRange Exception
Posted by Jun Rao <ju...@gmail.com>.
The following log says there are only 2 messages in the log.
kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
have log segments in the range 0 to 2.
If you run console consumer on that topic (using --from-beginning), how
many messages do you see?
Thanks,
Jun
On Mon, Feb 24, 2014 at 2:17 AM, Krishna Raj <re...@gmail.com>wrote:
> Hi there,
>
> I am a newbie to Kafka. I am trying to use the (
> https://github.com/endgameinc/elasticsearch-river-kafka) plugin to pull
> the
> messages from Kafka.
>
> When I start the ElasticSearch, the 1st message gets pulled into the
> cluster. And after no messages are pulled even there are enough messages
> available.
>
> I see the below exception continuously in kafka server log. Any information
> is greatly appreciated.
>
> Thanks !
>
>
> [2014-02-24 02:12:20,832] ERROR [KafkaApi-0] Error when processing fetch
> request for partition [asdaGro,0] offset 1318 from consumer with
> correlation id 0 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
> have log segments in the range 0 to 2.
> at kafka.log.Log.read(Log.scala:429)
> at
>
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> at
>
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> at
>
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
>
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:724)
> [2014-02-24 02:12:21,833] ERROR [KafkaApi-0] Error when processing fetch
> request for partition [asdaGro,0] offset 1318 from consumer with
> correlation id 0 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 1318 but we only
> have log segments in the range 0 to 2.
> at kafka.log.Log.read(Log.scala:429)
> at
>
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388)
> at
>
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:334)
> at
>
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:330)
> at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
>
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:330)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:296)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:724)
>