You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Wu, Jiang2 " <ji...@citi.com> on 2013/08/22 19:23:27 UTC
repeated for request offset out of range
Hi,
In our log we see there are repeated errors due to the same request whose offset is out of range. As I understand when out of range happens, the consumer should reset its offset, therefore such error should happen only once. Does the log indicate a bug?
Thanks,
Jiang
[2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing fetch request for partition [xxxxxx,0] offset 2717035 from consumer with correlation id 324387 (kafka.server.KafkaApis)
kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we only have log segments in the range 2720184 to 2724642.
at kafka.log.Log.read(Log.scala:417)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:722)
[2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing fetch request for partition [xxxxxx,0] offset 2717035 from consumer with correlation id 324387 (kafka.server.KafkaApis)
kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we only have log segments in the range 2720184 to 2724642.
at kafka.log.Log.read(Log.scala:417)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
at kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
at kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
at kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
at java.lang.Thread.run(Thread.java:722)
[2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing fetch request for partition [xxxxxx,0] offset 2717035 from consumer with correlation id 324388 (kafka.server.KafkaApis)
kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we only have log segments in the range 2720184 to 2724642.
at kafka.log.Log.read(Log.scala:417)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:722)
RE: repeated for request offset out of range
Posted by Neha Narkhede <ne...@gmail.com>.
Can you tell us how to reproduce this behavior?
Thanks,
Neha
On Aug 23, 2013 4:44 AM, "Wu, Jiang2" <ji...@citi.com> wrote:
> We are using high-level API, not the SimpleConsumer.
>
> Thanks,
> Jiang
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Friday, August 23, 2013 12:13 AM
> To: users@kafka.apache.org
> Subject: Re: repeated for request offset out of range
>
> Are you using the ZK-based consumer or SimpleConsumer? Only the former
> automatically resets offsets on OffsetOutOfRangeException.
>
> Thanks,
>
> Jun
>
>
> On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
>
> > Hi,
> >
> > In our log we see there are repeated errors due to the same request
> > whose offset is out of range. As I understand when out of range
> > happens, the consumer should reset its offset, therefore such error
> > should happen only once. Does the log indicate a bug?
> >
> > Thanks,
> > Jiang
> >
> >
> > [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324387 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:722)
> > [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324387 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at
> > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> > at
> > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> > at
> >
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> > at java.lang.Thread.run(Thread.java:722)
> > [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324388 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:722)
> >
>
RE: repeated for request offset out of range
Posted by "Wu, Jiang2 " <ji...@citi.com>.
We are using high-level API, not the SimpleConsumer.
Thanks,
Jiang
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Friday, August 23, 2013 12:13 AM
To: users@kafka.apache.org
Subject: Re: repeated for request offset out of range
Are you using the ZK-based consumer or SimpleConsumer? Only the former automatically resets offsets on OffsetOutOfRangeException.
Thanks,
Jun
On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
> Hi,
>
> In our log we see there are repeated errors due to the same request
> whose offset is out of range. As I understand when out of range
> happens, the consumer should reset its offset, therefore such error
> should happen only once. Does the log indicate a bug?
>
> Thanks,
> Jiang
>
>
> [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> at
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324388 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
>
Re: repeated for request offset out of range
Posted by Jun Rao <ju...@gmail.com>.
Are you using the ZK-based consumer or SimpleConsumer? Only the former
automatically resets offsets on OffsetOutOfRangeException.
Thanks,
Jun
On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
> Hi,
>
> In our log we see there are repeated errors due to the same request whose
> offset is out of range. As I understand when out of range happens, the
> consumer should reset its offset, therefore such error should happen only
> once. Does the log indicate a bug?
>
> Thanks,
> Jiang
>
>
> [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> at
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324388 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
>
Re: repeated for request offset out of range
Posted by Neha Narkhede <ne...@gmail.com>.
I think your request log is empty because you might not have a directory at
/logs. I think it should be logs/kafka/kafka-request.log
Thanks,
Neha
On Thu, Aug 22, 2013 at 1:02 PM, Wu, Jiang2 <ji...@citi.com> wrote:
> The kafka-request.log is empty.
>
> This is the related log4j.properties part:
>
> log4j.appender.requestAppender=org.apache.log4j.RollingFileAppender
> #log4j.appender.requestAppender.DatePattern='.'yyyy-MM-dd-HH
> log4j.appender.requestAppender.MaxFileSize=10MB
> log4j.appender.requestAppender.MaxBackupIndex=20
> log4j.appender.requestAppender.File=/logs/kafka/kafka-request.log
> log4j.appender.requestAppender.layout=org.apache.log4j.PatternLayout
> log4j.appender.requestAppender.layout.ConversionPattern=[%d] %p %m (%c)%n
>
> Other logs including server.log, controller.log, state-change.log are all
> correct.
>
> Regards,
> Jiang
>
> -----Original Message-----
> From: Neha Narkhede [mailto:neha.narkhede@gmail.com]
> Sent: Thursday, August 22, 2013 3:33 PM
> To: users@kafka.apache.org
> Subject: Re: repeated for request offset out of range
>
> Could you check the kafka-request.log for these FetchRequests and see if
> they are sent by the same clientId ? Also, from the same kafka-request.log,
> could you check if the Kafka server received an OffsetRequest after these
> FetchRequests ?
>
> Thanks,
> Neha
>
>
> On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
>
> > Hi,
> >
> > In our log we see there are repeated errors due to the same request
> > whose offset is out of range. As I understand when out of range
> > happens, the consumer should reset its offset, therefore such error
> > should happen only once. Does the log indicate a bug?
> >
> > Thanks,
> > Jiang
> >
> >
> > [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324387 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:722)
> > [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324387 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at
> > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> > at
> > kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> > at
> >
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> > at java.lang.Thread.run(Thread.java:722)
> > [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing
> > fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> > with correlation id 324388 (kafka.server.KafkaApis)
> > kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> > we only have log segments in the range 2720184 to 2724642.
> > at kafka.log.Log.read(Log.scala:417)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> > at
> >
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> >
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> > at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> > at java.lang.Thread.run(Thread.java:722)
> >
>
RE: repeated for request offset out of range
Posted by "Wu, Jiang2 " <ji...@citi.com>.
The kafka-request.log is empty.
This is the related log4j.properties part:
log4j.appender.requestAppender=org.apache.log4j.RollingFileAppender
#log4j.appender.requestAppender.DatePattern='.'yyyy-MM-dd-HH
log4j.appender.requestAppender.MaxFileSize=10MB
log4j.appender.requestAppender.MaxBackupIndex=20
log4j.appender.requestAppender.File=/logs/kafka/kafka-request.log
log4j.appender.requestAppender.layout=org.apache.log4j.PatternLayout
log4j.appender.requestAppender.layout.ConversionPattern=[%d] %p %m (%c)%n
Other logs including server.log, controller.log, state-change.log are all correct.
Regards,
Jiang
-----Original Message-----
From: Neha Narkhede [mailto:neha.narkhede@gmail.com]
Sent: Thursday, August 22, 2013 3:33 PM
To: users@kafka.apache.org
Subject: Re: repeated for request offset out of range
Could you check the kafka-request.log for these FetchRequests and see if they are sent by the same clientId ? Also, from the same kafka-request.log, could you check if the Kafka server received an OffsetRequest after these FetchRequests ?
Thanks,
Neha
On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
> Hi,
>
> In our log we see there are repeated errors due to the same request
> whose offset is out of range. As I understand when out of range
> happens, the consumer should reset its offset, therefore such error
> should happen only once. Does the log indicate a bug?
>
> Thanks,
> Jiang
>
>
> [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> at
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing
> fetch request for partition [xxxxxx,0] offset 2717035 from consumer
> with correlation id 324388 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but
> we only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
>
Re: repeated for request offset out of range
Posted by Neha Narkhede <ne...@gmail.com>.
Could you check the kafka-request.log for these FetchRequests and see if
they are sent by the same clientId ? Also, from the same kafka-request.log,
could you check if the Kafka server received an OffsetRequest after these
FetchRequests ?
Thanks,
Neha
On Thu, Aug 22, 2013 at 10:23 AM, Wu, Jiang2 <ji...@citi.com> wrote:
> Hi,
>
> In our log we see there are repeated errors due to the same request whose
> offset is out of range. As I understand when out of range happens, the
> consumer should reset its offset, therefore such error should happen only
> once. Does the log indicate a bug?
>
> Thanks,
> Jiang
>
>
> [2013-08-22 09:23:20,649] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,749] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324387 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:556)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:538)
> at
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> at java.lang.Thread.run(Thread.java:722)
> [2013-08-22 09:23:20,750] ERROR [KafkaApi-2] Error when processing fetch
> request for partition [xxxxxx,0] offset 2717035 from consumer with
> correlation id 324388 (kafka.server.KafkaApis)
> kafka.common.OffsetOutOfRangeException: Request for offset 2717035 but we
> only have log segments in the range 2720184 to 2724642.
> at kafka.log.Log.read(Log.scala:417)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:367)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:314)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:310)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:310)
> at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:276)
> at kafka.server.KafkaApis.handle(KafkaApis.scala:65)
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> at java.lang.Thread.run(Thread.java:722)
>