You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Yared (JIRA)" <ji...@apache.org> on 2019/08/03 18:18:00 UTC
[jira] [Comment Edited] (KAFKA-7401) Broker fails to start when
recovering a segment from before the log start offset
[ https://issues.apache.org/jira/browse/KAFKA-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899505#comment-16899505 ]
Yared edited comment on KAFKA-7401 at 8/3/19 6:17 PM:
------------------------------------------------------
Just wanted to update this, we are seeing this issue on 0.11.0.3 version of Kafka as well, has this been backported to this version of kafka? If not, is there a workaround to resolving this?
{code:java}
java.lang.IllegalArgumentException: inconsistent range
at java.util.concurrent.ConcurrentSkipListMap$SubMap.<init>(ConcurrentSkipListMap.java:2603)
at java.util.concurrent.ConcurrentSkipListMap.subMap(ConcurrentSkipListMap.java:2061)
at kafka.log.Log.logSegments(Log.scala:1455)
at kafka.log.Log.kafka$log$Log$$recoverSegment(Log.scala:335)
at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:370)
at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:351)
at scala.collection.immutable.Set$Set1.foreach(Set.scala:94)
at kafka.log.Log.completeSwapOperations(Log.scala:351)
at kafka.log.Log.loadSegments(Log.scala:388)
at kafka.log.Log.<init>(Log.scala:186)
at kafka.log.Log$.apply(Log.scala:1609)
at kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$5$$anonfun$apply$12$$anonfun$apply$1.apply$mcV$sp(LogManager.scala:172)
at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{code}
was (Author: f4tal-err0r):
Just wanted to update this, we are seeing this issue on 0.11.0.3 version of Kafka as well, has this been backported to this version of kafka?
```
java.lang.IllegalArgumentException: inconsistent range
at java.util.concurrent.ConcurrentSkipListMap$SubMap.<init>(ConcurrentSkipListMap.java:2603)
at java.util.concurrent.ConcurrentSkipListMap.subMap(ConcurrentSkipListMap.java:2061)
at kafka.log.Log.logSegments(Log.scala:1455)
at kafka.log.Log.kafka$log$Log$$recoverSegment(Log.scala:335)
at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:370)
at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:351)
at scala.collection.immutable.Set$Set1.foreach(Set.scala:94)
at kafka.log.Log.completeSwapOperations(Log.scala:351)
at kafka.log.Log.loadSegments(Log.scala:388)
at kafka.log.Log.<init>(Log.scala:186)
at kafka.log.Log$.apply(Log.scala:1609)
at kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$5$$anonfun$apply$12$$anonfun$apply$1.apply$mcV$sp(LogManager.scala:172)
at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
```
> Broker fails to start when recovering a segment from before the log start offset
> --------------------------------------------------------------------------------
>
> Key: KAFKA-7401
> URL: https://issues.apache.org/jira/browse/KAFKA-7401
> Project: Kafka
> Issue Type: Bug
> Components: log
> Affects Versions: 1.1.0, 1.1.1
> Reporter: Bob Barrett
> Assignee: Anna Povzner
> Priority: Major
> Fix For: 1.1.2
>
>
> If a segment needs to be recovered (for example, because of a missing index file or uncompleted swap operation) and its base offset is less than the log start offset, the broker will crash with the following error:
> Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
> java.lang.IllegalArgumentException: inconsistent range
> at java.util.concurrent.ConcurrentSkipListMap$SubMap.<init>(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.subMap(Unknown Source)
> at java.util.concurrent.ConcurrentSkipListMap.subMap(Unknown Source)
> at kafka.log.Log$$anonfun$12.apply(Log.scala:1579)
> at kafka.log.Log$$anonfun$12.apply(Log.scala:1578)
> at scala.Option.map(Option.scala:146)
> at kafka.log.Log.logSegments(Log.scala:1578)
> at kafka.log.Log.kafka$log$Log$$recoverSegment(Log.scala:358)
> at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:389)
> at kafka.log.Log$$anonfun$completeSwapOperations$1.apply(Log.scala:380)
> at scala.collection.immutable.Set$Set1.foreach(Set.scala:94)
> at kafka.log.Log.completeSwapOperations(Log.scala:380)
> at kafka.log.Log.loadSegments(Log.scala:408)
> at kafka.log.Log.<init>(Log.scala:216)
> at kafka.log.Log$.apply(Log.scala:1765)
> at kafka.log.LogManager.kafka$log$LogManager$$loadLog(LogManager.scala:260)
> at kafka.log.LogManager$$anonfun$loadLogs$2$$anonfun$11$$anonfun$apply$15$$anonfun$apply$2.apply$mcV$sp(LogManager.scala:340)
> at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:62)
> at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
> at java.util.concurrent.FutureTask.run(Unknown Source)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> at java.lang.Thread.run(Unknown Source)
> Since these segments are outside the log range, we should delete them, or at least not block broker startup because of them.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)