You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Kvicii.Yu (Jira)" <ji...@apache.org> on 2022/01/18 14:25:00 UTC
[jira] [Commented] (KAFKA-13596) ERROR Error while deleting segments for {topic} : java.nio.file.NoSuchFileException
[ https://issues.apache.org/jira/browse/KAFKA-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477918#comment-17477918 ]
Kvicii.Yu commented on KAFKA-13596:
-----------------------------------
[~shiyc]
Could you tell me how can I reproduce this problem
> ERROR Error while deleting segments for {topic} : java.nio.file.NoSuchFileException
> -----------------------------------------------------------------------------------
>
> Key: KAFKA-13596
> URL: https://issues.apache.org/jira/browse/KAFKA-13596
> Project: Kafka
> Issue Type: Bug
> Components: log
> Affects Versions: 2.0.1
> Environment: kafka 2.0.1 on Centos 7.5
> jvm: Java(TM) SE Runtime Environment (build 1.8.0_131)
> Reporter: shiyc
> Priority: Major
> Attachments: nohup.out-0114
>
>
> Our kafka server (version 2.0.1) failed because of a NoSuchFileException while it is trying to delete log files. The exceptions in the kafka log are :
> {code:java}
> ERROR Uncaught exception in scheduled task 'kafka-log-retention' (kafka.utils.KafkaScheduler)
> org.apache.kafka.common.errors.KafkaStorageException: Error while deleting segments for zabbix_topic_131-0 in dir /home/netvip/data/kafka
> Caused by: java.nio.file.NoSuchFileException: /home/netvip/data/kafka/zabbix_topic_131-0/00000000000745417527.log
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:409)
> at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
> at java.nio.file.Files.move(Files.java:1395)
> at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:786)
> at org.apache.kafka.common.record.FileRecords.renameTo(FileRecords.java:211)
> at kafka.log.LogSegment.changeFileSuffixes(LogSegment.scala:488)
> at kafka.log.Log.asyncDeleteSegment(Log.scala:1753)
> at kafka.log.Log.deleteSegment(Log.scala:1738)
> at kafka.log.Log.$anonfun$deleteSegments$3(Log.scala:1309)
> at kafka.log.Log.$anonfun$deleteSegments$3$adapted(Log.scala:1309)
> at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:59)
> at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:52)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
> at kafka.log.Log.$anonfun$deleteSegments$2(Log.scala:1309)
> at scala.runtime.java8.JFunction0$mcI$sp.apply(JFunction0$mcI$sp.java:12)
> at kafka.log.Log.maybeHandleIOException(Log.scala:1842)
> at kafka.log.Log.deleteSegments(Log.scala:1300)
> at kafka.log.Log.deleteOldSegments(Log.scala:1295)
> at kafka.log.Log.deleteRetentionMsBreachedSegments(Log.scala:1368)
> at kafka.log.Log.deleteOldSegments(Log.scala:1361)
> at kafka.log.LogManager.$anonfun$cleanupLogs$3(LogManager.scala:874)
> at kafka.log.LogManager.$anonfun$cleanupLogs$3$adapted(LogManager.scala:872)
> at scala.collection.TraversableLike$WithFilter.$anonfun$foreach$1(TraversableLike.scala:789)
> at scala.collection.immutable.List.foreach(List.scala:389)
> at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:788)
> at kafka.log.LogManager.cleanupLogs(LogManager.scala:872)
> at kafka.log.LogManager.$anonfun$startup$2(LogManager.scala:395)
> at kafka.utils.KafkaScheduler.$anonfun$schedule$2(KafkaScheduler.scala:114)
> at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:63)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Suppressed: java.nio.file.NoSuchFileException: /home/netvip/data/kafka/zabbix_topic_131-0/00000000000745417527.log -> /home/netvip/data/kafka/zabbix_topic_131-0/00000000000745417527.log.deleted
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> at sun.nio.fs.UnixCopyFile.move(UnixCopyFile.java:396)
> at sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
> at java.nio.file.Files.move(Files.java:1395)
> at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:783)
> ... 32 more {code}
> {color:#172b4d}The file '00000000000745417527.log' does not exist on disk. {color}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)