You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Shohei Okumiya (Jira)" <ji...@apache.org> on 2025/04/14 06:46:00 UTC

[jira] [Resolved] (HIVE-9089) Error when cleaning up in spark.log [Spark Branch]

     [ https://issues.apache.org/jira/browse/HIVE-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shohei Okumiya resolved HIVE-9089.
----------------------------------
    Fix Version/s: NA
       Resolution: Won't Fix

We have discontinued Hive on Spark and EoLed Hive 3. HIVE-26134

> Error when cleaning up in spark.log [Spark Branch]
> --------------------------------------------------
>
>                 Key: HIVE-9089
>                 URL: https://issues.apache.org/jira/browse/HIVE-9089
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Xuefu Zhang
>            Priority: Major
>             Fix For: NA
>
>
> Error in logged in spark.log. It might be an concurrency issue:
> {code}
> 2014-12-11 05:24:58,690 ERROR [delete Spark local dirs]: storage.DiskBlockManager (Logging.scala:logError(96)) - Exception while deleting local spark dir: /tmp/spark-local-20141211052409-61ef
> java.io.IOException: Failed to list files for dir: /tmp/spark-local-20141211052409-61ef/24
> 	at org.apache.spark.util.Utils$.listFilesSafely(Utils.scala:745)
> 	at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:763)
> 	at org.apache.spark.util.Utils$$anonfun$deleteRecursively$1.apply(Utils.scala:765)
> 	at org.apache.spark.util.Utils$$anonfun$deleteRecursively$1.apply(Utils.scala:763)
> 	at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> 	at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:34)
> 	at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:763)
> 	at org.apache.spark.storage.DiskBlockManager$$anonfun$stop$1.apply(DiskBlockManager.scala:171)
> 	at org.apache.spark.storage.DiskBlockManager$$anonfun$stop$1.apply(DiskBlockManager.scala:168)
> 	at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> 	at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:108)
> 	at org.apache.spark.storage.DiskBlockManager.stop(DiskBlockManager.scala:168)
> 	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply$mcV$sp(DiskBlockManager.scala:159)
> 	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply(DiskBlockManager.scala:157)
> 	at org.apache.spark.storage.DiskBlockManager$$anon$1$$anonfun$run$1.apply(DiskBlockManager.scala:157)
> 	at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1460)
> 	at org.apache.spark.storage.DiskBlockManager$$anon$1.run(DiskBlockManager.scala:157)
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)