[GitHub] [spark] HyukjinKwon edited a comment on pull request #34276: [SPARK-36998][CORE] Handle concurrent eviction of same application in SHS

[GitBox <gi...@apache.org>]

HyukjinKwon edited a comment on pull request #34276:
URL: https://github.com/apache/spark/pull/34276#issuecomment-963853824


   Hmm .. actually the UT is flaky:
   
   ```
   sbt.ForkMain$ForkError: org.scalatest.exceptions.TestFailedException: "Failed to list contents of Mock for File, hashCode: 1852043714" did not contain "Unknown I/O error"
   	at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
   	at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
   	at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
   	at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:1295)
   	at org.apache.spark.deploy.history.HistoryServerDiskManagerSuite.$anonfun$new$8(HistoryServerDiskManagerSuite.scala:178)
   	at org.apache.spark.deploy.history.HistoryServerDiskManagerSuite.$anonfun$new$8$adapted(HistoryServerDiskManagerSuite.scala:167)
   	at scala.collection.immutable.List.foreach(List.scala:333)
   	at org.apache.spark.deploy.history.HistoryServerDiskManagerSuite.$anonfun$new$7(HistoryServerDiskManagerSuite.scala:167)
   	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.scala:18)
   	at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
   	at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
   	at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
   	at org.scalatest.Transformer.apply(Transformer.scala:22)
   	at org.scalatest.Transformer.apply(Transformer.scala:20)
   	at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226)
   	at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:190)
   	at org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224)
   	at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236)
   	at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
   	at org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236)
   	at org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218)
   	at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:62)
   	at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234)
   	at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227)
   	at org.apache.spark.deploy.history.HistoryServerDiskManagerSuite.org$scalatest$BeforeAndAfter$$super$runTest(HistoryServerDiskManagerSuite.scala:34)
   	at org.scalatest.BeforeAndAfter.runTest(BeforeAndAfter.scala:213)
   	at org.scalatest.BeforeAndAfter.runTest$(BeforeAndAfter.scala:203)
   	at org.apache.spark.deploy.history.HistoryServerDiskManagerSuite.runTest(HistoryServerDiskManagerSuite.scala:34)
   	at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269)
   	at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413)
   ```
   
   https://github.com/apache/spark/runs/4130442054
   https://github.com/apache/spark/runs/4134402381
   https://github.com/apache/spark/runs/4134402381
   
   
   I saw few more times during rerunning some tests too.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org