[jira] [Commented] (SPARK-49688) Data race between SparkListener and SparkConnectServiceSuite over ExecuteHolder

["Changgyoo Park (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-49688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882862#comment-17882862 ] 

Changgyoo Park commented on SPARK-49688:
----------------------------------------

Unfortunately, another data race detected.

        org.scalatest.exceptions.TestFailedDueToTimeoutException: The code passed to eventually never returned normally. Attempted 654 times over 10.001713506999998 seconds. Last failure message: Canceled did not equal Closed Execution has not been completed in Timeout(Span(10, Seconds)).
      at org.scalatest.enablers.Retrying$$anon$4.tryTryAgain$2(Retrying.scala:219)
      at org.scalatest.enablers.Retrying$$anon$4.retry(Retrying.scala:226)
      at org.scalatest.concurrent.Eventually.eventually(Eventually.scala:348)
      at org.scalatest.concurrent.Eventually.eventually$(Eventually.scala:347)
      at org.scalatest.concurrent.Eventually$.eventually(Eventually.scala:457)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite$VerifyEvents.onCompleted(SparkConnectServiceSuite.scala:949)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite.$anonfun$new$32(SparkConnectServiceSuite.scala:636)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite.$anonfun$new$32$adapted(SparkConnectServiceSuite.scala:571)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite.$anonfun$withEvents$1(SparkConnectServiceSuite.scala:909)
      at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
      at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64)
      at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61)
      at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:110)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite.withEvents(SparkConnectServiceSuite.scala:912)
      at org.apache.spark.sql.connect.planner.SparkConnectServiceSuite.$anonfun$new$31(SparkConnectServiceSuite.scala:571)
      at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
      at org.scalatest.enablers.Timed$$anon$1.timeoutAfter(Timed.scala:127)
      at org.scalatest.concurrent.TimeLimits$.failAfterImpl(TimeLimits.scala:282)
      at org.scalatest.concurrent.TimeLimits.failAfter(TimeLimits.scala:231)
      at org.scalatest.concurrent.TimeLimits.failAfter$(TimeLimits.scala:230)
      at org.apache.spark.SparkFunSuite.failAfter(SparkFunSuite.scala:78)
      at org.apache.spark.SparkFunSuite.testWithTimeout(SparkFunSuite.scala:486)
      at org.apache.spark.SparkFunSuite.$anonfun$test$1(SparkFunSuite.scala:575)
      at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
      at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
      at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
      at org.scalatest.Transformer.apply(Transformer.scala:22)
      at org.scalatest.Transformer.apply(Transformer.scala:20)
      at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226)
      at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:224)
      at org.apache.spark.SparkFunSuite.runWithCredentials(SparkFunSuite.scala:633)
      at org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:317)
      at org.scalatest.funsuite.AnyFunSuiteLike.invokeWithFixture$1(AnyFunSuiteLike.scala:224)
      at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTest$1(AnyFunSuiteLike.scala:236)
      at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
      at org.scalatest.funsuite.AnyFunSuiteLike.runTest(AnyFunSuiteLike.scala:236)
      at org.scalatest.funsuite.AnyFunSuiteLike.runTest$(AnyFunSuiteLike.scala:218)
      at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(SparkFunSuite.scala:78)
      at org.scalatest.BeforeAndAfterEach.runTest(BeforeAndAfterEach.scala:234)
      at org.scalatest.BeforeAndAfterEach.runTest$(BeforeAndAfterEach.scala:227)
      at org.apache.spark.SparkFunSuite.runTest(SparkFunSuite.scala:78)
      at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$runTests$1(AnyFunSuiteLike.scala:269)
      at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413)
      at scala.collection.immutable.List.foreach(List.scala:431)
      at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
      at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)
      at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)
      at org.scalatest.funsuite.AnyFunSuiteLike.runTests(AnyFunSuiteLike.scala:269)
      at org.scalatest.funsuite.AnyFunSuiteLike.runTests$(AnyFunSuiteLike.scala:268)
      at org.scalatest.funsuite.AnyFunSuite.runTests(AnyFunSuite.scala:1564)
      at org.scalatest.Suite.run(Suite.scala:1114)
      at org.scalatest.Suite.run$(Suite.scala:1096)
      at org.scalatest.funsuite.AnyFunSuite.org$scalatest$funsuite$AnyFunSuiteLike$$super$run(AnyFunSuite.scala:1564)
      at org.scalatest.funsuite.AnyFunSuiteLike.$anonfun$run$1(AnyFunSuiteLike.scala:273)
      at org.scalatest.SuperEngine.runImpl(Engine.scala:535)
      at org.scalatest.funsuite.AnyFunSuiteLike.run(AnyFunSuiteLike.scala:273)
      at org.scalatest.funsuite.AnyFunSuiteLike.run$(AnyFunSuiteLike.scala:272)
      at org.apache.spark.SparkFunSuite.org$scalatest$BeforeAndAfterAll$$super$run(SparkFunSuite.scala:78)
      at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:213)
      at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
      at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)

> Data race between SparkListener and SparkConnectServiceSuite over ExecuteHolder
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-49688
>                 URL: https://issues.apache.org/jira/browse/SPARK-49688
>             Project: Spark
>          Issue Type: Bug
>          Components: Connect
>    Affects Versions: 4.0.0
>            Reporter: Changgyoo Park
>            Assignee: Changgyoo Park
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> https://github.com/longvu-db/spark/actions/runs/10903815379/job/30258793280
> => This is most likely a test issue (no synchronisation between two threads), but need to close look into it to ensure that.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org