You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2022/04/15 04:04:00 UTC
[jira] [Commented] (SPARK-38911) 'test 1 resource profile' throws exception when running it in IDEA separately
[ https://issues.apache.org/jira/browse/SPARK-38911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17522643#comment-17522643 ]
Apache Spark commented on SPARK-38911:
--------------------------------------
User 'wbo4958' has created a pull request for this issue:
https://github.com/apache/spark/pull/36208
> 'test 1 resource profile' throws exception when running it in IDEA separately
> -----------------------------------------------------------------------------
>
> Key: SPARK-38911
> URL: https://issues.apache.org/jira/browse/SPARK-38911
> Project: Spark
> Issue Type: Test
> Components: Tests
> Affects Versions: 3.2.1
> Reporter: Bobby Wang
> Priority: Minor
>
> The test `test 1 resource profile` of DAGSchedulerSuite will fail if I run it in IDEA separately.
>
> The root cause is the ResourceProfile is initialized before SparkContext, and it will take `DEFAULT_RESOURCE_PROFILE_ID` as the resource profile id. But the test asserts that the id is not equal to DEFAULT_RESOURCE_PROFILE_ID.
>
> {code:java}
> assert(expectedid.get != ResourceProfile.DEFAULT_RESOURCE_PROFILE_ID){code}
>
> The exception is like below,
>
> {code:java}
> 0 equaled 0
> ScalaTestFailureLocation: org.apache.spark.scheduler.DAGSchedulerSuite at (DAGSchedulerSuite.scala:3269)
> org.scalatest.exceptions.TestFailedException: 0 equaled 0
> at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
> at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
> at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
> at org.scalatest.Assertions$AssertionsHelper.macroAssert(Assertions.scala:1295)
> at org.apache.spark.scheduler.DAGSchedulerSuite.$anonfun$new$191(DAGSchedulerSuite.scala:3269)
> at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85){code}
> This issue does not exist when running all DAGSchedulerSuite one by one, since the SparkContext will be initialized at the very beginning.
>
> I will submit a patch to fix it.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org