You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2020/07/26 14:56:20 UTC

[spark] branch master updated: [SPARK-32442][CORE][TESTS] Fix TaskSetManagerSuite by hiding `o.a.s.FakeSchedulerBackend`

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 7e0c5b3  [SPARK-32442][CORE][TESTS] Fix TaskSetManagerSuite by hiding `o.a.s.FakeSchedulerBackend`
7e0c5b3 is described below

commit 7e0c5b3b539f208ef795d6848c34b52db2076a5c
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Sun Jul 26 07:54:30 2020 -0700

    [SPARK-32442][CORE][TESTS] Fix TaskSetManagerSuite by hiding `o.a.s.FakeSchedulerBackend`
    
    ### What changes were proposed in this pull request?
    
    There exists two `FakeSchedulerBackend` classes.
    ```
    $ git grep "class FakeSchedulerBackend"
    core/src/test/scala/org/apache/spark/HeartbeatReceiverSuite.scala:private class FakeSchedulerBackend(
    core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala:class FakeSchedulerBackend extends SchedulerBackend {
    ```
    
    This PR aims to hide the following at `TaskSetManagerSuite`.
    ```scala
    import org.apache.spark.{FakeSchedulerBackend => _, _}
    ```
    
    ### Why are the changes needed?
    
    Although `TaskSetManagerSuite` is inside `org.apache.spark.scheduler` package, `import org.apache.spark._` makes Scala 2.13 confused and causes 4 UT failures.
    ```
    $ dev/change-scala-version.sh 2.13
    $ build/mvn test -pl core --am -Pscala-2.13 -Dtest=none -DwildcardSuites=org.apache.spark.scheduler.TaskSetManagerSuite
    ...
    Tests: succeeded 48, failed 4, canceled 0, ignored 0, pending 0
    *** 4 TESTS FAILED ***
    ```
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    - **Scala 2.12**: Pass the Jenkins or GitHub Action
    - **Scala 2.13**: Pass the following manually.
    ```
    $ dev/change-scala-version.sh 2.13
    $ build/mvn test -pl core --am -Pscala-2.13 -Dtest=none -DwildcardSuites=org.apache.spark.scheduler.TaskSetManagerSuite
    ...
    Tests: succeeded 52, failed 0, canceled 0, ignored 0, pending 0
    All tests passed.
    ```
    
    Closes #29240 from dongjoon-hyun/SPARK-32442.
    
    Authored-by: Dongjoon Hyun <do...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 .../src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala b/core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala
index ae51b55..0a98030 100644
--- a/core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala
+++ b/core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala
@@ -31,7 +31,7 @@ import org.scalatest.Assertions._
 import org.scalatest.PrivateMethodTester
 import org.scalatest.concurrent.Eventually
 
-import org.apache.spark._
+import org.apache.spark.{FakeSchedulerBackend => _, _}
 import org.apache.spark.internal.Logging
 import org.apache.spark.internal.config
 import org.apache.spark.internal.config.Tests.SKIP_VALIDATE_CORES_TESTING


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org