You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ulysses you (Jira)" <ji...@apache.org> on 2021/01/20 04:06:00 UTC

[jira] [Created] (SPARK-34166) Fix flaky test in DecommissionWorkerSuite

ulysses you created SPARK-34166:
-----------------------------------

             Summary: Fix flaky test in DecommissionWorkerSuite
                 Key: SPARK-34166
                 URL: https://issues.apache.org/jira/browse/SPARK-34166
             Project: Spark
          Issue Type: Improvement
          Components: Tests
    Affects Versions: 3.2.0
            Reporter: ulysses you


The test `decommission workers ensure that shuffle output is regenerated even with shuffle service` assumes it has two executor and both of two tasks can execute concurrently.

The two tasks will execute serially if there only have one executor. The result is test is unexpceted. E.g. 

```

[info] 5 did not equal 4 Expected 4 tasks but got List(0:0:0:0-SUCCESS, 0:0:1:0-FAILED, 0:0:1:1-SUCCESS, 0:1:0:0-SUCCESS, 1:0:0:0-SUCCESS) (DecommissionWorkerSuite.scala:190)

```



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org