You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@uniffle.apache.org by ro...@apache.org on 2022/10/12 12:11:05 UTC
[incubator-uniffle] 01/03: [MINOR] Fix flaky test (#238)
This is an automated email from the ASF dual-hosted git repository.
roryqi pushed a commit to branch branch-0.6
in repository https://gitbox.apache.org/repos/asf/incubator-uniffle.git
commit e9540e4ad2d1b9f30e5777be9b51650f13dc16f3
Author: roryqi <je...@gmail.com>
AuthorDate: Fri Sep 23 10:14:38 2022 +0800
[MINOR] Fix flaky test (#238)
### What changes were proposed in this pull request?
`org.apache.uniffle.test.GetShuffleReportForMultiPartTest` is flaky
throws Exception:
ava.lang.ClassCastException: org.apache.spark.shuffle.RssShuffleManager cannot be cast to org.apache.uniffle.test.GetShuffleReportForMultiPartTest$RssShuffleManagerWrapper
at org.apache.uniffle.test.GetShuffleReportForMultiPartTest.runTest(GetShuffleReportForMultiPartTest.java:180)
at org.apache.uniffle.test.SparkIntegrationTestBase.runSparkApp(SparkIntegrationTestBase.java:74)
at org.apache.uniffle.test.SparkIntegrationTestBase.run(SparkIntegrationTestBase.java:52)
at org.apache.uniffle.test.GetShuffleReportForMultiPartTest.resultCompareTest(GetShuffleReportForMultiPartTest.java:141)
### Why are the changes needed?
Fix flaky test
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
GA passed
Co-authored-by: roryqi <ro...@tencent.com>
---
.../java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java b/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
index f719c96d..899970ce 100644
--- a/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
+++ b/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
@@ -175,7 +175,8 @@ public class GetShuffleReportForMultiPartTest extends SparkIntegrationTestBase {
i++;
}
SparkConf conf = spark.sparkContext().conf();
- if (!conf.get("spark.shuffle.manager", "").isEmpty()) {
+ if (conf.get("spark.shuffle.manager", "")
+ .equals("org.apache.uniffle.test.GetShuffleReportForMultiPartTest$RssShuffleManagerWrapper")) {
RssShuffleManagerWrapper mockRssShuffleManager =
(RssShuffleManagerWrapper) spark.sparkContext().env().shuffleManager();
int expectRequestNum = mockRssShuffleManager.getShuffleIdToPartitionNum().values().stream()