You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@uniffle.apache.org by ro...@apache.org on 2022/10/12 12:11:05 UTC

[incubator-uniffle] 01/03: [MINOR] Fix flaky test (#238)

This is an automated email from the ASF dual-hosted git repository.

roryqi pushed a commit to branch branch-0.6
in repository https://gitbox.apache.org/repos/asf/incubator-uniffle.git

commit e9540e4ad2d1b9f30e5777be9b51650f13dc16f3
Author: roryqi <je...@gmail.com>
AuthorDate: Fri Sep 23 10:14:38 2022 +0800

    [MINOR] Fix flaky test (#238)
    
    ### What changes were proposed in this pull request?
    `org.apache.uniffle.test.GetShuffleReportForMultiPartTest` is flaky
     throws Exception:
    ava.lang.ClassCastException: org.apache.spark.shuffle.RssShuffleManager cannot be cast to org.apache.uniffle.test.GetShuffleReportForMultiPartTest$RssShuffleManagerWrapper
            at org.apache.uniffle.test.GetShuffleReportForMultiPartTest.runTest(GetShuffleReportForMultiPartTest.java:180)
            at org.apache.uniffle.test.SparkIntegrationTestBase.runSparkApp(SparkIntegrationTestBase.java:74)
            at org.apache.uniffle.test.SparkIntegrationTestBase.run(SparkIntegrationTestBase.java:52)
            at org.apache.uniffle.test.GetShuffleReportForMultiPartTest.resultCompareTest(GetShuffleReportForMultiPartTest.java:141)
    
    ### Why are the changes needed?
    Fix flaky test
    
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    GA passed
    
    Co-authored-by: roryqi <ro...@tencent.com>
---
 .../java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java b/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
index f719c96d..899970ce 100644
--- a/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
+++ b/integration-test/spark3/src/test/java/org/apache/uniffle/test/GetShuffleReportForMultiPartTest.java
@@ -175,7 +175,8 @@ public class GetShuffleReportForMultiPartTest extends SparkIntegrationTestBase {
       i++;
     }
     SparkConf conf = spark.sparkContext().conf();
-    if (!conf.get("spark.shuffle.manager", "").isEmpty()) {
+    if (conf.get("spark.shuffle.manager", "")
+        .equals("org.apache.uniffle.test.GetShuffleReportForMultiPartTest$RssShuffleManagerWrapper")) {
       RssShuffleManagerWrapper mockRssShuffleManager =
           (RssShuffleManagerWrapper) spark.sparkContext().env().shuffleManager();
       int expectRequestNum = mockRssShuffleManager.getShuffleIdToPartitionNum().values().stream()