You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by sr...@apache.org on 2022/06/28 16:56:12 UTC

[spark] branch branch-3.3 updated: [SPARK-37753][FOLLOWUP][SQL] Add comments to unit test

This is an automated email from the ASF dual-hosted git repository.

srowen pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.3 by this push:
     new 7adb6e21022 [SPARK-37753][FOLLOWUP][SQL] Add comments to unit test
7adb6e21022 is described below

commit 7adb6e2102232447fde0cea010c2b68a602613b5
Author: mcdull-zhang <wo...@163.com>
AuthorDate: Tue Jun 28 11:55:51 2022 -0500

    [SPARK-37753][FOLLOWUP][SQL] Add comments to unit test
    
    ### What changes were proposed in this pull request?
    add comments to unit test.
    
    ### Why are the changes needed?
    code can be hard to understand without comments
    
    ### Does this PR introduce _any_ user-facing change?
    No
    
    ### How was this patch tested?
    existing test
    
    Closes #37018 from mcdull-zhang/add_reason.
    
    Authored-by: mcdull-zhang <wo...@163.com>
    Signed-off-by: Sean Owen <sr...@gmail.com>
    (cherry picked from commit 9fd010be24fcd6d81e05bd08133fd80ba81b97ac)
    Signed-off-by: Sean Owen <sr...@gmail.com>
---
 .../apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala  | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala b/sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala
index dd727855ce2..d5c933fbc8b 100644
--- a/sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala
+++ b/sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala
@@ -711,6 +711,10 @@ class AdaptiveQueryExecSuite
 
   test("SPARK-37753: Inhibit broadcast in left outer join when there are many empty" +
     " partitions on outer/left side") {
+    // if the right side is completed first and the left side is still being executed,
+    // the right side does not know whether there are many empty partitions on the left side,
+    // so there is no demote, and then the right side is broadcast in the planning stage.
+    // so retry several times here to avoid unit test failure.
     eventually(timeout(15.seconds), interval(500.milliseconds)) {
       withSQLConf(
         SQLConf.ADAPTIVE_EXECUTION_ENABLED.key -> "true",


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org