You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2022/04/18 02:32:46 UTC

[spark] branch branch-3.3 updated: [SPARK-38928][TESTS][SQL] Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.3 by this push:
     new 0d1005e8ccd [SPARK-38928][TESTS][SQL] Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available
0d1005e8ccd is described below

commit 0d1005e8ccdd379f93ae3ce9a61bb0469ec0d695
Author: William Hyun <wi...@apache.org>
AuthorDate: Sun Apr 17 19:29:16 2022 -0700

    [SPARK-38928][TESTS][SQL] Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available
    
    ### What changes were proposed in this pull request?
    This PR aims to skip Pandas UDF tests in `QueryCompilationErrorsSuite` if not available.
    
    ### Why are the changes needed?
    The tests should be skipped instead of showing failure.
    
    **BEFORE**
    ```
    $ build/sbt "sql/testOnly org.apache.spark.sql.errors.QueryCompilationErrorsSuite"
    ...
    [info] *** 2 TESTS FAILED ***
    [error] Failed tests:
    [error]         org.apache.spark.sql.errors.QueryCompilationErrorsSuite
    [error] (sql / Test / testOnly) sbt.TestsFailedException: Tests unsuccessful
    ```
    
    **AFTER**
    ```
    $ build/sbt "sql/testOnly org.apache.spark.sql.errors.QueryCompilationErrorsSuite"
    ...
    [info] Tests: succeeded 13, failed 0, canceled 2, ignored 0, pending 0
    [info] All tests passed.
    ```
    
    ### Does this PR introduce _any_ user-facing change?
    No.
    
    ### How was this patch tested?
    Pass the CIs.
    
    Closes #36236 from williamhyun/skippandas.
    
    Authored-by: William Hyun <wi...@apache.org>
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
    (cherry picked from commit 1f55a2af225b9c6226004180d9b83d2424bbe154)
    Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
 .../scala/org/apache/spark/sql/errors/QueryCompilationErrorsSuite.scala | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/sql/core/src/test/scala/org/apache/spark/sql/errors/QueryCompilationErrorsSuite.scala b/sql/core/src/test/scala/org/apache/spark/sql/errors/QueryCompilationErrorsSuite.scala
index 4d776caacf3..02f639008aa 100644
--- a/sql/core/src/test/scala/org/apache/spark/sql/errors/QueryCompilationErrorsSuite.scala
+++ b/sql/core/src/test/scala/org/apache/spark/sql/errors/QueryCompilationErrorsSuite.scala
@@ -107,6 +107,7 @@ class QueryCompilationErrorsSuite extends QueryTest with SharedSparkSession {
 
   test("CANNOT_USE_MIXTURE: Using aggregate function with grouped aggregate pandas UDF") {
     import IntegratedUDFTestUtils._
+    assume(shouldTestGroupedAggPandasUDFs)
 
     val df = Seq(
       (536361, "85123A", 2, 17850),
@@ -153,6 +154,7 @@ class QueryCompilationErrorsSuite extends QueryTest with SharedSparkSession {
 
   test("UNSUPPORTED_FEATURE: Using pandas UDF aggregate expression with pivot") {
     import IntegratedUDFTestUtils._
+    assume(shouldTestGroupedAggPandasUDFs)
 
     val df = Seq(
       (536361, "85123A", 2, 17850),


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org