You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ru...@apache.org on 2023/06/16 00:29:54 UTC
[spark] branch master updated (49dc2dbcbb1 -> 06b2b1a8c30)
This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 49dc2dbcbb1 [SPARK-42750][SQL][FOLLOWUP] Add INSERT OVERWRITE BY NAME statement
add 06b2b1a8c30 [SPARK-43937][CONNECT][PYTHON] Add ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python
No new revisions were added by this update.
Summary of changes:
.../scala/org/apache/spark/sql/functions.scala | 53 +++++++++
.../apache/spark/sql/PlanGenerationTestSuite.scala | 24 ++++
.../explain-results/function_equal_null.explain | 2 +
.../explain-results/function_ifnull.explain | 2 +
...sNotNull.explain => function_isnotnull.explain} | 0
.../explain-results/function_nullif.explain | 2 +
.../explain-results/function_nvl.explain | 2 +
.../explain-results/function_nvl2.explain | 2 +
.../query-tests/queries/function_equal_null.json | 29 +++++
.../queries/function_equal_null.proto.bin | Bin 0 -> 186 bytes
.../query-tests/queries/function_ifnull.json | 29 +++++
.../query-tests/queries/function_ifnull.proto.bin | Bin 0 -> 182 bytes
.../query-tests/queries/function_isnotnull.json | 25 ++++
.../queries/function_isnotnull.proto.bin | Bin 0 -> 178 bytes
.../query-tests/queries/function_nullif.json | 29 +++++
.../query-tests/queries/function_nullif.proto.bin | Bin 0 -> 182 bytes
.../query-tests/queries/function_nvl.json | 29 +++++
.../query-tests/queries/function_nvl.proto.bin | Bin 0 -> 179 bytes
.../query-tests/queries/function_nvl2.json | 33 ++++++
.../query-tests/queries/function_nvl2.proto.bin | Bin 0 -> 187 bytes
.../source/reference/pyspark.sql/functions.rst | 12 ++
python/pyspark/sql/connect/functions.py | 45 +++++++
python/pyspark/sql/functions.py | 130 +++++++++++++++++++++
.../scala/org/apache/spark/sql/functions.scala | 65 +++++++++++
.../apache/spark/sql/DataFrameFunctionsSuite.scala | 51 +++++++-
25 files changed, 559 insertions(+), 5 deletions(-)
create mode 100644 connector/connect/common/src/test/resources/query-tests/explain-results/function_equal_null.explain
create mode 100644 connector/connect/common/src/test/resources/query-tests/explain-results/function_ifnull.explain
copy connector/connect/common/src/test/resources/query-tests/explain-results/{column_isNotNull.explain => function_isnotnull.explain} (100%)
create mode 100644 connector/connect/common/src/test/resources/query-tests/explain-results/function_nullif.explain
create mode 100644 connector/connect/common/src/test/resources/query-tests/explain-results/function_nvl.explain
create mode 100644 connector/connect/common/src/test/resources/query-tests/explain-results/function_nvl2.explain
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_equal_null.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_equal_null.proto.bin
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_ifnull.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_ifnull.proto.bin
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_isnotnull.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_isnotnull.proto.bin
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nullif.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nullif.proto.bin
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nvl.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nvl.proto.bin
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nvl2.json
create mode 100644 connector/connect/common/src/test/resources/query-tests/queries/function_nvl2.proto.bin
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org