You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ru...@apache.org on 2025/06/03 01:24:33 UTC

(spark) branch master updated (cfd695b8e768 -> 64982a45f6bb)

This is an automated email from the ASF dual-hosted git repository.

ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


    from cfd695b8e768 [SPARK-52281][SQL] Change `ALTER TABLE ALTER COLUMN TYPE STRING` not to apply default collation if original data type was instance of `StringType`
     add 64982a45f6bb [SPARK-52307][PYTHON][CONNECT] Support Scalar Arrow Iterator UDF

No new revisions were added by this update.

Summary of changes:
 .../org/apache/spark/api/python/PythonRunner.scala |   4 +
 python/pyspark/sql/connect/udf.py                  |   1 +
 python/pyspark/sql/pandas/_typing/__init__.pyi     |   6 +
 python/pyspark/sql/pandas/functions.py             |   3 +
 python/pyspark/sql/pandas/functions.pyi            |  21 +++
 python/pyspark/sql/pandas/typehints.py             |  31 ++++
 .../sql/tests/arrow/test_arrow_udf_scalar.py       | 193 +++++++++++++++++----
 python/pyspark/util.py                             |   2 +
 python/pyspark/worker.py                           |  53 +++++-
 .../spark/sql/catalyst/expressions/PythonUDF.scala |   3 +-
 .../sql/execution/python/ExtractPythonUDFs.scala   |   9 +-
 11 files changed, 287 insertions(+), 39 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org