You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2020/01/22 06:34:14 UTC
[spark] branch master updated (3c4e619 -> ab0890b)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 3c4e619 [SPARK-30553][DOCS] fix structured-streaming java example error
add ab0890b [SPARK-28264][PYTHON][SQL] Support type hints in pandas UDF and rename/move inconsistent pandas UDF types
No new revisions were added by this update.
Summary of changes:
dev/sparktestsupport/modules.py | 8 +-
python/pyspark/sql/pandas/functions.py | 169 +++++--------
python/pyspark/sql/pandas/group_ops.py | 111 ++++++---
python/pyspark/sql/pandas/map_ops.py | 37 ++-
python/pyspark/sql/pandas/typehints.py | 141 +++++++++++
...grouped_map.py => test_pandas_cogrouped_map.py} | 69 ++----
...f_grouped_map.py => test_pandas_grouped_map.py} | 11 +-
...{test_pandas_udf_iter.py => test_pandas_map.py} | 22 +-
python/pyspark/sql/tests/test_pandas_udf.py | 8 +-
python/pyspark/sql/tests/test_pandas_udf_scalar.py | 8 +-
.../pyspark/sql/tests/test_pandas_udf_typehints.py | 273 +++++++++++++++++++++
python/pyspark/sql/tests/test_udf.py | 2 +-
python/pyspark/sql/udf.py | 68 ++---
13 files changed, 644 insertions(+), 283 deletions(-)
create mode 100644 python/pyspark/sql/pandas/typehints.py
rename python/pyspark/sql/tests/{test_pandas_udf_cogrouped_map.py => test_pandas_cogrouped_map.py} (74%)
rename python/pyspark/sql/tests/{test_pandas_udf_grouped_map.py => test_pandas_grouped_map.py} (98%)
rename python/pyspark/sql/tests/{test_pandas_udf_iter.py => test_pandas_map.py} (82%)
create mode 100644 python/pyspark/sql/tests/test_pandas_udf_typehints.py
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org