[spark] branch master updated (dd32f45 -> 8e2a0bd)

[gu...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from dd32f45  [SPARK-31069][CORE] Avoid repeat compute `chunksBeingTransferred` cause hight cpu cost in external shuffle service when  `maxChunksBeingTransferred`  use default value
     add 8e2a0bd  [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

No new revisions were added by this update.

Summary of changes:
 python/docs/source/user_guide/arrow_pandas.rst     |  3 +-
 python/pyspark/sql/pandas/conversion.py            |  8 ++-
 python/pyspark/sql/pandas/functions.py             |  1 -
 python/pyspark/sql/pandas/serializers.py           | 10 ++-
 python/pyspark/sql/pandas/types.py                 | 42 +++++++++++-
 python/pyspark/sql/tests/test_arrow.py             | 77 +++++++++++++++++++---
 .../pyspark/sql/tests/test_pandas_cogrouped_map.py |  4 +-
 .../pyspark/sql/tests/test_pandas_grouped_map.py   |  7 +-
 .../sql/tests/test_pandas_udf_grouped_agg.py       |  4 +-
 python/pyspark/sql/tests/test_pandas_udf_scalar.py | 23 +++++--
 .../org/apache/spark/sql/internal/SQLConf.scala    |  2 +-
 .../spark/sql/execution/arrow/ArrowWriter.scala    | 12 ++--
 12 files changed, 157 insertions(+), 36 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org