You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by gu...@apache.org on 2021/11/18 09:15:58 UTC

[spark] branch master updated (1c26113 -> 88e53e5)

This is an automated email from the ASF dual-hosted git repository.

gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.


    from 1c26113  [SPARK-37224][SS] Optimize write path on RocksDB state store provider
     add 88e53e5  [SPARK-37277][PYTHON][SQL] Support DayTimeIntervalType in pandas UDF and Arrow optimization

No new revisions were added by this update.

Summary of changes:
 docs/sql-migration-guide.md                        |  2 ++
 python/pyspark/sql/pandas/conversion.py            | 27 ++++++++++++++++--
 python/pyspark/sql/pandas/types.py                 |  5 ++++
 python/pyspark/sql/tests/test_arrow.py             | 14 ++++++++-
 python/pyspark/sql/tests/test_dataframe.py         | 33 +++++++++++++++++-----
 python/pyspark/sql/tests/test_pandas_udf.py        | 23 +++++++++++++--
 .../spark/sql/vectorized/ArrowColumnVector.java    | 24 ++++++----------
 .../org/apache/spark/sql/util/ArrowUtils.scala     |  4 +--
 .../spark/sql/execution/arrow/ArrowWriter.scala    | 10 ++-----
 .../sql/execution/arrow/ArrowWriterSuite.scala     | 26 -----------------
 10 files changed, 104 insertions(+), 64 deletions(-)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org