You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ru...@apache.org on 2023/02/28 03:26:15 UTC

[spark] branch master updated (5e1776051ac -> 3d900b70c55)

This is an automated email from the ASF dual-hosted git repository.

ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


    from 5e1776051ac [SPARK-42572][SQL][SS] Fix behavior for StateStoreProvider.validateStateRowFormat
     add 3d900b70c55 [SPARK-42367][CONNECT][PYTHON] DataFrame.drop` should handle duplicated columns properly

No new revisions were added by this update.

Summary of changes:
 .../main/scala/org/apache/spark/sql/Dataset.scala  |  13 ++-
 .../main/protobuf/spark/connect/relations.proto    |   9 +-
 .../query-tests/queries/drop_multiple_strings.json |  14 +--
 .../queries/drop_multiple_strings.proto.bin        | Bin 71 -> 59 bytes
 .../query-tests/queries/drop_single_string.json    |   6 +-
 .../queries/drop_single_string.proto.bin           | Bin 56 -> 52 bytes
 .../resources/query-tests/queries/unionByName.json |  12 +-
 .../query-tests/queries/unionByName.proto.bin      | Bin 143 -> 135 bytes
 .../org/apache/spark/sql/connect/dsl/package.scala |  10 +-
 .../sql/connect/planner/SparkConnectPlanner.scala  |  18 +--
 python/pyspark/sql/connect/dataframe.py            |   3 -
 python/pyspark/sql/connect/plan.py                 |  18 +--
 python/pyspark/sql/connect/proto/relations_pb2.py  | 126 ++++++++++-----------
 python/pyspark/sql/connect/proto/relations_pb2.pyi |  23 ++--
 python/pyspark/sql/dataframe.py                    |   4 +-
 .../pyspark/sql/tests/connect/test_connect_plan.py |  10 +-
 .../sql/tests/connect/test_parity_dataframe.py     |   5 -
 17 files changed, 122 insertions(+), 149 deletions(-)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org