You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2024/05/21 00:09:19 UTC
(spark) branch master updated (0393ab432389 -> 7d6bb7474faa)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 0393ab432389 [SPARK-48330][SS][PYTHON] Fix the python streaming data source timeout issue for large trigger interval
add 7d6bb7474faa [SPARK-48258][PYTHON][CONNECT] Checkpoint and localCheckpoint in Spark Connect
No new revisions were added by this update.
Summary of changes:
.../src/main/protobuf/spark/connect/base.proto | 8 +
.../src/main/protobuf/spark/connect/commands.proto | 20 ++
.../sql/connect/planner/SparkConnectPlanner.scala | 51 ++++-
.../spark/sql/connect/service/SessionHolder.scala | 5 +-
.../sql/connect/service/SparkConnectService.scala | 6 +
.../tests/connect/test_parity_frame_spark.py | 6 +-
python/pyspark/sql/connect/client/core.py | 12 +-
python/pyspark/sql/connect/conversion.py | 23 ++-
python/pyspark/sql/connect/dataframe.py | 69 +++++--
python/pyspark/sql/connect/plan.py | 32 ++-
python/pyspark/sql/connect/proto/base_pb2.py | 214 +++++++++++----------
python/pyspark/sql/connect/proto/base_pb2.pyi | 31 +++
python/pyspark/sql/connect/proto/commands_pb2.py | 192 +++++++++---------
python/pyspark/sql/connect/proto/commands_pb2.pyi | 107 +++++++++++
python/pyspark/sql/dataframe.py | 113 ++++++-----
.../sql/tests/connect/test_connect_basic.py | 47 +++++
.../sql/tests/connect/test_connect_error.py | 10 +-
python/pyspark/sql/tests/test_dataframe.py | 5 +
18 files changed, 656 insertions(+), 295 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org