You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ru...@apache.org on 2023/04/12 07:52:21 UTC
[spark] branch master updated (7e2c6c7ab23 -> f8751e2afeb)
This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 7e2c6c7ab23 [SPARK-42985][CONNECT][PYTHON] Fix createDataFrame to respect the SQL configs
add f8751e2afeb [SPARK-42994][ML][CONNECT] PyTorch Distributor support Local Mode
No new revisions were added by this update.
Summary of changes:
.../src/main/protobuf/spark/connect/base.proto | 3 +
.../src/main/protobuf/spark/connect/commands.proto | 9 ++
.../src/main/protobuf/spark/connect/common.proto | 10 ++
.../sql/connect/planner/SparkConnectPlanner.scala | 27 ++++
.../tests/connect/test_parity_torch_distributor.py | 59 +++++----
python/pyspark/ml/torch/distributor.py | 89 +++++++++----
python/pyspark/ml/torch/tests/test_distributor.py | 30 ++++-
python/pyspark/sql/connect/client.py | 16 +++
python/pyspark/sql/connect/proto/base_pb2.py | 108 ++++++++--------
python/pyspark/sql/connect/proto/base_pb2.pyi | 13 ++
python/pyspark/sql/connect/proto/commands_pb2.py | 144 ++++++++++++++-------
python/pyspark/sql/connect/proto/commands_pb2.pyi | 68 ++++++++++
python/pyspark/sql/connect/proto/common_pb2.py | 16 ++-
python/pyspark/sql/connect/proto/common_pb2.pyi | 30 +++++
14 files changed, 462 insertions(+), 160 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org