You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@spark.apache.org by hv...@apache.org on 2023/04/25 20:58:08 UTC

[spark] branch master updated (0e6446ac62d -> b26844ce879)

This is an automated email from the ASF dual-hosted git repository.

hvanhovell pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


    from 0e6446ac62d [SPARK-43285] Fix ReplE2ESuite consistently failing with JDK 17
     add b26844ce879 [SPARK-43136][CONNECT] Adding groupByKey + mapGroup + coGroup functions

No new revisions were added by this update.

Summary of changes:
 .../main/scala/org/apache/spark/sql/Dataset.scala  |  29 ++
 .../apache/spark/sql/KeyValueGroupedDataset.scala  | 416 +++++++++++++++++++++
 .../apache/spark/sql/connect/client/UdfUtils.scala |  43 ++-
 .../sql/KeyValueGroupedDatasetE2ETestSuite.scala   | 218 +++++++++++
 .../CheckConnectJvmClientCompatibility.scala       |  19 +-
 .../main/protobuf/spark/connect/relations.proto    |   9 +
 .../sql/connect/planner/SparkConnectPlanner.scala  | 253 ++++++++++---
 python/pyspark/sql/connect/proto/relations_pb2.py  |  24 +-
 python/pyspark/sql/connect/proto/relations_pb2.pyi |  49 ++-
 .../spark/sql/catalyst/plans/logical/object.scala  |   7 +
 .../apache/spark/sql/KeyValueGroupedDataset.scala  |   7 +-
 11 files changed, 996 insertions(+), 78 deletions(-)
 create mode 100644 connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/KeyValueGroupedDataset.scala
 create mode 100644 connector/connect/client/jvm/src/test/scala/org/apache/spark/sql/KeyValueGroupedDatasetE2ETestSuite.scala


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org