You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ka...@apache.org on 2025/05/29 05:19:28 UTC
(spark) branch master updated (7e48ba7bf10e -> 3d84039292b7)
This is an automated email from the ASF dual-hosted git repository.
kabhwan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 7e48ba7bf10e [SPARK-52272][SQL] V2SessionCatalog does not alter schema on Hive Catalog
add 3d84039292b7 [SPARK-52228][SS][PYSPARK] Construct the benchmark purposed TWS state server with in-memory state impls and the benchmark code in python
No new revisions were added by this update.
Summary of changes:
.../pyspark/sql/streaming/benchmark}/__init__.py | 0
.../benchmark/benchmark_tws_state_server.py | 375 ++++++++++++++++++++
.../pyspark/sql/streaming/benchmark/tws_utils.py | 73 ++++
.../pyspark/sql/streaming/benchmark/utils.py | 18 +-
...arkTransformWithStateInPySparkStateServer.scala | 376 +++++++++++++++++++++
5 files changed, 830 insertions(+), 12 deletions(-)
copy {examples/src/main/python => python/pyspark/sql/streaming/benchmark}/__init__.py (100%)
create mode 100644 python/pyspark/sql/streaming/benchmark/benchmark_tws_state_server.py
create mode 100644 python/pyspark/sql/streaming/benchmark/tws_utils.py
copy bin/beeline => python/pyspark/sql/streaming/benchmark/utils.py (71%)
mode change 100755 => 100644
create mode 100644 sql/core/src/main/scala/org/apache/spark/sql/execution/python/streaming/benchmark/BenchmarkTransformWithStateInPySparkStateServer.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org