You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2025/12/11 13:44:00 UTC

[jira] [Created] (SPARK-54684) Introduce stream-stream join operations microbenchmark

Jungtaek Lim created SPARK-54684:
------------------------------------

             Summary: Introduce stream-stream join operations microbenchmark
                 Key: SPARK-54684
                 URL: https://issues.apache.org/jira/browse/SPARK-54684
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 4.2.0
            Reporter: Jungtaek Lim


As of now, we are providing three state format versions for stream-stream join, and the version 2 and 3 are valid one. Ideally we would be better to have e2e benchmarks, but understanding the performance for state store operations under stream-stream join would be very useful to improve it further.

To achieve this, we propose to introduce a new microbenchmark for this.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org