You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by "tkaymak (via GitHub)" <gi...@apache.org> on 2026/09/10 11:11:12 UTC

Re: [I] [Feature Request]: Support Apache Spark 4.x in Beam Spark Runner [beam]

tkaymak commented on issue #36841:
URL: https://github.com/apache/beam/issues/36841#issuecomment-5617746902

   Status of the Spark 4 Structured Streaming runner slices, cut from the proof of concept in #39576:
   
   1. Dispatch seam, options and lifecycle hooks, #39906, merged.
   2. Kryo registrations, #39939 and #39952, merged.
   3. DataSourceV2 unbounded source with commit aligned checkpointing, #39971, merged.
   4. Stateless streaming translator, makes the source reachable, #40090, in review.
   5. transformWithState state and timer bridge, then GroupByKey and stateful ParDo translation, next.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org