You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Etienne Chauchot <ec...@apache.org> on 2021/08/03 12:53:24 UTC

Re: Spark Structured Streaming Runner Roadmap

Hi,

Sorry for the late answer: the streaming mode in spark structured 
streaming runner is stuck because of spark structured streaming 
framework implementation of watermark at the apache spark project side. See

https://echauchot.blogspot.com/2020/11/watermark-architecture-proposal-for.html

best

Etienne

On 20/05/2021 20:37, Yu Zhang wrote:
> Hi Beam Community,
>
> Would there be any roadmap for Spark Structured Runner to support streaming and Splittable DoFn API? Like the specific timeline or release version.
>
> Thanks,
> Yu