You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2019/12/06 15:18:00 UTC

[jira] [Commented] (BEAM-8907) Implement SplittableDoFn translation in spark runner

    [ https://issues.apache.org/jira/browse/BEAM-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989871#comment-16989871 ] 

Ismaël Mejía commented on BEAM-8907:
------------------------------------

SDF is implemented in a naive an simple way for all runners by expanding SDF into two continuous ParDos in the batch case. Most tests already pass for the Structured Streaming runner so this ticket could closed given that the only missing bit is BEAM-8859

> Implement SplittableDoFn translation in spark runner
> ----------------------------------------------------
>
>                 Key: BEAM-8907
>                 URL: https://issues.apache.org/jira/browse/BEAM-8907
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-spark
>            Reporter: Etienne Chauchot
>            Priority: Major
>              Labels: structured-streaming
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)