You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Felipe DTS (Jira)" <ji...@apache.org> on 2022/02/18 05:12:00 UTC
[jira] [Commented] (BEAM-11998) Portable runners should be able to issue checkpoints to Splittable DoFn
[ https://issues.apache.org/jira/browse/BEAM-11998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494366#comment-17494366 ]
Felipe DTS commented on BEAM-11998:
-----------------------------------
Cannot we put the priority as P!, for that ticket.
Because here an important component is nonfunctional for important use cases.
As many said in the comments above
"that because of that error, they are searching for alternatives"
> Portable runners should be able to issue checkpoints to Splittable DoFn
> -----------------------------------------------------------------------
>
> Key: BEAM-11998
> URL: https://issues.apache.org/jira/browse/BEAM-11998
> Project: Beam
> Issue Type: New Feature
> Components: cross-language, runner-flink, runner-spark
> Reporter: Boyuan Zhang
> Priority: P2
> Attachments: read.png
>
>
> To execute unbounded Splittable DoFn over fnapi in streaming mode properly, portable runners should issue split(ProcessBundleSplitRequest with fraction_of_remainder > 0) or simply checkpoint(ProcessBundleSplitRequest with fraction_of_remainder == 0) to SDK regularly to make current bundle finished processing instead of running forever.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)