[jira] [Commented] (BEAM-8742) Add stateful processing to ParDo load test

["Kamil Wasilewski (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183248#comment-17183248 ] 

Kamil Wasilewski commented on BEAM-8742:
----------------------------------------

> have support for streaming which we can't have until SDF is implemented in streaming mode

[~mxm] Does it apply only to Flink? We've successfully run streaming pipelines with `SyntheticSource` on Dataflow, which would mean SDF does work in streaming mode (SyntheticSource executes as SDF because a wrapper is used). Also, a JIRA ticket related to streaming SDF in Python has been closed: https://issues.apache.org/jira/browse/BEAM-3742

> Add stateful processing to ParDo load test
> ------------------------------------------
>
>                 Key: BEAM-8742
>                 URL: https://issues.apache.org/jira/browse/BEAM-8742
>             Project: Beam
>          Issue Type: Sub-task
>          Components: testing
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: P2
>             Fix For: 2.22.0
>
>          Time Spent: 16h 10m
>  Remaining Estimate: 0h
>
> So far, the ParDo load test is not stateful. We should add a basic counter to test the stateful processing.
> The test should work in streaming mode and with checkpointing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)