You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Arvid Heise (Jira)" <ji...@apache.org> on 2021/04/07 09:26:00 UTC

[jira] [Created] (FLINK-22136) Device application for unaligned checkpoint test on cluster

Arvid Heise created FLINK-22136:
-----------------------------------

             Summary: Device application for unaligned checkpoint test on cluster
                 Key: FLINK-22136
                 URL: https://issues.apache.org/jira/browse/FLINK-22136
             Project: Flink
          Issue Type: Sub-task
            Reporter: Arvid Heise


To test unaligned checkpoints, we should use a few different applications that use different features:

*     Mixing forward/rescale channels with keyby or other shuffle operations
*     Unions
*     2 or n-ary operators
*     Associated state ((keyed) process function)
*     Correctness verifications

The sinks should not be mocked but rather should be able to induce a fair amount of backpressure into the system. Quite possibly, it would be a good idea to have a way to add more backpressure to the sink by running the respective system on the cluster and be able to add/remove parallel instances.





--
This message was sent by Atlassian Jira
(v8.3.4#803005)