[jira] [Created] (FLINK-20574) Throttle number of remote invocation requests on startup or restores with large backlogs

["Tzu-Li (Gordon) Tai (Jira)" <ji...@apache.org>]

Tzu-Li (Gordon) Tai created FLINK-20574:
-------------------------------------------

             Summary: Throttle number of remote invocation requests on startup or restores with large backlogs
                 Key: FLINK-20574
                 URL: https://issues.apache.org/jira/browse/FLINK-20574
             Project: Flink
          Issue Type: Improvement
          Components: Stateful Functions
            Reporter: Tzu-Li (Gordon) Tai
            Assignee: Tzu-Li (Gordon) Tai
             Fix For: statefun-2.3.0


On startup or restores, the {{RequestReplyFunction}} may heavily load the remote functions with multiple concurrent invocation requests if there is a large backlog of restored or historical events to process through.

The new protocol introduced by FLINK-20265 emphasizes this much more due to the nature of extra invocation roundtrips if the function has state declarations (i.e., the first hoard of concurrent invocations would all fail with an {{IncompleteInvocationContext}} and requires invocation patching + state registrations).

We should think about how to apply throttling to mitigate these scenarios.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)