[jira] [Updated] (FLINK-14862) Fuse initalizeState and open passes in StreamTask#invoke

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-14862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated FLINK-14862:
-----------------------------------
    Labels: pull-request-available  (was: )

> Fuse initalizeState and open passes in StreamTask#invoke
> --------------------------------------------------------
>
>                 Key: FLINK-14862
>                 URL: https://issues.apache.org/jira/browse/FLINK-14862
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / Task
>            Reporter: Igal Shilman
>            Assignee: Igal Shilman
>            Priority: Minor
>              Labels: pull-request-available
>
> Currently chained operators lack the ability to send records downstream during initializeState (AbstractStreamOperator#initalizeState), because downstream operators in the chain didn't open yet (AbstractStreamOperator#open).
> The main problem with that is that the rawOperatorState and the rawKeyedStateInputs are only valid during the execution of initializeState, and with large raw states materializing to hand them over to be used at open is not feasible (at least without spilling to disk)
> So, I would propose to fuse the loops here:
> https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask.java#L435,L436
> Into a single loop that calls initalizeState and immediately open.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)