You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Seth Wiesman (Jira)" <ji...@apache.org> on 2021/02/09 15:25:00 UTC

[jira] [Assigned] (FLINK-21341) Update state reader to return InputFormat

     [ https://issues.apache.org/jira/browse/FLINK-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Seth Wiesman reassigned FLINK-21341:
------------------------------------

    Assignee: Jun Qin

> Update state reader to return InputFormat
> -----------------------------------------
>
>                 Key: FLINK-21341
>                 URL: https://issues.apache.org/jira/browse/FLINK-21341
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / State Processor
>    Affects Versions: 1.13.0
>            Reporter: Seth Wiesman
>            Assignee: Jun Qin
>            Priority: Major
>
> The state processor api on read currently takes an ExecutionEnvironment and returns a DataSet. As Flink now supports Bounded DataStream we want to support that as well but not have to maintain parallel apis. To that end we propose the following.
> Introduce a new `load` method to Savepoint.
>  
> {code:java}
> SavepointReader Savepoint#load(String path, StateBackend backend);
> {code}
> SavepointReader will contain the same read methods as ExistingSavepoint but they will instead return InputFormat<T, ?>. This way the input format can be used with either DataSet, DataStream, or Table API.
>  
> The reader methods in ExistingSavepoint should be deprecated.
>  
> Additionally, OperatorStateInputFormat and KeyedStateInputFormat should both now extend ResultTypeQueryable so users get efficient serializer for their reads.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)