[jira] [Comment Edited] (BEAM-6077) Make UnboundedSource state rescale friendly

["Maximilian Michels (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16697197#comment-16697197 ] 

Maximilian Michels edited comment on BEAM-6077 at 11/23/18 2:23 PM:
--------------------------------------------------------------------

Correction: you need to use {{OperatorStateStore}} state which also provides a State interface. If you look at {{FlinkKafkaConsumerBase#snapshotState}} you see an example of how that's being used.


was (Author: mxm):
Correction: you need to use {{OperatorStateStore}} state which also provides a State interface. If you look at {{ FlinkKafkaConsumerBase#snapshotState}} you see an example of how that's being used.

> Make UnboundedSource state rescale friendly
> -------------------------------------------
>
>                 Key: BEAM-6077
>                 URL: https://issues.apache.org/jira/browse/BEAM-6077
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>    Affects Versions: 2.8.0
>            Reporter: Jozef Vilcek
>            Assignee: Jozef Vilcek
>            Priority: Major
>
> FlinkRunner's UnboundedSourceWrapper currently does not rescale well it's state when job changes parallelism.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)