You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/07/11 15:15:00 UTC

[jira] [Commented] (FLINK-9799) Generalize/unify state meta info

    [ https://issues.apache.org/jira/browse/FLINK-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540227#comment-16540227 ] 

ASF GitHub Bot commented on FLINK-9799:
---------------------------------------

GitHub user StefanRRichter opened a pull request:

    https://github.com/apache/flink/pull/6308

    [FLINK-9799] Generalize and unify state meta info snapshot

    ## What is the purpose of the change
    
    This PR generalizes and unifies the de/serialization of state meta information in backends. We replace the snapshots and reader/writers of the individual state types with a general `StateMetaInfoSnapshot` and the corresponding `StateMetaInfoSnapshotReadersWriters`. Backwards compatibility is maintained.
    
    ## Verifying this change
    
    This change is already covered by existing tests.
    
    ## Does this pull request potentially affect one of the following parts:
    
      - Dependencies (does it add or upgrade a dependency): (no)
      - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no)
      - The serializers: (no)
      - The runtime per-record code paths (performance sensitive): (no)
      - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
      - The S3 file system connector: (no)
    
    ## Documentation
    
      - Does this pull request introduce a new feature? (no)
      - If yes, how is the feature documented? (not applicable)


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/StefanRRichter/flink FLINK-9799-generalize-state-meta-pr

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/6308.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #6308
    
----
commit 5e44f759342793f4532e99f8df589c2416402176
Author: Stefan Richter <s....@...>
Date:   2018-07-11T09:11:11Z

    [FLINK-9799][state] Generalize and unify state meta infos

----


> Generalize/unify state meta info
> --------------------------------
>
>                 Key: FLINK-9799
>                 URL: https://issues.apache.org/jira/browse/FLINK-9799
>             Project: Flink
>          Issue Type: Sub-task
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.5.0
>            Reporter: Stefan Richter
>            Assignee: Stefan Richter
>            Priority: Major
>              Labels: pull-request-available
>
> Flink currently has a couple of classes that describe the meta data of state (e.g. for keyed state, operator state, broadcast state, ...) and they typically come with their own serialization proxy and backwards compatibility story. However, the differences between those meta data classes are very small, like different option flags and a different set of serializers. Before introducing yet another meta data for timers, we should unify them in a general state meta data class.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)