You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Sihua Zhou (JIRA)" <ji...@apache.org> on 2018/03/07 08:41:00 UTC

[jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend

     [ https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sihua Zhou updated FLINK-8845:
------------------------------
    Summary: Use WriteBatch to improve performance for recovery in RocksDB backend  (was:  Introduce `parallel recovery` mode for full checkpoint (savepoint))

> Use WriteBatch to improve performance for recovery in RocksDB backend
> ---------------------------------------------------------------------
>
>                 Key: FLINK-8845
>                 URL: https://issues.apache.org/jira/browse/FLINK-8845
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.5.0
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Major
>             Fix For: 1.6.0
>
>
> Base on {{ingestExternalFile()}} and {{SstFileWriter}} provided by RocksDB, we can restore from fully checkpoint (savepoint) in parallel. This can also be extended to incremental checkpoint easily, but for the sake of simple, we do this in two separate tasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)