You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Sihua Zhou (JIRA)" <ji...@apache.org> on 2018/02/26 16:19:00 UTC

[jira] [Created] (FLINK-8790) Improve performance for recovery from incremental checkpoint

Sihua Zhou created FLINK-8790:
---------------------------------

             Summary: Improve performance for recovery from incremental checkpoint
                 Key: FLINK-8790
                 URL: https://issues.apache.org/jira/browse/FLINK-8790
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.5.0
            Reporter: Sihua Zhou
            Assignee: Sihua Zhou
             Fix For: 1.5.0


When there are multi state handle to be restored, we can improve the performance as follow:

1. Choose the best state handle to init the target db
2. Use the other state handles to create temp db, and clip the db according to the target key group range (via rocksdb.deleteRange()), this can help use get rid of the `key group check` in 
 `data insertion loop` and also help us get rid of traversing the useless record.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)