[jira] [Created] (FLINK-26560) make the threshold of the overlap fraction of incremental restoring configurable

["Yanfei Lei (Jira)" <ji...@apache.org>]

Yanfei Lei created FLINK-26560:
----------------------------------

             Summary: make the threshold of the overlap fraction of incremental restoring configurable
                 Key: FLINK-26560
                 URL: https://issues.apache.org/jira/browse/FLINK-26560
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / State Backends
    Affects Versions: 1.15.0
            Reporter: Yanfei Lei


Currently, the threshold of the overlap fraction of incremental restoring `OVERLAP_FRACTION_THRESHOLD` is a hard-coded, fixed value.

 
{code:java}
public class RocksDBIncrementalCheckpointUtils {

    /**
     * The threshold of the overlap fraction of the handle's key-group range with target key-group
     * range to be an initial handle.
     */
    private static final double OVERLAP_FRACTION_THRESHOLD = 0.75;
...
} {code}
 

`OVERLAP_FRACTION_THRESHOLD` is used to control how to restore a state handle, different thresholds can affect the performance of restoring. The behavior of deletion in restoring has been changed after FLINK-21321, the old threshold no longer fits the current situation.

To make it easier to modify the threshold according to different situations, changing `OVERLAP_FRACTION_THRESHOLD` to be configurable is suggested.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)