You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Yanfei Lei (Jira)" <ji...@apache.org> on 2021/07/15 09:39:00 UTC
[jira] [Created] (FLINK-23399) Add a benchmark for rescaling
Yanfei Lei created FLINK-23399:
----------------------------------
Summary: Add a benchmark for rescaling
Key: FLINK-23399
URL: https://issues.apache.org/jira/browse/FLINK-23399
Project: Flink
Issue Type: Improvement
Components: Runtime / State Backends
Affects Versions: 1.14.0
Reporter: Yanfei Lei
We notice that rescaling is not covered in the current state benchmark, so we'd like to introduce a benchmark for rescaling in flink-benchmark.
The benchmark process is:
(1) generate some states,
(2) change the parallelism of the operator, and restore from these states generate before.
The implementation of this benchmark is based on {{RocksIncrementalCheckpointRescalingTest}}, and *_AverageTime_* is used to measure the rescaling performance on each subtask.
And this benchmark does not conflict with
RocksIncrementalCheckpointRescalingBenchmarkTest in [PR|[https://github.com/apache/flink/pull/14893]]. Compare with
RocksIncrementalCheckpointRescalingBenchmarkTest, this benchmark supports testing rescaling on different state backends, and has a finer granularity.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)