You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by GitBox <gi...@apache.org> on 2022/10/07 04:42:08 UTC
[GitHub] [incubator-streampark] 1996fanrui opened a new pull request, #1755: [Feature] Simplify checkpoint/state related configuration
1996fanrui opened a new pull request, #1755:
URL: https://github.com/apache/incubator-streampark/pull/1755
## What problem does this PR solve?
Issue Number: close #1744
Problem Summary:
## What is changed and how it works?
Click #1739 to get detailed background.
Simplify checkpoint/state related configuration.
Checkpoint related:
| StreamPark Configuration | Flink Configuration | Flink 1.12 doc | Flink 1.15 doc |
| --- | --- | --- | --- |
| flink.checkpoints.enable | None, the checkpoint will be enable when `execution.checkpointing.interval` > 0 | | |
| flink.checkpoints.unaligned | execution.checkpointing.unaligned | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-unaligned | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-unaligned |
| flink.checkpoints.interval | execution.checkpointing.interval | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-interval | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-interval |
| flink.checkpoints.mode | execution.checkpointing.mode | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-mode | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-mode |
| flink.checkpoints.cleanup | execution.checkpointing.externalized-checkpoint-retention | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-externalized-checkpoint-retention | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-externalized-checkpoint-retention |
| flink.checkpoints.timeout | execution.checkpointing.timeout | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-timeout | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-timeout |
| flink.checkpoints.maxConcurrent | execution.checkpointing.max-concurrent-checkpoints | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-max-concurrent-checkpoints | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-max-concurrent-checkpoints |
| flink.checkpoints.minPauseBetween | execution.checkpointing.min-pause | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#execution-checkpointing-min-pause | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#execution-checkpointing-min-pause |
State related:
| StreamPark Configuration | Flink Configuration | Flink 1.12 doc | Flink 1.15 doc |
| --- | --- | --- | --- |
| flink.state.savepoints.dir | state.savepoints.dir | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#state-savepoints-dir | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-savepoints-dir |
| flink.state.checkpoints.dir | state.checkpoints.dir | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#state-checkpoints-dir | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-checkpoints-dir |
| flink.state.checkpoint-storage | state.checkpoint-storage | Support since Flink-1.13 | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-checkpoint-storage |
| flink.state.backend.value | state.backend | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#state-backend | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-backend |
| flink.state.backend.async | state.backend.async | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#state-backend-async | The `state.backend.async` option is deprecated since Flink 1.13. Snapshots are always asynchronous now. |
| flink.state.backend.incremental | state.backend.incremental | https://nightlies.apache.org/flink/flink-docs-release-1.12/deployment/config.html#state-backend-incremental | https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-backend-incremental |
| flink.state.backend.memory | None, JobManagerCheckpointStorage and MemoryStateBackend store state in JM memory and are not recommended for production use. Flink has no corresponding configuration item, so StreamPark will discard it. | | |
| flink.state.backend.rocksdb | | | |
Feel free to ping committers for the review!
## Contribution Checklist
- Make sure that the pull request corresponds to a [GITHUB issue](https://github.com/apache/streampark/issues).
- Name the pull request in the form "[Feature] [component] Title of the pull request", where *Feature* can be replaced by `Hotfix`, `Bug`, etc.
- Minor fixes should be named following this pattern: `[hotfix] [docs] Fix typo in README.md doc`.
## Purpose of this pull request
Simplify checkpoint/state related configuration.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-streampark] wolfboys merged pull request #1755: [Feature] Simplify checkpoint/state related configuration
Posted by GitBox <gi...@apache.org>.
wolfboys merged PR #1755:
URL: https://github.com/apache/incubator-streampark/pull/1755
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org