You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Flink CDC Issue Import (Jira)" <ji...@apache.org> on 2024/03/20 09:29:03 UTC
[jira] [Created] (FLINK-34834) [cdc-pipeline] Add 'flink-confing' config for pipeline.
Flink CDC Issue Import created FLINK-34834:
----------------------------------------------
Summary: [cdc-pipeline] Add 'flink-confing' config for pipeline.
Key: FLINK-34834
URL: https://issues.apache.org/jira/browse/FLINK-34834
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Reporter: Flink CDC Issue Import
### Search before asking
- [X] I searched in the [issues|https://github.com/ververica/flink-cdc-connectors/issues] and found nothing similar.
### Motivation
Our current task is to submit to the Flink cluster. Currently, the Flink configuration can only be read from 'FLINK_HOME' in the flink-conf.yaml file. This limitation is too restrictive, as it does not allow for flexible configuration of individual pipeline settings.
### Solution
Therefore, I suggest adding a configuration item, "flink-config," to the pipeline YAML configuration file. This will be used to configure Flink settings for individual pipeline.
The values in the "flink-config" configuration item will override those in flink-conf.yaml.
The 'flink-config' configuration items are as follows:
```yaml
flink-config:
execution.checkpointing.interval: 30000
execution.checkpointing.mode: EXACTLY_ONCE
```
### Alternatives
_No response_
### Anything else?
_No response_
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
---------------- Imported from GitHub ----------------
Url: https://github.com/apache/flink-cdc/issues/2854
Created by: [joyCurry30|https://github.com/joyCurry30]
Labels: enhancement,
Created at: Tue Dec 12 14:08:55 CST 2023
State: open
--
This message was sent by Atlassian Jira
(v8.20.10#820010)