You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "qiunan (Jira)" <ji...@apache.org> on 2021/12/22 07:58:00 UTC

[jira] [Created] (FLINK-25413) Use append yarn and hadoop config to replace overwrite

qiunan created FLINK-25413:
------------------------------

             Summary: Use append yarn and hadoop config to replace overwrite
                 Key: FLINK-25413
                 URL: https://issues.apache.org/jira/browse/FLINK-25413
             Project: Flink
          Issue Type: Improvement
            Reporter: qiunan


In [FLINK-16005][flink-yarn] Support yarn and hadoop config override.

However, I think we should append methods to better meet our production needs. For example, the HDFS cluster in production has its own configuration. We only need to add hdfs that cannot be written to. At the same time, there are many clusters in production. We cannot cover all the configurations.

In flink-conf.yaml
flink.hadoop.dfs.nameservices: nameservice1

The problem now is, if flink.hadoop.dfs.nameservices: nameservice1 we can only write to the cluster of nameservice1, all other clusters cannot be written, we need to add the configuration of each cluster to write.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)