You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Yuan Kui (Jira)" <ji...@apache.org> on 2022/09/21 04:01:00 UTC

[jira] [Created] (FLINK-29366) Use flink shaded jacson to parse flink-conf.yaml

Yuan Kui created FLINK-29366:
--------------------------------

             Summary: Use flink shaded jacson to parse flink-conf.yaml
                 Key: FLINK-29366
                 URL: https://issues.apache.org/jira/browse/FLINK-29366
             Project: Flink
          Issue Type: Improvement
          Components: API / Core
    Affects Versions: 1.13.3
            Reporter: Yuan Kui


Now we use a simple implementation(org.apache.flink.configuration.GlobalConfiguration#loadYAMLResource) to parse flink-conf.yaml, which can only parse key-value pairs.

Although there have been discussions on this issue historically(see:https://github.com/stratosphere/stratosphere/issues/113)
but I think that in the actual production environment, we often need to config complex structure into flink-conf.yaml. At this time, the yaml libary is required for parsing, so I suggest to use the yaml library to parse flink-conf.yaml  instead of our own implementation.

In fact, the flink-core module already has a dependency on flink-shaded-jackson which could parse yaml format,  we can use this jar without more dependencies.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)