You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Bo Cui (Jira)" <ji...@apache.org> on 2021/03/26 01:36:00 UTC

[jira] [Created] (FLINK-21982) jobs should use client org.apache.hadoop.config on yarn

Bo Cui created FLINK-21982:
------------------------------

             Summary: jobs should use client org.apache.hadoop.config on yarn
                 Key: FLINK-21982
                 URL: https://issues.apache.org/jira/browse/FLINK-21982
             Project: Flink
          Issue Type: Bug
          Components: Deployment / YARN
    Affects Versions: 1.13.0
            Reporter: Bo Cui


currently, jobs use the Yarn server configuration during execution. 
i think we should submit the configuration to the HDFS, like MR job.xml...etc
and container fetches the job.xml and creates a soft link(hdfs-site core-site yarn-site) during container initializes
and then the configuration can obtain these resources through classLoader.getResource(String) during configuration initializes



--
This message was sent by Atlassian Jira
(v8.3.4#803005)