You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zili Chen (Jira)" <ji...@apache.org> on 2020/01/08 02:20:00 UTC
[jira] [Updated] (FLINK-11135) Reorder Hadoop config loading in
HadoopUtils
[ https://issues.apache.org/jira/browse/FLINK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zili Chen updated FLINK-11135:
------------------------------
Summary: Reorder Hadoop config loading in HadoopUtils (was: Refactor Hadoop config loading in HadoopUtils)
> Reorder Hadoop config loading in HadoopUtils
> --------------------------------------------
>
> Key: FLINK-11135
> URL: https://issues.apache.org/jira/browse/FLINK-11135
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN, Runtime / Configuration
> Affects Versions: 1.6.2, 1.7.0, 1.8.2, 1.9.1, 1.10.0
> Reporter: Paul Lin
> Assignee: Paul Lin
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, Hadoop config search order is: `HADOOP_HOME > HADOOP_CONF_DIR > Flink configuration entries`. However, YARN client prefers `HADOOP_CONF_DIR` to `HADOOP_HOME`, so it would result in inconsistency if the two env variables point to different paths. Hence I propose to refactor the Hadoop config loading in HadoopUtils, changing the search order to `HADOOP_CONF_DIR > Flink configuration entries > HADOOP_HOME`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)