You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zili Chen (Jira)" <ji...@apache.org> on 2020/01/08 02:26:00 UTC
[jira] [Closed] (FLINK-11135) Reorder Hadoop config loading in
HadoopUtils
[ https://issues.apache.org/jira/browse/FLINK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zili Chen closed FLINK-11135.
-----------------------------
Fix Version/s: 1.10.0
1.9.2
Resolution: Fixed
master via dffa19b85bbe16946c960d9dfe0a2c2f26a0757b
1.10 via f91c7095339f1d77b41e63b12916f4a949ce30c1
1.9 via 7a82b384f985e94fd6e5694f5dee52ec9b5c68fd
> Reorder Hadoop config loading in HadoopUtils
> --------------------------------------------
>
> Key: FLINK-11135
> URL: https://issues.apache.org/jira/browse/FLINK-11135
> Project: Flink
> Issue Type: Improvement
> Components: Deployment / YARN, Runtime / Configuration
> Affects Versions: 1.6.2, 1.7.0, 1.8.2, 1.9.1, 1.10.0
> Reporter: Paul Lin
> Assignee: Paul Lin
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.9.2, 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently, Hadoop config search order is: `HADOOP_HOME > HADOOP_CONF_DIR > Flink configuration entries`. However, YARN client prefers `HADOOP_CONF_DIR` to `HADOOP_HOME`, so it would result in inconsistency if the two env variables point to different paths. Hence I propose to refactor the Hadoop config loading in HadoopUtils, changing the search order to `HADOOP_CONF_DIR > Flink configuration entries > HADOOP_HOME`.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)