You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Robert Metzger (JIRA)" <ji...@apache.org> on 2015/08/27 11:30:45 UTC
[jira] [Created] (FLINK-2581) Add warning to the YARN client when
using an older Hadoop version
Robert Metzger created FLINK-2581:
-------------------------------------
Summary: Add warning to the YARN client when using an older Hadoop version
Key: FLINK-2581
URL: https://issues.apache.org/jira/browse/FLINK-2581
Project: Flink
Issue Type: Improvement
Components: YARN Client
Affects Versions: 0.10
Reporter: Robert Metzger
Assignee: Robert Metzger
Some users were facing issues when using Flink on YARN because they were using outdated Hadoop releases included into Flink.
In this example, the user was using Flink with hadoop 2.2.0 included, against a Hadoop 2.6.0 cluster: http://stackoverflow.com/questions/32085990/error-with-kerberos-authentication-when-executing-flink-example-code-on-yarn-clu/32131571
With this change, I'm going to ResourceManager's REST API to get the Hadoop version of the remote YARN cluster: http://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
This Hadoop class allows us to determine the local Hadoop version we are using: https://hadoop.apache.org/docs/r1.2.1/api/org/apache/hadoop/util/VersionInfo.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)