You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Till Rohrmann (JIRA)" <ji...@apache.org> on 2019/02/26 16:05:00 UTC

[jira] [Closed] (FLINK-2581) Add warning to the YARN client when using an older Hadoop version

     [ https://issues.apache.org/jira/browse/FLINK-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Till Rohrmann closed FLINK-2581.
--------------------------------
    Resolution: Won't Do

Closed because of inactivity

> Add warning to the YARN client when using an older Hadoop version
> -----------------------------------------------------------------
>
>                 Key: FLINK-2581
>                 URL: https://issues.apache.org/jira/browse/FLINK-2581
>             Project: Flink
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 0.10.0
>            Reporter: Robert Metzger
>            Priority: Minor
>
> Some users were facing issues when using Flink on YARN because they were using outdated Hadoop releases included into Flink.
> In this example, the user was using Flink with hadoop 2.2.0 included, against a Hadoop 2.6.0 cluster: http://stackoverflow.com/questions/32085990/error-with-kerberos-authentication-when-executing-flink-example-code-on-yarn-clu/32131571
> With this change, I'm going to ResourceManager's REST API to get the Hadoop version of the remote YARN cluster: http://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html
> This Hadoop class allows us to determine the local Hadoop version we are using: https://hadoop.apache.org/docs/r1.2.1/api/org/apache/hadoop/util/VersionInfo.html



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)