[jira] [Comment Edited] (FLINK-8177) Flink cannot be built for Hadoop 2.9.0

["Aljoscha Krettek (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272679#comment-16272679 ] 

Aljoscha Krettek edited comment on FLINK-8177 at 11/30/17 1:44 PM:
-------------------------------------------------------------------

I simply changed the test to not extend {{Container}} but to instead mock it. This way we get around the differing interfaces for different Hadoop versions. Travis: https://travis-ci.org/aljoscha/flink/builds/309513334

We probably should not offer a hadoop 2.9.0 release for 1.4.0 because that would require further testing but if this travis run succeeds I'm somewhat confident that users can just use the "Hadoop-free" binary release and drop in whatever hadoop version they like or use it on YARN.


was (Author: aljoscha):
I simply changed the test to not extend {{Container}} but to instead mock it. This way we get around the differing interfaces for different Hadoop versions.

We probably should not offer a hadoop 2.9.0 release for 1.4.0 because that would require further testing but if this travis run succeeds I'm somewhat confident that users can just use the "Hadoop-free" binary release and drop in whatever hadoop version they like or use it on YARN.

> Flink cannot be built for Hadoop 2.9.0
> --------------------------------------
>
>                 Key: FLINK-8177
>                 URL: https://issues.apache.org/jira/browse/FLINK-8177
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN
>    Affects Versions: 1.4.0, 1.5.0
>            Reporter: Fabian Hueske
>            Priority: Critical
>
> Flink cannot be built for Hadoop 2.9.0 which was released on Nov. 17th, 2017.
> When running 
> {code}
> mvn clean install -DskipTests -Dhadoop.version=2.9.0
> {code}
> Maven fails with the following error:
> {code}
> [ERROR] /Users/fhueske/Development/flink/flink-yarn/src/test/java/org/apache/flink/yarn/UtilsTest.java:[239,16] org.apache.flink.yarn.UtilsTest.TestingContainer is not abstract and does not override abstract method setExecutionType(org.apache.hadoop.yarn.api.records.ExecutionType) in org.apache.hadoop.yarn.api.records.Container
> {code}
> The problem is caused, because Hadoop 2.9.0 extended the {{Container}} interface with a getter ({{getExecutionType()}}) and a setter method ({{setExecutionType()}}) and adds a class dependency on {{ExecutionType}}.
> Flink's {{UtilsTest}} class defines a class {{TestingContainer}} that implements the {{Container}} interface.
> We cannot simply update the implementation of {{TestingContainer}} because previous versions of Hadoop do not provide {{ExecutionType}}.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)