You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by Vlad Rozov <v....@datatorrent.com> on 2017/03/23 15:59:21 UTC
Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency
YarnConfiguration is @Evolving :)
Moving discussion to dev@apex.
Thank you,
Vlad
//
On 3/23/17 08:43, Pramod Immaneni wrote:
> So much for semantic versioning..
>
> On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath
> <ram@datatorrent.com <ma...@datatorrent.com>> wrote:
>
> Looks like this was a breaking change introduced in Hadoop 2.7.0:
>
> In
> https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
> <https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
> we have:
>
> static longDELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static StringDELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> But in
> https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
> <https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
> we have:
>
> static longRM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static StringRM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> Ram
>
> On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar
> <chinmay@apache.org <ma...@apache.org>> wrote:
>
> Hi All,
>
> I want to clarify whether my understanding is correct here.
>
> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
> 2. Extracted the tar
> 3. Ran following command to build apex core:
> mvn clean package -DskipTests -Dhadoop.version=2.7.3
> (NOTE: I have overridden hadoop version to 2.7.3)
>
> I get following compilation error:
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
> (default-compile) on project apex-engine: Compilation failure:
> Compilation failure:
> [ERROR]
> /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
> cannot find symbol
> [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class
> org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR]
> /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
> cannot find symbol
> [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
> [ERROR] location: class
> org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR]
> /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
> cannot find symbol
> [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class
> org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] -> [Help 1]
>
> What should be the expected result while building apex-core
> when building with different version of hadoop?
> Is this error expected OR something wrong in my environment?
>
> Thanks,
> Chinmay.
>
>
>
>
> --
>
> _______________________________________________________
>
> Munagala V. Ramanath
>
> Software Engineer
>
> E: ram@datatorrent.com <ma...@datatorrent.com> | M: (408)
> 331-5034 <tel:%28408%29%20331-5034> | Twitter: @UnknownRam
>
> www.datatorrent.com <http://www.datatorrent.com> |
> apex.apache.org <http://apex.apache.org>
>