You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by Munagala Ramanath <ra...@datatorrent.com> on 2017/03/23 14:15:17 UTC

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Looks like this was a breaking change introduced in Hadoop 2.7.0:

In
https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
we have:

static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static String DELEGATION_TOKEN_MAX_LIFETIME_KEY

But in
https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
we have:

static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY

Ram

On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <ch...@apache.org>
wrote:

> Hi All,
>
> I want to clarify whether my understanding is correct here.
>
> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
> 2. Extracted the tar
> 3. Ran following command to build apex core:
> mvn clean package -DskipTests -Dhadoop.version=2.7.3
> (NOTE: I have overridden hadoop version to 2.7.3)
>
> I get following compilation error:
> [ERROR] Failed to execute goal org.apache.maven.plugins:
> maven-compiler-plugin:3.3:compile (default-compile) on project
> apex-engine: Compilation failure: Compilation failure:
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/
> main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
> cannot find symbol
> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
> [ERROR] -> [Help 1]
>
> What should be the expected result while building apex-core when building
> with different version of hadoop?
> Is this error expected OR something wrong in my environment?
>
> Thanks,
> Chinmay.
>
>


-- 

_______________________________________________________

Munagala V. Ramanath

Software Engineer

E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam

www.datatorrent.com  |  apex.apache.org

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Chinmay Kolhatkar <ch...@apache.org>.
Created this: https://issues.apache.org/jira/browse/APEXCORE-679

On Thu, Mar 23, 2017 at 7:59 PM, Chinmay Kolhatkar <ch...@apache.org>
wrote:

> Cool.. I'll create a Jira...
>
> On Thu, Mar 23, 2017 at 7:55 PM, Thomas Weise <th...@apache.org> wrote:
>
>> Bummer. Thanks Ram, I was just going to look at it. The binaries work on
>> 2.7.x though. Will the issue only show in secure mode?
>>
>> Please create a JIRA in APEXCORE.
>>
>> Chinmay, you may need to apply a patch as part of your build to be able
>> to use the 3.5.0 sources.
>>
>> Thomas
>>
>>
>> On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath <ra...@datatorrent.com>
>> wrote:
>>
>>> Looks like this was a breaking change introduced in Hadoop 2.7.0:
>>>
>>> In https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hado
>>> op/yarn/conf/YarnConfiguration.html we have:
>>>
>>> static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>> static String DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>>
>>> But in https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hado
>>> op/yarn/conf/YarnConfiguration.html we have:
>>>
>>> static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>> static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>>
>>> Ram
>>>
>>> On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <ch...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I want to clarify whether my understanding is correct here.
>>>>
>>>> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>>>> 2. Extracted the tar
>>>> 3. Ran following command to build apex core:
>>>> mvn clean package -DskipTests -Dhadoop.version=2.7.3
>>>> (NOTE: I have overridden hadoop version to 2.7.3)
>>>>
>>>> I get following compilation error:
>>>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>>>> (default-compile) on project apex-engine: Compilation failure: Compilation
>>>> failure:
>>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>>> ava/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
>>>> cannot find symbol
>>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>>> ava/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
>>>> cannot find symbol
>>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>>> ava/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
>>>> cannot find symbol
>>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>>> [ERROR] -> [Help 1]
>>>>
>>>> What should be the expected result while building apex-core when
>>>> building with different version of hadoop?
>>>> Is this error expected OR something wrong in my environment?
>>>>
>>>> Thanks,
>>>> Chinmay.
>>>>
>>>>
>>>
>>>
>>> --
>>>
>>> _______________________________________________________
>>>
>>> Munagala V. Ramanath
>>>
>>> Software Engineer
>>>
>>> E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam
>>>
>>> www.datatorrent.com  |  apex.apache.org
>>>
>>>
>>>
>>
>

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Chinmay Kolhatkar <ch...@apache.org>.
Cool.. I'll create a Jira...

On Thu, Mar 23, 2017 at 7:55 PM, Thomas Weise <th...@apache.org> wrote:

> Bummer. Thanks Ram, I was just going to look at it. The binaries work on
> 2.7.x though. Will the issue only show in secure mode?
>
> Please create a JIRA in APEXCORE.
>
> Chinmay, you may need to apply a patch as part of your build to be able to
> use the 3.5.0 sources.
>
> Thomas
>
>
> On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath <ra...@datatorrent.com>
> wrote:
>
>> Looks like this was a breaking change introduced in Hadoop 2.7.0:
>>
>> In https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hado
>> op/yarn/conf/YarnConfiguration.html we have:
>>
>> static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> static String DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>
>> But in https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hado
>> op/yarn/conf/YarnConfiguration.html we have:
>>
>> static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>
>> Ram
>>
>> On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <ch...@apache.org>
>> wrote:
>>
>>> Hi All,
>>>
>>> I want to clarify whether my understanding is correct here.
>>>
>>> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>>> 2. Extracted the tar
>>> 3. Ran following command to build apex core:
>>> mvn clean package -DskipTests -Dhadoop.version=2.7.3
>>> (NOTE: I have overridden hadoop version to 2.7.3)
>>>
>>> I get following compilation error:
>>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>>> (default-compile) on project apex-engine: Compilation failure: Compilation
>>> failure:
>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>> ava/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87] cannot
>>> find symbol
>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>> ava/com/datatorrent/stram/client/StramAppLauncher.java:[586,120] cannot
>>> find symbol
>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/j
>>> ava/com/datatorrent/stram/client/StramAppLauncher.java:[586,173] cannot
>>> find symbol
>>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>>> [ERROR] -> [Help 1]
>>>
>>> What should be the expected result while building apex-core when
>>> building with different version of hadoop?
>>> Is this error expected OR something wrong in my environment?
>>>
>>> Thanks,
>>> Chinmay.
>>>
>>>
>>
>>
>> --
>>
>> _______________________________________________________
>>
>> Munagala V. Ramanath
>>
>> Software Engineer
>>
>> E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam
>>
>> www.datatorrent.com  |  apex.apache.org
>>
>>
>>
>

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Thomas Weise <th...@apache.org>.
Bummer. Thanks Ram, I was just going to look at it. The binaries work on
2.7.x though. Will the issue only show in secure mode?

Please create a JIRA in APEXCORE.

Chinmay, you may need to apply a patch as part of your build to be able to
use the 3.5.0 sources.

Thomas


On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath <ra...@datatorrent.com>
wrote:

> Looks like this was a breaking change introduced in Hadoop 2.7.0:
>
> In https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/
> YarnConfiguration.html we have:
>
> static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static String DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> But in https://hadoop.apache.org/docs/r2.7.0/api/org/apache/
> hadoop/yarn/conf/YarnConfiguration.html we have:
>
> static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> Ram
>
> On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <ch...@apache.org>
> wrote:
>
>> Hi All,
>>
>> I want to clarify whether my understanding is correct here.
>>
>> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>> 2. Extracted the tar
>> 3. Ran following command to build apex core:
>> mvn clean package -DskipTests -Dhadoop.version=2.7.3
>> (NOTE: I have overridden hadoop version to 2.7.3)
>>
>> I get following compilation error:
>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>> (default-compile) on project apex-engine: Compilation failure: Compilation
>> failure:
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] -> [Help 1]
>>
>> What should be the expected result while building apex-core when building
>> with different version of hadoop?
>> Is this error expected OR something wrong in my environment?
>>
>> Thanks,
>> Chinmay.
>>
>>
>
>
> --
>
> _______________________________________________________
>
> Munagala V. Ramanath
>
> Software Engineer
>
> E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam
>
> www.datatorrent.com  |  apex.apache.org
>
>
>

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Vlad Rozov <v....@datatorrent.com>.
YarnConfiguration is @Evolving :)

Moving discussion to dev@apex.

Thank you,

Vlad

//
On 3/23/17 08:43, Pramod Immaneni wrote:
> So much for semantic versioning..
>
> On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath 
> <ram@datatorrent.com <ma...@datatorrent.com>> wrote:
>
>     Looks like this was a breaking change introduced in Hadoop 2.7.0:
>
>     In
>     https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
>     <https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
>     we have:
>
>     static longDELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>     static StringDELEGATION_TOKEN_MAX_LIFETIME_KEY
>
>     But in
>     https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
>     <https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
>     we have:
>
>     static longRM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>     static StringRM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
>     Ram
>
>     On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar
>     <chinmay@apache.org <ma...@apache.org>> wrote:
>
>         Hi All,
>
>         I want to clarify whether my understanding is correct here.
>
>         1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>         2. Extracted the tar
>         3. Ran following command to build apex core:
>         mvn clean package -DskipTests -Dhadoop.version=2.7.3
>         (NOTE: I have overridden hadoop version to 2.7.3)
>
>         I get following compilation error:
>         [ERROR] Failed to execute goal
>         org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>         (default-compile) on project apex-engine: Compilation failure:
>         Compilation failure:
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR] -> [Help 1]
>
>         What should be the expected result while building apex-core
>         when building with different version of hadoop?
>         Is this error expected OR something wrong in my environment?
>
>         Thanks,
>         Chinmay.
>
>
>
>
>     -- 
>
>     _______________________________________________________
>
>     Munagala V. Ramanath
>
>     Software Engineer
>
>     E: ram@datatorrent.com <ma...@datatorrent.com> | M: (408)
>     331-5034 <tel:%28408%29%20331-5034> | Twitter: @UnknownRam
>
>     www.datatorrent.com <http://www.datatorrent.com>  |
>     apex.apache.org <http://apex.apache.org>
>

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Vlad Rozov <v....@datatorrent.com>.
YarnConfiguration is @Evolving :)

Moving discussion to dev@apex.

Thank you,

Vlad

//
On 3/23/17 08:43, Pramod Immaneni wrote:
> So much for semantic versioning..
>
> On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath 
> <ram@datatorrent.com <ma...@datatorrent.com>> wrote:
>
>     Looks like this was a breaking change introduced in Hadoop 2.7.0:
>
>     In
>     https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
>     <https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
>     we have:
>
>     static longDELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>     static StringDELEGATION_TOKEN_MAX_LIFETIME_KEY
>
>     But in
>     https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html
>     <https://hadoop.apache.org/docs/r2.7.0/api/org/apache/hadoop/yarn/conf/YarnConfiguration.html>
>     we have:
>
>     static longRM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>     static StringRM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
>     Ram
>
>     On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar
>     <chinmay@apache.org <ma...@apache.org>> wrote:
>
>         Hi All,
>
>         I want to clarify whether my understanding is correct here.
>
>         1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>         2. Extracted the tar
>         3. Ran following command to build apex core:
>         mvn clean package -DskipTests -Dhadoop.version=2.7.3
>         (NOTE: I have overridden hadoop version to 2.7.3)
>
>         I get following compilation error:
>         [ERROR] Failed to execute goal
>         org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>         (default-compile) on project apex-engine: Compilation failure:
>         Compilation failure:
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR]
>         /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173]
>         cannot find symbol
>         [ERROR] symbol: variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>         [ERROR] location: class
>         org.apache.hadoop.yarn.conf.YarnConfiguration
>         [ERROR] -> [Help 1]
>
>         What should be the expected result while building apex-core
>         when building with different version of hadoop?
>         Is this error expected OR something wrong in my environment?
>
>         Thanks,
>         Chinmay.
>
>
>
>
>     -- 
>
>     _______________________________________________________
>
>     Munagala V. Ramanath
>
>     Software Engineer
>
>     E: ram@datatorrent.com <ma...@datatorrent.com> | M: (408)
>     331-5034 <tel:%28408%29%20331-5034> | Twitter: @UnknownRam
>
>     www.datatorrent.com <http://www.datatorrent.com>  |
>     apex.apache.org <http://apex.apache.org>
>

Re: 3.5.0 apex core build failing with hadoop 2.7.3 dependency

Posted by Pramod Immaneni <pr...@datatorrent.com>.
So much for semantic versioning..

On Thu, Mar 23, 2017 at 7:15 AM, Munagala Ramanath <ra...@datatorrent.com>
wrote:

> Looks like this was a breaking change introduced in Hadoop 2.7.0:
>
> In https://hadoop.apache.org/docs/r2.6.5/api/org/apache/hadoop/yarn/conf/
> YarnConfiguration.html we have:
>
> static long DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static String DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> But in https://hadoop.apache.org/docs/r2.7.0/api/org/apache/
> hadoop/yarn/conf/YarnConfiguration.html we have:
>
> static long RM_DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
> static String RM_DELEGATION_TOKEN_MAX_LIFETIME_KEY
>
> Ram
>
> On Wed, Mar 22, 2017 at 11:59 PM, Chinmay Kolhatkar <ch...@apache.org>
> wrote:
>
>> Hi All,
>>
>> I want to clarify whether my understanding is correct here.
>>
>> 1. I downloaded apache-apex-core-3.5.0-source-release.tar.gz
>> 2. Extracted the tar
>> 3. Ran following command to build apex core:
>> mvn clean package -DskipTests -Dhadoop.version=2.7.3
>> (NOTE: I have overridden hadoop version to 2.7.3)
>>
>> I get following compilation error:
>> [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.3:compile
>> (default-compile) on project apex-engine: Compilation failure: Compilation
>> failure:
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/plan/logical/LogicalPlan.java:[159,87] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/client/StramAppLauncher.java:[586,120] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_KEY
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] /home/chinmay/files/apache-apex-core-3.5.0/engine/src/main/
>> java/com/datatorrent/stram/client/StramAppLauncher.java:[586,173] cannot
>> find symbol
>> [ERROR] symbol:   variable DELEGATION_TOKEN_MAX_LIFETIME_DEFAULT
>> [ERROR] location: class org.apache.hadoop.yarn.conf.YarnConfiguration
>> [ERROR] -> [Help 1]
>>
>> What should be the expected result while building apex-core when building
>> with different version of hadoop?
>> Is this error expected OR something wrong in my environment?
>>
>> Thanks,
>> Chinmay.
>>
>>
>
>
> --
>
> _______________________________________________________
>
> Munagala V. Ramanath
>
> Software Engineer
>
> E: ram@datatorrent.com | M: (408) 331-5034 | Twitter: @UnknownRam
>
> www.datatorrent.com  |  apex.apache.org
>
>
>