[jira] [Commented] (OOZIE-1958) address duplication of env variables in oozie.launcher.yarn.app.mapreduce.am.env when running with uber mode

["Hadoop QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091671#comment-14091671 ] 

Hadoop QA commented on OOZIE-1958:
----------------------------------

Testing JIRA OOZIE-1958

Cleaning local git workspace

----------------------------

{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.    {color:green}+1{color} the patch does not introduce any @author tags
.    {color:green}+1{color} the patch does not introduce any tabs
.    {color:green}+1{color} the patch does not introduce any trailing spaces
.    {color:green}+1{color} the patch does not introduce any line longer than 132
.    {color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.    {color:green}+1{color} the patch does not seem to introduce new RAT warnings
{color:green}+1 JAVADOC{color}
.    {color:green}+1{color} the patch does not seem to introduce new Javadoc warnings
{color:green}+1 COMPILE{color}
.    {color:green}+1{color} HEAD compiles
.    {color:green}+1{color} patch compiles
.    {color:green}+1{color} the patch does not seem to introduce new javac warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.    {color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
.    {color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.    Tests run: 1506
.    Tests failed: 1
.    Tests errors: 0

.    The patch failed the following testcases:

.      testActionKillCommandDate(org.apache.oozie.command.coord.TestCoordActionsKillXCommand)

{color:green}+1 DISTRO{color}
.    {color:green}+1{color} distro tarball builds with the patch 

----------------------------
{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/1519/

> address duplication of env variables in oozie.launcher.yarn.app.mapreduce.am.env when running with uber mode
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: OOZIE-1958
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1958
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Ryota Egashira
>            Assignee: Ryota Egashira
>             Fix For: 4.1.0
>
>         Attachments: OOZIE-1958-v3.patch
>
>
> Hadoop 2.X has the weird behavior to translate yarn.app.mapreduce.am.env,
> JAVA_HOME=/home/gs/java/jdk64/current,JAVA_HOME=/home/gs/java/jdk64/current 
> to
> JAVA_HOME=/home/gs/java/jdk64/current:JAVA_HOME=/home/gs/java/jdk64/current
> due to this, some of env variables are not taken in effect properly.
> this problem happens when running launcher with uber mode in Hadoop 2.X, 
> since oozie copies mapreduce.map.env to yarn.app.mapreduce.am.env, like following case
>   
> {code}
> <property>
>       <name>oozie.launcher.mapreduce.map.env</name>
>       <value>JAVA_HOME=/home/gs/java/jdk64/current</value>
> </property>
> <property>
>       <name>oozie.launcher.yarn.app.mapreduce.am.env</name>
>       <value>JAVA_HOME=/home/gs/java/jdk64/current</value>
> </property>
> {code}
> this patch is to do 
>    1) Deduplication before appending map.env to am.env
>    2) If there is a conflict, turn of uber mode AM. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)