You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Arpit Gupta (Created) (JIRA)" <ji...@apache.org> on 2011/10/01 21:10:34 UTC

[jira] [Created] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

hadoop-env.sh generated from templates has duplicate info
---------------------------------------------------------

                 Key: HADOOP-7711
                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
             Project: Hadoop Common
          Issue Type: Bug
          Components: conf
            Reporter: Arpit Gupta
             Fix For: 0.20.205.1




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta updated HADOOP-7711:
--------------------------------

    Status: Patch Available  (was: Open)
    
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Matt Foley (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt Foley updated HADOOP-7711:
-------------------------------

    Fix Version/s:     (was: 1.0.0)
                   0.20.205.0
                   0.23.0

Corrected Fix Versions field, based on commit dates.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.0, 0.23.0
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120346#comment-13120346 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1030 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1030/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178853
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118935#comment-13118935 ] 

Eric Yang commented on HADOOP-7711:
-----------------------------------

If the running user environment contains HADOOP_NAMENODE_OPTS, then it will trigger this problem.  $HADOOP_NAMENODE_OPTS will eliminate the current problem, but it also enforce $HADOOP_NAMENODE_OPTS to be non-overwritable by the template system.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Eric Yang
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119457#comment-13119457 ] 

Eric Yang commented on HADOOP-7711:
-----------------------------------

+1 looks good.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120951#comment-13120951 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #851 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/851/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178853
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta reassigned HADOOP-7711:
-----------------------------------

    Assignee: Arpit Gupta  (was: Eric Yang)
    
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119390#comment-13119390 ] 

Arpit Gupta commented on HADOOP-7711:
-------------------------------------

Will perform the following.

1. remove curly parenthesis from OPTS vars in the hadoop-env.sh
2. unset the those env in the hadoop-setup-conf.sh
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118922#comment-13118922 ] 

Arpit Gupta commented on HADOOP-7711:
-------------------------------------

The info in the first comment was what was in the hadoop-env.sh if they should not be replaced my we change them from 

export HADOOP_NAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT ${HADOOP_NAMENODE_OPTS}"


to

export HADOOP_NAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT $HADOOP_NAMENODE_OPTS"


Do you think that might be the cause?
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Eric Yang
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120263#comment-13120263 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1088 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1088/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178853
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120876#comment-13120876 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #821 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/821/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178853
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120258#comment-13120258 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1010 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1010/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178853
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta updated HADOOP-7711:
--------------------------------

    Attachment: HADOOP-7711.20s.patch

patch for 20 security branch
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118913#comment-13118913 ] 

Eric Yang commented on HADOOP-7711:
-----------------------------------

The trigger of this problem was fixed in MAPREDUCE-3112.  Arpit, could you confirm it?
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Eric Yang
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta updated HADOOP-7711:
--------------------------------

    Attachment: HADOOP-7711.patch

patch for trunk. also updated HADOOP_OPTS to use HADOOP_CLIENT_OPTS to make it behave the same as 20 security
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119407#comment-13119407 ] 

Arpit Gupta commented on HADOOP-7711:
-------------------------------------

no tests included as this is part of the deployment scripts.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta reassigned HADOOP-7711:
-----------------------------------

    Assignee: Eric Yang
    
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Eric Yang
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120935#comment-13120935 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #37 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/37/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178852
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120904#comment-13120904 ] 

Hudson commented on HADOOP-7711:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #30 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/30/])
    HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)

eyang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1178852
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/hadoop-setup-conf.sh
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-env.sh

                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Yang updated HADOOP-7711:
------------------------------

      Resolution: Fixed
    Release Note: Fixed recursive sourcing of HADOOP_OPTS environment variables (Arpit Gupta via Eric Yang)
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

I just committed this to trunk, 0.23 branch, 0.20 security branch, 0.20.205.  Thanks Arpit.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118890#comment-13118890 ] 

Arpit Gupta commented on HADOOP-7711:
-------------------------------------

Here is the info, notice how the same info is repeated for the namenode and secondary namenode opts

# Command specific options appended to HADOOP_OPTS when specified
export HADOOP_NAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT "
HADOOP_JOBTRACKER_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dmapred.audit.logger=INFO,MRAUDIT -


export HADOOP_SECONDARYNAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT -Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT "
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Arpit Gupta (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118921#comment-13118921 ] 

Arpit Gupta commented on HADOOP-7711:
-------------------------------------

Eric this seems to be a different problem.

hadoop-env.sh template has the following...

export HADOOP_NAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT ${HADOOP_NAMENODE_OPTS}"

export HADOOP_SECONDARYNAMENODE_OPTS="-Dsecurity.audit.logger=INFO,DRFAS -Dhdfs.audit.logger=INFO,DRFAAUDIT ${HADOOP_SECONDARYNAMENODE_OPTS}"


Somehow at the time of generating the conf from the template they get all duplicate info.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Eric Yang
>             Fix For: 0.20.205.1
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7711) hadoop-env.sh generated from templates has duplicate info

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13119404#comment-13119404 ] 

Hadoop QA commented on HADOOP-7711:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12497482/HADOOP-7711.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/255//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/255//console

This message is automatically generated.
                
> hadoop-env.sh generated from templates has duplicate info
> ---------------------------------------------------------
>
>                 Key: HADOOP-7711
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7711
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 0.20.205.1
>
>         Attachments: HADOOP-7711.20s.patch, HADOOP-7711.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira