You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Vinay (JIRA)" <ji...@apache.org> on 2012/06/04 16:42:23 UTC

[jira] [Commented] (HADOOP-8476) Remove duplicate VM arguments for hadoop deamon

    [ https://issues.apache.org/jira/browse/HADOOP-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288594#comment-13288594 ] 

Vinay commented on HADOOP-8476:
-------------------------------

following things will remove the duplicate VM args.

1. Make following changes in hadoop-env.sh
{noformat}
export HADOOP_OPTS=""

export HADOOP_NAMENODE_OPTS="-Dhdfs.audit.logger=${HDFS_AUDIT_LOGGER:-INFO,NullAppender}"
export HADOOP_DATANODE_OPTS=""
export HADOOP_SECONDARYNAMENODE_OPTS="-Dhdfs.audit.logger=${HDFS_AUDIT_LOGGER:-INFO,NullAppender}"

export HADOOP_CLIENT_OPTS="-Xmx128m"
{noformat}

Above change is because, from any script hadoop-config.sh will be the first script called, which inturn call hadoop-env.sh. So appending not required.
Anyway remaining args will be added inside hadoop-config.sh. 

Also hadoop-config.sh will be called again by hdfs-config.sh and yarn-config.sh. 
So args will be appending again and again.

2. Remove calling hadoop-env.sh explicitly from hadoop-daemon.sh

I will post patch in some time.

Any comments on this.. ?

                
> Remove duplicate VM arguments for hadoop deamon
> -----------------------------------------------
>
>                 Key: HADOOP-8476
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8476
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: conf
>    Affects Versions: 2.0.0-alpha, 3.0.0
>            Reporter: Vinay
>            Assignee: Vinay
>            Priority: Minor
>
> remove duplicate VM arguments passed to hadoop daemon
> Following are the VM arguments currently duplicated.
> {noformat}-Dproc_namenode
> -Xmx1000m
> -Djava.net.preferIPv4Stack=true
> -Xmx128m
> -Xmx128m
> -Dhadoop.log.dir=/home/nn2/logs
> -Dhadoop.log.file=hadoop-root-namenode-HOST-xx-xx-xx-105.log
> -Dhadoop.home.dir=/home/nn2/
> -Dhadoop.id.str=root
> -Dhadoop.root.logger=INFO,RFA
> -Dhadoop.policy.file=hadoop-policy.xml
> -Djava.net.preferIPv4Stack=true
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS{noformat}
>  
> In above VM argumants -Xmx1000m will be Overridden by -Xmx128m.
> BTW Other duplicate arguments wont harm

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira