You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Vinay (JIRA)" <ji...@apache.org> on 2012/06/04 16:42:23 UTC
[jira] [Commented] (HADOOP-8476) Remove duplicate VM arguments for
hadoop deamon
[ https://issues.apache.org/jira/browse/HADOOP-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13288594#comment-13288594 ]
Vinay commented on HADOOP-8476:
-------------------------------
following things will remove the duplicate VM args.
1. Make following changes in hadoop-env.sh
{noformat}
export HADOOP_OPTS=""
export HADOOP_NAMENODE_OPTS="-Dhdfs.audit.logger=${HDFS_AUDIT_LOGGER:-INFO,NullAppender}"
export HADOOP_DATANODE_OPTS=""
export HADOOP_SECONDARYNAMENODE_OPTS="-Dhdfs.audit.logger=${HDFS_AUDIT_LOGGER:-INFO,NullAppender}"
export HADOOP_CLIENT_OPTS="-Xmx128m"
{noformat}
Above change is because, from any script hadoop-config.sh will be the first script called, which inturn call hadoop-env.sh. So appending not required.
Anyway remaining args will be added inside hadoop-config.sh.
Also hadoop-config.sh will be called again by hdfs-config.sh and yarn-config.sh.
So args will be appending again and again.
2. Remove calling hadoop-env.sh explicitly from hadoop-daemon.sh
I will post patch in some time.
Any comments on this.. ?
> Remove duplicate VM arguments for hadoop deamon
> -----------------------------------------------
>
> Key: HADOOP-8476
> URL: https://issues.apache.org/jira/browse/HADOOP-8476
> Project: Hadoop Common
> Issue Type: Bug
> Components: conf
> Affects Versions: 2.0.0-alpha, 3.0.0
> Reporter: Vinay
> Assignee: Vinay
> Priority: Minor
>
> remove duplicate VM arguments passed to hadoop daemon
> Following are the VM arguments currently duplicated.
> {noformat}-Dproc_namenode
> -Xmx1000m
> -Djava.net.preferIPv4Stack=true
> -Xmx128m
> -Xmx128m
> -Dhadoop.log.dir=/home/nn2/logs
> -Dhadoop.log.file=hadoop-root-namenode-HOST-xx-xx-xx-105.log
> -Dhadoop.home.dir=/home/nn2/
> -Dhadoop.id.str=root
> -Dhadoop.root.logger=INFO,RFA
> -Dhadoop.policy.file=hadoop-policy.xml
> -Djava.net.preferIPv4Stack=true
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS
> -Dhdfs.audit.logger=INFO,NullAppender
> -Dhadoop.security.logger=INFO,RFAS{noformat}
>
> In above VM argumants -Xmx1000m will be Overridden by -Xmx128m.
> BTW Other duplicate arguments wont harm
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira