You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/10/18 09:06:31 UTC
issure about different heapsize on namenode and datanode
hi,all:
what i want is allocate different heap size to namenode and datanode
,so i add the following info in hadoop-env.sh file
export HADOOP_NAMENODE_OPTS="-Xmx2048m"
but, i am very confuse about the output of ps , here is two -Xmx option
value ,i do not know which is the real heap size that the namenode
use,anyone can help?
# ps -ef|grep namenode
hdfs 14468 1 36 15:00 ? 00:00:05
/usr/java/jdk1.6.0_35/bin/java -Dproc_namenode
-Xmx1000m-Dhadoop.log.dir=/var/log/hadoop-hdfs
-Dhadoop.log.file=hadoop-hdfs-namenode-CHBM220.log
-Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs
-Dhadoop.root.logger=INFO,RFA
-Djava.library.path=/usr/lib/hadoop/lib/native
-Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true
-Xmx2048m -Dhadoop.security.logger=INFO,RFAS
org.apache.hadoop.hdfs.server.namenode.NameNode
Re: issure about different heapsize on namenode and datanode
Posted by Ravi Prakash <ra...@ymail.com>.
Hi!
You can go to the JMX page: http://<namenode>:50070/jmx to find out what the Heap Memory and usage is. Yes we know that there is a problem in the scripts. I believe its being handled as part of https://issues.apache.org/jira/browse/HADOOP-9902
On Friday, October 18, 2013 2:07 AM, ch huang <ju...@gmail.com> wrote:
hi,all:
what i want is allocate different heap size to namenode and datanode ,so i add the following info in hadoop-env.sh file
export HADOOP_NAMENODE_OPTS="-Xmx2048m"
but, i am very confuse about the output of ps , here is two -Xmx option value ,i do not know which is the real heap size that the namenode use,anyone can help?
# ps -ef|grep namenode
hdfs 14468 1 36 15:00 ? 00:00:05 /usr/java/jdk1.6.0_35/bin/java -Dproc_namenode -Xmx1000m -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop-hdfs-namenode-CHBM220.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx2048m -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
Re: issure about different heapsize on namenode and datanode
Posted by Ravi Prakash <ra...@ymail.com>.
Hi!
You can go to the JMX page: http://<namenode>:50070/jmx to find out what the Heap Memory and usage is. Yes we know that there is a problem in the scripts. I believe its being handled as part of https://issues.apache.org/jira/browse/HADOOP-9902
On Friday, October 18, 2013 2:07 AM, ch huang <ju...@gmail.com> wrote:
hi,all:
what i want is allocate different heap size to namenode and datanode ,so i add the following info in hadoop-env.sh file
export HADOOP_NAMENODE_OPTS="-Xmx2048m"
but, i am very confuse about the output of ps , here is two -Xmx option value ,i do not know which is the real heap size that the namenode use,anyone can help?
# ps -ef|grep namenode
hdfs 14468 1 36 15:00 ? 00:00:05 /usr/java/jdk1.6.0_35/bin/java -Dproc_namenode -Xmx1000m -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop-hdfs-namenode-CHBM220.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx2048m -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
Re: issure about different heapsize on namenode and datanode
Posted by Ravi Prakash <ra...@ymail.com>.
Hi!
You can go to the JMX page: http://<namenode>:50070/jmx to find out what the Heap Memory and usage is. Yes we know that there is a problem in the scripts. I believe its being handled as part of https://issues.apache.org/jira/browse/HADOOP-9902
On Friday, October 18, 2013 2:07 AM, ch huang <ju...@gmail.com> wrote:
hi,all:
what i want is allocate different heap size to namenode and datanode ,so i add the following info in hadoop-env.sh file
export HADOOP_NAMENODE_OPTS="-Xmx2048m"
but, i am very confuse about the output of ps , here is two -Xmx option value ,i do not know which is the real heap size that the namenode use,anyone can help?
# ps -ef|grep namenode
hdfs 14468 1 36 15:00 ? 00:00:05 /usr/java/jdk1.6.0_35/bin/java -Dproc_namenode -Xmx1000m -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop-hdfs-namenode-CHBM220.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx2048m -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode
Re: issure about different heapsize on namenode and datanode
Posted by Ravi Prakash <ra...@ymail.com>.
Hi!
You can go to the JMX page: http://<namenode>:50070/jmx to find out what the Heap Memory and usage is. Yes we know that there is a problem in the scripts. I believe its being handled as part of https://issues.apache.org/jira/browse/HADOOP-9902
On Friday, October 18, 2013 2:07 AM, ch huang <ju...@gmail.com> wrote:
hi,all:
what i want is allocate different heap size to namenode and datanode ,so i add the following info in hadoop-env.sh file
export HADOOP_NAMENODE_OPTS="-Xmx2048m"
but, i am very confuse about the output of ps , here is two -Xmx option value ,i do not know which is the real heap size that the namenode use,anyone can help?
# ps -ef|grep namenode
hdfs 14468 1 36 15:00 ? 00:00:05 /usr/java/jdk1.6.0_35/bin/java -Dproc_namenode -Xmx1000m -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop-hdfs-namenode-CHBM220.log -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/usr/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx2048m -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode