You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Zhudacai <zh...@hisilicon.com> on 2015/09/19 10:42:22 UTC
issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
But the ratio between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Jean-Eric CAZAMEA <je...@yahoo.com>.
unsubscribe
On Saturday, September 19, 2015 10:42 AM, Zhudacai <zh...@hisilicon.com> wrote:
<!--#yiv7661362184 _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7661362184 {font-family:"Cambria Math";panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7661362184 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7661362184 #yiv7661362184 p.yiv7661362184MsoNormal, #yiv7661362184 li.yiv7661362184MsoNormal, #yiv7661362184 div.yiv7661362184MsoNormal {margin:0cm;margin-bottom:.0001pt;text-align:justify;text-justify:inter-ideograph;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 a:link, #yiv7661362184 span.yiv7661362184MsoHyperlink {color:blue;text-decoration:underline;}#yiv7661362184 a:visited, #yiv7661362184 span.yiv7661362184MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7661362184 p.yiv7661362184MsoPlainText, #yiv7661362184 li.yiv7661362184MsoPlainText, #yiv7661362184 div.yiv7661362184MsoPlainText {margin:0cm;margin-bottom:.0001pt;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 span.yiv7661362184EmailStyle17 {font-family:"Calibri", "sans-serif";color:windowtext;}#yiv7661362184 span.yiv7661362184Char {font-family:"Calibri", "sans-serif";}#yiv7661362184 .yiv7661362184MsoChpDefault {}#yiv7661362184 _filtered #yiv7661362184 {margin:72.0pt 90.0pt 72.0pt 90.0pt;}#yiv7661362184 div.yiv7661362184WordSection1 {}-->Hi,ALL We get a problem about enable UseNUMA flag for my hadoop framework. We've tried to specify JVM flags during hadoop daemon's starts, e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS", export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. But the ratio between local and remote memory access is 2:1, just remains as same as before. Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter. What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it? The hadoop version is 2.6.0. Best Regards. Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by "Grant Overby (groverby)" <gr...@cisco.com>.
UseNUMA isn't supported by all garbage collectors.
CMS is not supported
G1 is supported
Not sure about others
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]
Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<ma...@cisco.com>
Mobile: 865 724 4910
[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.
From: Zhudacai <zh...@hisilicon.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Saturday, September 19, 2015 at 4:42 AM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>, "general@hadoop.apache.org<ma...@hadoop.apache.org>" <ge...@hadoop.apache.org>>, "common-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <co...@hadoop.apache.org>>, "yarn-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <ya...@hadoop.apache.org>>, "mapreduce-issues@hadoop.apache.org<ma...@hadoop.apache.org>." <ma...@hadoop.apache.org>>
Cc: "dongbo (E)" <do...@huawei.com>>, Zhanweitao <zh...@hisilicon.com>>
Subject: issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
But the ratio between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Shashikiran Bhat <sh...@gmail.com>.
Ko o,
On Sep 19, 2015 2:12 PM, "Zhudacai" <zh...@hisilicon.com> wrote:
> Hi,ALL
>
>
>
> We get a problem about enable UseNUMA flag for my hadoop framework.
>
>
>
> We've tried to specify JVM flags during hadoop daemon's starts,
>
> e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
>
> export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
>
> But the ratio between local and remote memory access is 2:1, just remains
> as same as before.
>
>
>
> Then we find that hadoop MapReduce start child JVM processes to run task
> in containers. So we passes -XX:+UseNUMA to JVMs by set theting
> configuration parameter child.java.opts. But hadoop starts to throw
> ExitCodeExceptionException (exitCode=1), seems that hadoop does not support
> this JVM parameter.
>
>
>
> What should we do to enable UseNUMA flag for my hadoop? Or what should we
> do to decrease the local/remote memory access in NUMA framework? Should we
> just change Hadoop script or resorts to source code? And how to do it?
>
>
>
> The hadoop version is 2.6.0.
>
>
>
> Best Regards.
>
>
>
> Dacai
>
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Shashikiran Bhat <sh...@gmail.com>.
Ko o,
On Sep 19, 2015 2:12 PM, "Zhudacai" <zh...@hisilicon.com> wrote:
> Hi,ALL
>
>
>
> We get a problem about enable UseNUMA flag for my hadoop framework.
>
>
>
> We've tried to specify JVM flags during hadoop daemon's starts,
>
> e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
>
> export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
>
> But the ratio between local and remote memory access is 2:1, just remains
> as same as before.
>
>
>
> Then we find that hadoop MapReduce start child JVM processes to run task
> in containers. So we passes -XX:+UseNUMA to JVMs by set theting
> configuration parameter child.java.opts. But hadoop starts to throw
> ExitCodeExceptionException (exitCode=1), seems that hadoop does not support
> this JVM parameter.
>
>
>
> What should we do to enable UseNUMA flag for my hadoop? Or what should we
> do to decrease the local/remote memory access in NUMA framework? Should we
> just change Hadoop script or resorts to source code? And how to do it?
>
>
>
> The hadoop version is 2.6.0.
>
>
>
> Best Regards.
>
>
>
> Dacai
>
Re: issue about enable UseNUMA flag in hadoop framework
Posted by "Grant Overby (groverby)" <gr...@cisco.com>.
UseNUMA isn't supported by all garbage collectors.
CMS is not supported
G1 is supported
Not sure about others
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]
Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<ma...@cisco.com>
Mobile: 865 724 4910
[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.
From: Zhudacai <zh...@hisilicon.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Saturday, September 19, 2015 at 4:42 AM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>, "general@hadoop.apache.org<ma...@hadoop.apache.org>" <ge...@hadoop.apache.org>>, "common-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <co...@hadoop.apache.org>>, "yarn-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <ya...@hadoop.apache.org>>, "mapreduce-issues@hadoop.apache.org<ma...@hadoop.apache.org>." <ma...@hadoop.apache.org>>
Cc: "dongbo (E)" <do...@huawei.com>>, Zhanweitao <zh...@hisilicon.com>>
Subject: issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
But the ratio between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Shashikiran Bhat <sh...@gmail.com>.
Ko o,
On Sep 19, 2015 2:12 PM, "Zhudacai" <zh...@hisilicon.com> wrote:
> Hi,ALL
>
>
>
> We get a problem about enable UseNUMA flag for my hadoop framework.
>
>
>
> We've tried to specify JVM flags during hadoop daemon's starts,
>
> e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
>
> export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
>
> But the ratio between local and remote memory access is 2:1, just remains
> as same as before.
>
>
>
> Then we find that hadoop MapReduce start child JVM processes to run task
> in containers. So we passes -XX:+UseNUMA to JVMs by set theting
> configuration parameter child.java.opts. But hadoop starts to throw
> ExitCodeExceptionException (exitCode=1), seems that hadoop does not support
> this JVM parameter.
>
>
>
> What should we do to enable UseNUMA flag for my hadoop? Or what should we
> do to decrease the local/remote memory access in NUMA framework? Should we
> just change Hadoop script or resorts to source code? And how to do it?
>
>
>
> The hadoop version is 2.6.0.
>
>
>
> Best Regards.
>
>
>
> Dacai
>
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Shashikiran Bhat <sh...@gmail.com>.
Ko o,
On Sep 19, 2015 2:12 PM, "Zhudacai" <zh...@hisilicon.com> wrote:
> Hi,ALL
>
>
>
> We get a problem about enable UseNUMA flag for my hadoop framework.
>
>
>
> We've tried to specify JVM flags during hadoop daemon's starts,
>
> e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
>
> export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA
> -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
>
> But the ratio between local and remote memory access is 2:1, just remains
> as same as before.
>
>
>
> Then we find that hadoop MapReduce start child JVM processes to run task
> in containers. So we passes -XX:+UseNUMA to JVMs by set theting
> configuration parameter child.java.opts. But hadoop starts to throw
> ExitCodeExceptionException (exitCode=1), seems that hadoop does not support
> this JVM parameter.
>
>
>
> What should we do to enable UseNUMA flag for my hadoop? Or what should we
> do to decrease the local/remote memory access in NUMA framework? Should we
> just change Hadoop script or resorts to source code? And how to do it?
>
>
>
> The hadoop version is 2.6.0.
>
>
>
> Best Regards.
>
>
>
> Dacai
>
Re: issue about enable UseNUMA flag in hadoop framework
Posted by "Grant Overby (groverby)" <gr...@cisco.com>.
UseNUMA isn't supported by all garbage collectors.
CMS is not supported
G1 is supported
Not sure about others
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]
Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<ma...@cisco.com>
Mobile: 865 724 4910
[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.
From: Zhudacai <zh...@hisilicon.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Saturday, September 19, 2015 at 4:42 AM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>, "general@hadoop.apache.org<ma...@hadoop.apache.org>" <ge...@hadoop.apache.org>>, "common-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <co...@hadoop.apache.org>>, "yarn-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <ya...@hadoop.apache.org>>, "mapreduce-issues@hadoop.apache.org<ma...@hadoop.apache.org>." <ma...@hadoop.apache.org>>
Cc: "dongbo (E)" <do...@huawei.com>>, Zhanweitao <zh...@hisilicon.com>>
Subject: issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
But the ratio between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Jean-Eric CAZAMEA <je...@yahoo.com>.
unsubscribe
On Saturday, September 19, 2015 10:42 AM, Zhudacai <zh...@hisilicon.com> wrote:
<!--#yiv7661362184 _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7661362184 {font-family:"Cambria Math";panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7661362184 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7661362184 #yiv7661362184 p.yiv7661362184MsoNormal, #yiv7661362184 li.yiv7661362184MsoNormal, #yiv7661362184 div.yiv7661362184MsoNormal {margin:0cm;margin-bottom:.0001pt;text-align:justify;text-justify:inter-ideograph;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 a:link, #yiv7661362184 span.yiv7661362184MsoHyperlink {color:blue;text-decoration:underline;}#yiv7661362184 a:visited, #yiv7661362184 span.yiv7661362184MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7661362184 p.yiv7661362184MsoPlainText, #yiv7661362184 li.yiv7661362184MsoPlainText, #yiv7661362184 div.yiv7661362184MsoPlainText {margin:0cm;margin-bottom:.0001pt;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 span.yiv7661362184EmailStyle17 {font-family:"Calibri", "sans-serif";color:windowtext;}#yiv7661362184 span.yiv7661362184Char {font-family:"Calibri", "sans-serif";}#yiv7661362184 .yiv7661362184MsoChpDefault {}#yiv7661362184 _filtered #yiv7661362184 {margin:72.0pt 90.0pt 72.0pt 90.0pt;}#yiv7661362184 div.yiv7661362184WordSection1 {}-->Hi,ALL We get a problem about enable UseNUMA flag for my hadoop framework. We've tried to specify JVM flags during hadoop daemon's starts, e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS", export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. But the ratio between local and remote memory access is 2:1, just remains as same as before. Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter. What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it? The hadoop version is 2.6.0. Best Regards. Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Jean-Eric CAZAMEA <je...@yahoo.com>.
unsubscribe
On Saturday, September 19, 2015 10:42 AM, Zhudacai <zh...@hisilicon.com> wrote:
<!--#yiv7661362184 _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7661362184 {font-family:"Cambria Math";panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7661362184 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7661362184 #yiv7661362184 p.yiv7661362184MsoNormal, #yiv7661362184 li.yiv7661362184MsoNormal, #yiv7661362184 div.yiv7661362184MsoNormal {margin:0cm;margin-bottom:.0001pt;text-align:justify;text-justify:inter-ideograph;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 a:link, #yiv7661362184 span.yiv7661362184MsoHyperlink {color:blue;text-decoration:underline;}#yiv7661362184 a:visited, #yiv7661362184 span.yiv7661362184MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7661362184 p.yiv7661362184MsoPlainText, #yiv7661362184 li.yiv7661362184MsoPlainText, #yiv7661362184 div.yiv7661362184MsoPlainText {margin:0cm;margin-bottom:.0001pt;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 span.yiv7661362184EmailStyle17 {font-family:"Calibri", "sans-serif";color:windowtext;}#yiv7661362184 span.yiv7661362184Char {font-family:"Calibri", "sans-serif";}#yiv7661362184 .yiv7661362184MsoChpDefault {}#yiv7661362184 _filtered #yiv7661362184 {margin:72.0pt 90.0pt 72.0pt 90.0pt;}#yiv7661362184 div.yiv7661362184WordSection1 {}-->Hi,ALL We get a problem about enable UseNUMA flag for my hadoop framework. We've tried to specify JVM flags during hadoop daemon's starts, e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS", export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. But the ratio between local and remote memory access is 2:1, just remains as same as before. Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter. What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it? The hadoop version is 2.6.0. Best Regards. Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by Jean-Eric CAZAMEA <je...@yahoo.com>.
unsubscribe
On Saturday, September 19, 2015 10:42 AM, Zhudacai <zh...@hisilicon.com> wrote:
<!--#yiv7661362184 _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;} _filtered #yiv7661362184 {font-family:"Cambria Math";panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv7661362184 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv7661362184 {panose-1:2 1 6 0 3 1 1 1 1 1;}#yiv7661362184 #yiv7661362184 p.yiv7661362184MsoNormal, #yiv7661362184 li.yiv7661362184MsoNormal, #yiv7661362184 div.yiv7661362184MsoNormal {margin:0cm;margin-bottom:.0001pt;text-align:justify;text-justify:inter-ideograph;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 a:link, #yiv7661362184 span.yiv7661362184MsoHyperlink {color:blue;text-decoration:underline;}#yiv7661362184 a:visited, #yiv7661362184 span.yiv7661362184MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv7661362184 p.yiv7661362184MsoPlainText, #yiv7661362184 li.yiv7661362184MsoPlainText, #yiv7661362184 div.yiv7661362184MsoPlainText {margin:0cm;margin-bottom:.0001pt;font-size:10.5pt;font-family:"Calibri", "sans-serif";}#yiv7661362184 span.yiv7661362184EmailStyle17 {font-family:"Calibri", "sans-serif";color:windowtext;}#yiv7661362184 span.yiv7661362184Char {font-family:"Calibri", "sans-serif";}#yiv7661362184 .yiv7661362184MsoChpDefault {}#yiv7661362184 _filtered #yiv7661362184 {margin:72.0pt 90.0pt 72.0pt 90.0pt;}#yiv7661362184 div.yiv7661362184WordSection1 {}-->Hi,ALL We get a problem about enable UseNUMA flag for my hadoop framework. We've tried to specify JVM flags during hadoop daemon's starts, e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS", export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc. But the ratio between local and remote memory access is 2:1, just remains as same as before. Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter. What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it? The hadoop version is 2.6.0. Best Regards. Dacai
Re: issue about enable UseNUMA flag in hadoop framework
Posted by "Grant Overby (groverby)" <gr...@cisco.com>.
UseNUMA isn't supported by all garbage collectors.
CMS is not supported
G1 is supported
Not sure about others
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]
Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<ma...@cisco.com>
Mobile: 865 724 4910
[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.
This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.
Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.
From: Zhudacai <zh...@hisilicon.com>>
Reply-To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>
Date: Saturday, September 19, 2015 at 4:42 AM
To: "user@hadoop.apache.org<ma...@hadoop.apache.org>" <us...@hadoop.apache.org>>, "general@hadoop.apache.org<ma...@hadoop.apache.org>" <ge...@hadoop.apache.org>>, "common-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <co...@hadoop.apache.org>>, "yarn-issues@hadoop.apache.org<ma...@hadoop.apache.org>" <ya...@hadoop.apache.org>>, "mapreduce-issues@hadoop.apache.org<ma...@hadoop.apache.org>." <ma...@hadoop.apache.org>>
Cc: "dongbo (E)" <do...@huawei.com>>, Zhanweitao <zh...@hisilicon.com>>
Subject: issue about enable UseNUMA flag in hadoop framework
Hi,ALL
We get a problem about enable UseNUMA flag for my hadoop framework.
We've tried to specify JVM flags during hadoop daemon's starts,
e.g. export HADOOP_NAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_NAMENODE_OPTS",
export HADOOP_SECONDARYNAMENODE_OPTS="-XX:+UseNUMA -Dcom.sun.management.jmxremote $HADOOP_SECONDARYNAMENODE_OPTS", etc.
But the ratio between local and remote memory access is 2:1, just remains as same as before.
Then we find that hadoop MapReduce start child JVM processes to run task in containers. So we passes -XX:+UseNUMA to JVMs by set theting configuration parameter child.java.opts. But hadoop starts to throw ExitCodeExceptionException (exitCode=1), seems that hadoop does not support this JVM parameter.
What should we do to enable UseNUMA flag for my hadoop? Or what should we do to decrease the local/remote memory access in NUMA framework? Should we just change Hadoop script or resorts to source code? And how to do it?
The hadoop version is 2.6.0.
Best Regards.
Dacai