You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Viswanathan J <ja...@gmail.com> on 2013/10/11 18:58:34 UTC
Hadoop Jobtracker cluster summary of heap size and OOME
Hi,
I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
nodes.
Have set the jobtracker default memory size in hadoop-env.sh
*HADOOP_HEAPSIZE="1024"*
*
*
Have set the mapred.child.java.opts value in mapred-site.xml as,
<property>
<name>mapred.child.java.opts</name>
<value>-Xmx2048m</value>
--
Regards,
Viswa.J
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Pabale Vikas <vi...@gmail.com>.
join the group
On Fri, Oct 11, 2013 at 10:28 PM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cdh-user+unsubscribe@cloudera.org.
> For more options, visit
> https://groups.google.com/a/cloudera.org/groups/opt_out.
>
--
Regards.
Vikas S Pabale.
+919730198004
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Pabale Vikas <vi...@gmail.com>.
join the group
On Fri, Oct 11, 2013 at 10:28 PM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cdh-user+unsubscribe@cloudera.org.
> For more options, visit
> https://groups.google.com/a/cloudera.org/groups/opt_out.
>
--
Regards.
Vikas S Pabale.
+919730198004
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Pabale Vikas <vi...@gmail.com>.
join the group
On Fri, Oct 11, 2013 at 10:28 PM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cdh-user+unsubscribe@cloudera.org.
> For more options, visit
> https://groups.google.com/a/cloudera.org/groups/opt_out.
>
--
Regards.
Vikas S Pabale.
+919730198004
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Rajesh Balamohan <ra...@gmail.com>.
JT OOM??.. Refer https://issues.apache.org/jira/browse/MAPREDUCE-5508 (but
JT OOM should happen over a period of time. Not immediately).
On Tue, Oct 15, 2013 at 7:44 AM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi Arun,
>
> Will not cross post hereafter.
>
> I had the same heap size value, same no.of jobs,scheduler and it is works
> fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
> issue in hadoop 1.2.1 version only.
>
> Even though I tried to set heap size max of 16G but it eats the whole
> memory.
>
> Thanks,
> Viswa
> On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> Please don't cross-post.
>>
>> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G
>> or more, depending on:
>> * #jobs
>> * Scheduler you use.
>>
>> Arun
>>
>> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
>> nodes.
>>
>> Have set the jobtracker default memory size in hadoop-env.sh
>>
>> *HADOOP_HEAPSIZE="1024"*
>> *
>> *
>> Have set the mapred.child.java.opts value in mapred-site.xml as,
>>
>> <property>
>> <name>mapred.child.java.opts</name>
>> <value>-Xmx2048m</value>
>>
>>
>> --
>> Regards,
>> Viswa.J
>>
>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
~Rajesh.B
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Rajesh Balamohan <ra...@gmail.com>.
JT OOM??.. Refer https://issues.apache.org/jira/browse/MAPREDUCE-5508 (but
JT OOM should happen over a period of time. Not immediately).
On Tue, Oct 15, 2013 at 7:44 AM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi Arun,
>
> Will not cross post hereafter.
>
> I had the same heap size value, same no.of jobs,scheduler and it is works
> fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
> issue in hadoop 1.2.1 version only.
>
> Even though I tried to set heap size max of 16G but it eats the whole
> memory.
>
> Thanks,
> Viswa
> On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> Please don't cross-post.
>>
>> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G
>> or more, depending on:
>> * #jobs
>> * Scheduler you use.
>>
>> Arun
>>
>> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
>> nodes.
>>
>> Have set the jobtracker default memory size in hadoop-env.sh
>>
>> *HADOOP_HEAPSIZE="1024"*
>> *
>> *
>> Have set the mapred.child.java.opts value in mapred-site.xml as,
>>
>> <property>
>> <name>mapred.child.java.opts</name>
>> <value>-Xmx2048m</value>
>>
>>
>> --
>> Regards,
>> Viswa.J
>>
>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
~Rajesh.B
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Rajesh Balamohan <ra...@gmail.com>.
JT OOM??.. Refer https://issues.apache.org/jira/browse/MAPREDUCE-5508 (but
JT OOM should happen over a period of time. Not immediately).
On Tue, Oct 15, 2013 at 7:44 AM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi Arun,
>
> Will not cross post hereafter.
>
> I had the same heap size value, same no.of jobs,scheduler and it is works
> fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
> issue in hadoop 1.2.1 version only.
>
> Even though I tried to set heap size max of 16G but it eats the whole
> memory.
>
> Thanks,
> Viswa
> On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> Please don't cross-post.
>>
>> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G
>> or more, depending on:
>> * #jobs
>> * Scheduler you use.
>>
>> Arun
>>
>> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
>> nodes.
>>
>> Have set the jobtracker default memory size in hadoop-env.sh
>>
>> *HADOOP_HEAPSIZE="1024"*
>> *
>> *
>> Have set the mapred.child.java.opts value in mapred-site.xml as,
>>
>> <property>
>> <name>mapred.child.java.opts</name>
>> <value>-Xmx2048m</value>
>>
>>
>> --
>> Regards,
>> Viswa.J
>>
>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
~Rajesh.B
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Rajesh Balamohan <ra...@gmail.com>.
JT OOM??.. Refer https://issues.apache.org/jira/browse/MAPREDUCE-5508 (but
JT OOM should happen over a period of time. Not immediately).
On Tue, Oct 15, 2013 at 7:44 AM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi Arun,
>
> Will not cross post hereafter.
>
> I had the same heap size value, same no.of jobs,scheduler and it is works
> fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
> issue in hadoop 1.2.1 version only.
>
> Even though I tried to set heap size max of 16G but it eats the whole
> memory.
>
> Thanks,
> Viswa
> On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> Please don't cross-post.
>>
>> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G
>> or more, depending on:
>> * #jobs
>> * Scheduler you use.
>>
>> Arun
>>
>> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
>> wrote:
>>
>> Hi,
>>
>> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
>> nodes.
>>
>> Have set the jobtracker default memory size in hadoop-env.sh
>>
>> *HADOOP_HEAPSIZE="1024"*
>> *
>> *
>> Have set the mapred.child.java.opts value in mapred-site.xml as,
>>
>> <property>
>> <name>mapred.child.java.opts</name>
>> <value>-Xmx2048m</value>
>>
>>
>> --
>> Regards,
>> Viswa.J
>>
>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
~Rajesh.B
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Viswanathan J <ja...@gmail.com>.
Hi Arun,
Will not cross post hereafter.
I had the same heap size value, same no.of jobs,scheduler and it is works
fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
issue in hadoop 1.2.1 version only.
Even though I tried to set heap size max of 16G but it eats the whole
memory.
Thanks,
Viswa
On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> Please don't cross-post.
>
> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or
> more, depending on:
> * #jobs
> * Scheduler you use.
>
> Arun
>
> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
> wrote:
>
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
> *
> *
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Viswanathan J <ja...@gmail.com>.
Hi Arun,
Will not cross post hereafter.
I had the same heap size value, same no.of jobs,scheduler and it is works
fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
issue in hadoop 1.2.1 version only.
Even though I tried to set heap size max of 16G but it eats the whole
memory.
Thanks,
Viswa
On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> Please don't cross-post.
>
> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or
> more, depending on:
> * #jobs
> * Scheduler you use.
>
> Arun
>
> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
> wrote:
>
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
> *
> *
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Viswanathan J <ja...@gmail.com>.
Hi Arun,
Will not cross post hereafter.
I had the same heap size value, same no.of jobs,scheduler and it is works
fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
issue in hadoop 1.2.1 version only.
Even though I tried to set heap size max of 16G but it eats the whole
memory.
Thanks,
Viswa
On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> Please don't cross-post.
>
> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or
> more, depending on:
> * #jobs
> * Scheduler you use.
>
> Arun
>
> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
> wrote:
>
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
> *
> *
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Viswanathan J <ja...@gmail.com>.
Hi Arun,
Will not cross post hereafter.
I had the same heap size value, same no.of jobs,scheduler and it is works
fine in hadoop 1.0.4 version for 8 to 9 months, but I'm facing this JT OOME
issue in hadoop 1.2.1 version only.
Even though I tried to set heap size max of 16G but it eats the whole
memory.
Thanks,
Viswa
On Oct 15, 2013 7:30 AM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
> Please don't cross-post.
>
> HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or
> more, depending on:
> * #jobs
> * Scheduler you use.
>
> Arun
>
> On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com>
> wrote:
>
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
> *
> *
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
>
> --
> Arun C. Murthy
> Hortonworks Inc.
> http://hortonworks.com/
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Arun C Murthy <ac...@hortonworks.com>.
Please don't cross-post.
HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or more, depending on:
* #jobs
* Scheduler you use.
Arun
On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com> wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> HADOOP_HEAPSIZE="1024"
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Arun C Murthy <ac...@hortonworks.com>.
Please don't cross-post.
HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or more, depending on:
* #jobs
* Scheduler you use.
Arun
On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com> wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> HADOOP_HEAPSIZE="1024"
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Arun C Murthy <ac...@hortonworks.com>.
Please don't cross-post.
HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or more, depending on:
* #jobs
* Scheduler you use.
Arun
On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com> wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> HADOOP_HEAPSIZE="1024"
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Arun C Murthy <ac...@hortonworks.com>.
Please don't cross-post.
HADOOP_HEAPSIZE of 1024 is too low. You might want to bump it up to 16G or more, depending on:
* #jobs
* Scheduler you use.
Arun
On Oct 11, 2013, at 9:58 AM, Viswanathan J <ja...@gmail.com> wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> HADOOP_HEAPSIZE="1024"
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Hadoop Jobtracker cluster summary of heap size and OOME
Posted by Pabale Vikas <vi...@gmail.com>.
join the group
On Fri, Oct 11, 2013 at 10:28 PM, Viswanathan J
<ja...@gmail.com>wrote:
> Hi,
>
> I'm running a 14 nodes Hadoop cluster with tasktrackers running in all
> nodes.
>
> Have set the jobtracker default memory size in hadoop-env.sh
>
> *HADOOP_HEAPSIZE="1024"*
>
> Have set the mapred.child.java.opts value in mapred-site.xml as,
>
> <property>
> <name>mapred.child.java.opts</name>
> <value>-Xmx2048m</value>
>
>
> --
> Regards,
> Viswa.J
>
> --
>
> ---
> You received this message because you are subscribed to the Google Groups
> "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to cdh-user+unsubscribe@cloudera.org.
> For more options, visit
> https://groups.google.com/a/cloudera.org/groups/opt_out.
>
--
Regards.
Vikas S Pabale.
+919730198004