You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/08/08 08:03:03 UTC
is RM require a lot of memory?
the yarn resource manager require a lot of memory as jobtracker?
Re: is RM require a lot of memory?
Posted by ch huang <ju...@gmail.com>.
so ,from performance aspect i need seperate RN with NN,because each of them
is memory hungry
On Fri, Aug 9, 2013 at 8:00 AM, Marcos Luis Ortiz Valmaseda <
marcosluis2186@gmail.com> wrote:
> Remember that in YARN, the two main responsibilities of the JobTracker is
> divided in two different components:
> - Resource Management by ResourceManager (this is a global component)
> - Job scheduling and monitoring by the NodeManager (this is a per-node
> component)
> - Resource negotiation and task execution by the ApplicationMaster (which
> it´s a per-application component)
>
> Said this, like any Java-based process, for YARN could be very beneficial
> to have a lot of RAM in a careful tuned JVM.
>
>
>
> 2013/8/8 ch huang <ju...@gmail.com>
>
>> the yarn resource manager require a lot of memory as jobtracker?
>
>
>
>
> --
> Marcos Ortiz Valmaseda
> Product Manager at PDVSA
> http://about.me/marcosortiz
>
>
Re: is RM require a lot of memory?
Posted by ch huang <ju...@gmail.com>.
so ,from performance aspect i need seperate RN with NN,because each of them
is memory hungry
On Fri, Aug 9, 2013 at 8:00 AM, Marcos Luis Ortiz Valmaseda <
marcosluis2186@gmail.com> wrote:
> Remember that in YARN, the two main responsibilities of the JobTracker is
> divided in two different components:
> - Resource Management by ResourceManager (this is a global component)
> - Job scheduling and monitoring by the NodeManager (this is a per-node
> component)
> - Resource negotiation and task execution by the ApplicationMaster (which
> it´s a per-application component)
>
> Said this, like any Java-based process, for YARN could be very beneficial
> to have a lot of RAM in a careful tuned JVM.
>
>
>
> 2013/8/8 ch huang <ju...@gmail.com>
>
>> the yarn resource manager require a lot of memory as jobtracker?
>
>
>
>
> --
> Marcos Ortiz Valmaseda
> Product Manager at PDVSA
> http://about.me/marcosortiz
>
>
Re: is RM require a lot of memory?
Posted by ch huang <ju...@gmail.com>.
so ,from performance aspect i need seperate RN with NN,because each of them
is memory hungry
On Fri, Aug 9, 2013 at 8:00 AM, Marcos Luis Ortiz Valmaseda <
marcosluis2186@gmail.com> wrote:
> Remember that in YARN, the two main responsibilities of the JobTracker is
> divided in two different components:
> - Resource Management by ResourceManager (this is a global component)
> - Job scheduling and monitoring by the NodeManager (this is a per-node
> component)
> - Resource negotiation and task execution by the ApplicationMaster (which
> it´s a per-application component)
>
> Said this, like any Java-based process, for YARN could be very beneficial
> to have a lot of RAM in a careful tuned JVM.
>
>
>
> 2013/8/8 ch huang <ju...@gmail.com>
>
>> the yarn resource manager require a lot of memory as jobtracker?
>
>
>
>
> --
> Marcos Ortiz Valmaseda
> Product Manager at PDVSA
> http://about.me/marcosortiz
>
>
Re: is RM require a lot of memory?
Posted by ch huang <ju...@gmail.com>.
so ,from performance aspect i need seperate RN with NN,because each of them
is memory hungry
On Fri, Aug 9, 2013 at 8:00 AM, Marcos Luis Ortiz Valmaseda <
marcosluis2186@gmail.com> wrote:
> Remember that in YARN, the two main responsibilities of the JobTracker is
> divided in two different components:
> - Resource Management by ResourceManager (this is a global component)
> - Job scheduling and monitoring by the NodeManager (this is a per-node
> component)
> - Resource negotiation and task execution by the ApplicationMaster (which
> it´s a per-application component)
>
> Said this, like any Java-based process, for YARN could be very beneficial
> to have a lot of RAM in a careful tuned JVM.
>
>
>
> 2013/8/8 ch huang <ju...@gmail.com>
>
>> the yarn resource manager require a lot of memory as jobtracker?
>
>
>
>
> --
> Marcos Ortiz Valmaseda
> Product Manager at PDVSA
> http://about.me/marcosortiz
>
>
Re: is RM require a lot of memory?
Posted by Marcos Luis Ortiz Valmaseda <ma...@gmail.com>.
Remember that in YARN, the two main responsibilities of the JobTracker is
divided in two different components:
- Resource Management by ResourceManager (this is a global component)
- Job scheduling and monitoring by the NodeManager (this is a per-node
component)
- Resource negotiation and task execution by the ApplicationMaster (which
it´s a per-application component)
Said this, like any Java-based process, for YARN could be very beneficial
to have a lot of RAM in a careful tuned JVM.
2013/8/8 ch huang <ju...@gmail.com>
> the yarn resource manager require a lot of memory as jobtracker?
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz
Re: is RM require a lot of memory?
Posted by Marcos Luis Ortiz Valmaseda <ma...@gmail.com>.
Remember that in YARN, the two main responsibilities of the JobTracker is
divided in two different components:
- Resource Management by ResourceManager (this is a global component)
- Job scheduling and monitoring by the NodeManager (this is a per-node
component)
- Resource negotiation and task execution by the ApplicationMaster (which
it´s a per-application component)
Said this, like any Java-based process, for YARN could be very beneficial
to have a lot of RAM in a careful tuned JVM.
2013/8/8 ch huang <ju...@gmail.com>
> the yarn resource manager require a lot of memory as jobtracker?
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz
Re: is RM require a lot of memory?
Posted by Marcos Luis Ortiz Valmaseda <ma...@gmail.com>.
Remember that in YARN, the two main responsibilities of the JobTracker is
divided in two different components:
- Resource Management by ResourceManager (this is a global component)
- Job scheduling and monitoring by the NodeManager (this is a per-node
component)
- Resource negotiation and task execution by the ApplicationMaster (which
it´s a per-application component)
Said this, like any Java-based process, for YARN could be very beneficial
to have a lot of RAM in a careful tuned JVM.
2013/8/8 ch huang <ju...@gmail.com>
> the yarn resource manager require a lot of memory as jobtracker?
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz
Re: is RM require a lot of memory?
Posted by Marcos Luis Ortiz Valmaseda <ma...@gmail.com>.
Remember that in YARN, the two main responsibilities of the JobTracker is
divided in two different components:
- Resource Management by ResourceManager (this is a global component)
- Job scheduling and monitoring by the NodeManager (this is a per-node
component)
- Resource negotiation and task execution by the ApplicationMaster (which
it´s a per-application component)
Said this, like any Java-based process, for YARN could be very beneficial
to have a lot of RAM in a careful tuned JVM.
2013/8/8 ch huang <ju...@gmail.com>
> the yarn resource manager require a lot of memory as jobtracker?
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz