You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Ana Gillan <an...@gmail.com> on 2014/08/06 12:57:02 UTC
YARN Application Master Question
Hi,
In the documentation and papers about Apache YARN, they say that an
Application Master is launched for every application and it is this that
manages resources and scheduling for applications on Hadoop.
For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
each job)?
Thanks!
Ana
Re: YARN Application Master Question
Posted by Ana Gillan <an...@gmail.com>.
Thanks very much, Mirko!
-Ana
On 6 August 2014 12:00, Mirko Kämpf <mi...@gmail.com> wrote:
> In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
> Giraph job.
> Makes a total of 5 AMs.
>
> Cheers,
> Mirko
>
>
>
> 2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
>
> Hi,
>>
>> In the documentation and papers about Apache YARN, they say that an
>> Application Master is launched for every application and it is this that
>> manages resources and scheduling for applications on Hadoop.
>>
>> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
>> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
>> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
>> each job)?
>>
>> Thanks!
>> Ana
>>
>
>
Re: YARN Application Master Question
Posted by Ana Gillan <an...@gmail.com>.
Thanks very much, Mirko!
-Ana
On 6 August 2014 12:00, Mirko Kämpf <mi...@gmail.com> wrote:
> In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
> Giraph job.
> Makes a total of 5 AMs.
>
> Cheers,
> Mirko
>
>
>
> 2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
>
> Hi,
>>
>> In the documentation and papers about Apache YARN, they say that an
>> Application Master is launched for every application and it is this that
>> manages resources and scheduling for applications on Hadoop.
>>
>> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
>> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
>> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
>> each job)?
>>
>> Thanks!
>> Ana
>>
>
>
Re: YARN Application Master Question
Posted by Ana Gillan <an...@gmail.com>.
Thanks very much, Mirko!
-Ana
On 6 August 2014 12:00, Mirko Kämpf <mi...@gmail.com> wrote:
> In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
> Giraph job.
> Makes a total of 5 AMs.
>
> Cheers,
> Mirko
>
>
>
> 2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
>
> Hi,
>>
>> In the documentation and papers about Apache YARN, they say that an
>> Application Master is launched for every application and it is this that
>> manages resources and scheduling for applications on Hadoop.
>>
>> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
>> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
>> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
>> each job)?
>>
>> Thanks!
>> Ana
>>
>
>
Re: YARN Application Master Question
Posted by Ana Gillan <an...@gmail.com>.
Thanks very much, Mirko!
-Ana
On 6 August 2014 12:00, Mirko Kämpf <mi...@gmail.com> wrote:
> In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
> Giraph job.
> Makes a total of 5 AMs.
>
> Cheers,
> Mirko
>
>
>
> 2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
>
> Hi,
>>
>> In the documentation and papers about Apache YARN, they say that an
>> Application Master is launched for every application and it is this that
>> manages resources and scheduling for applications on Hadoop.
>>
>> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
>> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
>> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
>> each job)?
>>
>> Thanks!
>> Ana
>>
>
>
Re: YARN Application Master Question
Posted by Mirko Kämpf <mi...@gmail.com>.
In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
Giraph job.
Makes a total of 5 AMs.
Cheers,
Mirko
2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
> Hi,
>
> In the documentation and papers about Apache YARN, they say that an
> Application Master is launched for every application and it is this that
> manages resources and scheduling for applications on Hadoop.
>
> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
> each job)?
>
> Thanks!
> Ana
>
Re: YARN Application Master Question
Posted by Mirko Kämpf <mi...@gmail.com>.
In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
Giraph job.
Makes a total of 5 AMs.
Cheers,
Mirko
2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
> Hi,
>
> In the documentation and papers about Apache YARN, they say that an
> Application Master is launched for every application and it is this that
> manages resources and scheduling for applications on Hadoop.
>
> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
> each job)?
>
> Thanks!
> Ana
>
Re: YARN Application Master Question
Posted by Mirko Kämpf <mi...@gmail.com>.
In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
Giraph job.
Makes a total of 5 AMs.
Cheers,
Mirko
2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
> Hi,
>
> In the documentation and papers about Apache YARN, they say that an
> Application Master is launched for every application and it is this that
> manages resources and scheduling for applications on Hadoop.
>
> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
> each job)?
>
> Thanks!
> Ana
>
Re: YARN Application Master Question
Posted by Mirko Kämpf <mi...@gmail.com>.
In this case you would have 3 AM for MR jobs and 2 more AMs, one for each
Giraph job.
Makes a total of 5 AMs.
Cheers,
Mirko
2014-08-06 11:57 GMT+01:00 Ana Gillan <an...@gmail.com>:
> Hi,
>
> In the documentation and papers about Apache YARN, they say that an
> Application Master is launched for every application and it is this that
> manages resources and scheduling for applications on Hadoop.
>
> For example, if you submit 3 MapReduce jobs, and 2 Giraph jobs to your
> cluster, does the Resource Manager spawn 2 AMs (one to manage all MapReduce
> jobs and one to manage all Giraph jobs) or does it spawn 5 AMs (one for
> each job)?
>
> Thanks!
> Ana
>