You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by 杨浩 <ya...@gmail.com> on 2015/04/09 08:56:45 UTC
Questions about RMContainerAllocator
Hi
I'm doing some research on MRv2. It would be very helpful for you to
answer this question.
As RMContainerAllocator allocates resource for MRv2 job. The state of task
is pending, scheduled, assigned, completed. When task transfers from
assigned to completed queue? I think when NM tells RM that a container
finishes, and MRAM sends a heartbeat to RM, RM tells the MRAM that the
container finishes, then the task of the container transfers from assigned
to completed. Am I right
Re: Questions about RMContainerAllocator
Posted by 杨浩 <ya...@gmail.com>.
Hi， Pavi
thanks for your reply. I have already known the state diagram, but the
state of MapReduce is different from state in RMContainerAllocator.
2015-04-10 14:00 GMT+08:00 Ravi Prakash <ra...@ymail.com>:
> Hi Yang Hao!
>
> You should be able to find all these transitions in code. It can be
> easier to understand with state diagrams you can produce yourself from
> the source code (Thanks to great work in MAPREDUCE-2930):
> 1. Run mvn -Pvisualize compile
> 2. dot -Tpng NodeManager.gv > NodeManager.png; dot -Tpng
> ResourceManager.gv > ResourceManager.png; dot -Tpng MapReduce.gv >
> MapReduce.png;
>
> HTH
> Ravi
>
> On 04/08/15 23:56, 杨浩 wrote:
> > Hi
> > I'm doing some research on MRv2. It would be very helpful for you to
> > answer this question.
> >
> > As RMContainerAllocator allocates resource for MRv2 job. The state of
> task
> > is pending, scheduled, assigned, completed. When task transfers from
> > assigned to completed queue? I think when NM tells RM that a container
> > finishes, and MRAM sends a heartbeat to RM, RM tells the MRAM that the
> > container finishes, then the task of the container transfers from
> assigned
> > to completed. Am I right
> >
>
>
>
Re: Questions about RMContainerAllocator
Posted by Ravi Prakash <ra...@ymail.com>.
Hi Yang Hao!
You should be able to find all these transitions in code. It can be
easier to understand with state diagrams you can produce yourself from
the source code (Thanks to great work in MAPREDUCE-2930):
1. Run mvn -Pvisualize compile
2. dot -Tpng NodeManager.gv > NodeManager.png; dot -Tpng
ResourceManager.gv > ResourceManager.png; dot -Tpng MapReduce.gv >
MapReduce.png;
HTH
Ravi
On 04/08/15 23:56, 杨浩 wrote:
> Hi
> I'm doing some research on MRv2. It would be very helpful for you to
> answer this question.
>
> As RMContainerAllocator allocates resource for MRv2 job. The state of task
> is pending, scheduled, assigned, completed. When task transfers from
> assigned to completed queue? I think when NM tells RM that a container
> finishes, and MRAM sends a heartbeat to RM, RM tells the MRAM that the
> container finishes, then the task of the container transfers from assigned
> to completed. Am I right
>