You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by hadoop anis <ha...@gmail.com> on 2011/12/13 09:59:58 UTC
How Jobtracler stores tasktracker's information
Anyone please tell this,
I want to know from where Jobtracker sends task(taskid) to
tasktarcker for scheduling.
i.e where it creates taskid & tasktracker pairs
Thanks & Regards,
Mohmmadanis Moulavi
Student,
MTech (Computer Sci. & Engg.)
Walchand college of Engg. Sangli (M.S.) India
Re: How Jobtracler stores tasktracker's information
Posted by Arun C Murthy <ac...@hortonworks.com>.
Moving to mapreduce-user@, bcc common-user@. Please use project specific lists.
Take a look at JobTracker.heartbeat -> *Scheduler.assignTasks.
After the scheduler 'assigns' tasks, the JT sends the corresponding 'LaunchTaskAction' to the TaskTracker.
hth,
Arun
On Dec 13, 2011, at 12:59 AM, hadoop anis wrote:
> Anyone please tell this,
> I want to know from where Jobtracker sends task(taskid) to
> tasktarcker for scheduling.
> i.e where it creates taskid & tasktracker pairs
>
>
>
> Thanks & Regards,
>
> Mohmmadanis Moulavi
>
> Student,
> MTech (Computer Sci. & Engg.)
> Walchand college of Engg. Sangli (M.S.) India
Re: How Jobtracler stores tasktracker's information
Posted by Arun C Murthy <ac...@hortonworks.com>.
Moving to mapreduce-user@, bcc common-user@. Please use project specific lists.
Take a look at JobTracker.heartbeat -> *Scheduler.assignTasks.
After the scheduler 'assigns' tasks, the JT sends the corresponding 'LaunchTaskAction' to the TaskTracker.
hth,
Arun
On Dec 13, 2011, at 12:59 AM, hadoop anis wrote:
> Anyone please tell this,
> I want to know from where Jobtracker sends task(taskid) to
> tasktarcker for scheduling.
> i.e where it creates taskid & tasktracker pairs
>
>
>
> Thanks & Regards,
>
> Mohmmadanis Moulavi
>
> Student,
> MTech (Computer Sci. & Engg.)
> Walchand college of Engg. Sangli (M.S.) India
Re: How Jobtracler stores tasktracker's information
Posted by Robert Evans <ev...@yahoo-inc.com>.
I am not completely sure what you mean by this. In Hadoop the TaskTracker will heartbeat into the JobTracker to report its status and get new tasks to launch. The Scheduler, which is pluggable, then matches up requests for tasks with the TaskTracker. If you want to see where the matching up of tasks to task trackers takes place you should look at the schedulers. There are two main ones in use by hadoop. They are the Capacity Scheduler and the Fair Scheduler. You should be able to find them under contrib.
--
Bobby Evans
On 12/13/11 3:02 AM, "hadoop anis" <ha...@gmail.com> wrote:
Anyone please tell this,
I want to know from where Jobtracker sends task(taskid) to
tasktarcker for scheduling.
i.e where it creates taskid & tasktracker pairs
Thanks & Regards,
Mohmmadanis Moulavi
Student,
MTech (Computer Sci. & Engg.)
Walchand college of Engg. Sangli (M.S.) India
How Jobtracler stores tasktracker's information
Posted by hadoop anis <ha...@gmail.com>.
Anyone please tell this,
I want to know from where Jobtracker sends task(taskid) to
tasktarcker for scheduling.
i.e where it creates taskid & tasktracker pairs
Thanks & Regards,
Mohmmadanis Moulavi
Student,
MTech (Computer Sci. & Engg.)
Walchand college of Engg. Sangli (M.S.) India