You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by hadoop anis <ha...@gmail.com> on 2011/12/22 07:14:11 UTC
Information regarding completed MapTask
Hi, I want to know where has information regarding completed MapTask been
stored?
i.e. how reduce task know about completed map output data is available on
which tasktracker?
please let me know this.
--
Regards,
Anis
Student MTech (Comp.Sci. & Engg)
Re: Information regarding completed MapTask
Posted by hadoop anis <ha...@gmail.com>.
Thanks a lot Sir, it worked.
On Tue, Dec 27, 2011 at 9:47 PM, Arun C Murthy <ac...@hortonworks.com> wrote:
> The reduces get it from the JobTracker. Take a look at
> TaskCompletionEvents.java.
>
> Arun
>
> On Dec 27, 2011, at 1:26 AM, hadoop anis wrote:
>
>
>
> Friends,
>
> I want to know where does information regarding completed MapTask get
> stored?
> i.e. how reduce task know about completed map output data is available on
> which tasktracker?
> what data structure gets maintained to track for the map output data?
>
> If anyone know this please let me know.
>
> --
> Regards,
>
> Anis
> Student MTech (Comp.Sci. & Engg)
>
>
>
>
>
>
>
--
Regards,
Anis
Student MTech (Comp.Sci. & Engg)
Re: Information regarding completed MapTask
Posted by Arun C Murthy <ac...@hortonworks.com>.
The reduces get it from the JobTracker. Take a look at TaskCompletionEvents.java.
Arun
On Dec 27, 2011, at 1:26 AM, hadoop anis wrote:
>
>
> Friends,
>
> I want to know where does information regarding completed MapTask get stored?
> i.e. how reduce task know about completed map output data is available on which tasktracker?
> what data structure gets maintained to track for the map output data?
>
> If anyone know this please let me know.
>
> --
> Regards,
>
> Anis
> Student MTech (Comp.Sci. & Engg)
>
>
>
>
>
Information regarding completed MapTask
Posted by hadoop anis <ha...@gmail.com>.
Friends,
I want to know where does information regarding completed MapTask get
stored?
i.e. how reduce task know about completed map output data is available on
which tasktracker?
what data structure gets maintained to track for the map output data?
If anyone know this please let me know.
--
Regards,
Anis
Student MTech (Comp.Sci. & Engg)