You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by preethi ganeshan <pr...@gmail.com> on 2013/03/13 09:31:57 UTC
Keeping track of the mappers that feed a reducer
Hi,
I have to modify the Task.java class and the MapTask.java class to keep
track of the mappers that feed a reducer .How do i go about doing this ?
Regards,
Preethi
Re: Keeping track of the mappers that feed a reducer
Posted by Paul Wilkinson <pa...@gmail.com>.
Why not just materialise the mapper information into the values that are
emitted?
No need to rewrite Hadoop - just change the application code.
On 13 March 2013 08:31, preethi ganeshan <pr...@gmail.com>wrote:
> Hi,
> I have to modify the Task.java class and the MapTask.java class to keep
> track of the mappers that feed a reducer .How do i go about doing this ?
>
> Regards,
> Preethi
>
Re: Keeping track of the mappers that feed a reducer
Posted by Paul Wilkinson <pa...@gmail.com>.
Why not just materialise the mapper information into the values that are
emitted?
No need to rewrite Hadoop - just change the application code.
On 13 March 2013 08:31, preethi ganeshan <pr...@gmail.com>wrote:
> Hi,
> I have to modify the Task.java class and the MapTask.java class to keep
> track of the mappers that feed a reducer .How do i go about doing this ?
>
> Regards,
> Preethi
>
Re: Keeping track of the mappers that feed a reducer
Posted by Paul Wilkinson <pa...@gmail.com>.
Why not just materialise the mapper information into the values that are
emitted?
No need to rewrite Hadoop - just change the application code.
On 13 March 2013 08:31, preethi ganeshan <pr...@gmail.com>wrote:
> Hi,
> I have to modify the Task.java class and the MapTask.java class to keep
> track of the mappers that feed a reducer .How do i go about doing this ?
>
> Regards,
> Preethi
>
Re: Keeping track of the mappers that feed a reducer
Posted by Paul Wilkinson <pa...@gmail.com>.
Why not just materialise the mapper information into the values that are
emitted?
No need to rewrite Hadoop - just change the application code.
On 13 March 2013 08:31, preethi ganeshan <pr...@gmail.com>wrote:
> Hi,
> I have to modify the Task.java class and the MapTask.java class to keep
> track of the mappers that feed a reducer .How do i go about doing this ?
>
> Regards,
> Preethi
>