You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by Ahmad Shahzad <as...@gmail.com> on 2010/04/25 04:01:18 UTC

issue regarding shuffle process in hadoop mapreduce

Hey All,
           Can anyone tell me that how does the shuffle process that happens
after the mapping task takes place. Is it the responsibility of mappers to
push data to the reducers or is it the responsibility of task trackers to
shuffle the data to the reducers. And which communication protocol does
shuffle process use to shuffle.

Regards,
Ahmad Shahzad

issue regarding shuffle process in hadoop mapreduce

Posted by Ahmad Shahzad <as...@gmail.com>.

Hey All,
           Can anyone tell me that how does the shuffle process that happens
after the mapping task takes place. Is it the responsibility of mappers to
push data to the reducers or is it the responsibility of task trackers to
shuffle the data to the reducers. And which communication protocol does
shuffle process use to shuffle.

Regards,
Ahmad Shahzad