You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Vibhooti Verma <ve...@gmail.com> on 2008/04/16 15:14:45 UTC

Two output reduce for the same map

Can we configure two(multiple) reduce for the same map, so that all key val
collected by one map goes to both and processing can be done on both
reduces. Idea is to do some different processing on same intermediate
key-value pair and write to two different files.
Or can we configure two output collectors so that we can write on two
different files?


Please reply if you  know about any of them.
-- 
Thanks,
Vibhooti

Re: Two output reduce for the same map

Posted by Amar Kamat <am...@yahoo-inc.com>.

Earlier someone asked a similar question. See 
http://mail-archives.apache.org/mod_mbox/hadoop-core-user/200804.mbox/%3c4805AA5B.7010704@yahoo-inc.com%3e 
for the reply.
I dont think that the framework directly supports this.
Amar
Vibhooti Verma wrote:
> Can we configure two(multiple) reduce for the same map, so that all key val
> collected by one map goes to both and processing can be done on both
> reduces. Idea is to do some different processing on same intermediate
> key-value pair and write to two different files.
> Or can we configure two output collectors so that we can write on two
> different files?
>
>
> Please reply if you  know about any of them.
>