You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Pedro Costa <ps...@gmail.com> on 2011/02/15 16:11:37 UTC

reduce input is compressed?

Hi,

When the compression in on, the compressed map intermediate files are
transfered to the reduce side as compressed data?

Thanks,

-- 
Pedro

Re: reduce input is compressed?

Posted by Harsh J <qw...@gmail.com>.

Hello,

On Tue, Feb 15, 2011 at 8:41 PM, Pedro Costa <ps...@gmail.com> wrote:
> Hi,
>
> When the compression in on, the compressed map intermediate files are
> transfered to the reduce side as compressed data?

Yes. The compression's role here primarily intends to reduce the data
transfer time over the network.

-- 
Harsh J
www.harshj.com