You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by 张茂森 <ma...@alibaba-inc.com> on 2007/06/10 01:46:40 UTC

HELP! Question about SetCompressOut

Hi all:

I have tried to compress the output data, so I use the sentence below:

TextOutputFormat.setCompressOutput(conf, true);

After I finish my hadoop job, the output data is like these:

Part-00000.deflate Part-00001.deflate

And I use the hadoop dfs command to get these data:

Hadoop dfs �Cget Part-00000.deflate ./

But I can��t open the file part-00000.deflate got on my local disk at all!
(I��ve tried gunzip and unzip command, but failed)

Would you please tell me the right way to inflate the file
part-00000.deflate? Thank you very much!

Re: HELP! Question about SetCompressOut

Posted by yu-yang chen <yy...@doc.ic.ac.uk>.

have you set the output compress class?

OutputFormatBase.setOutputCompressorClass

yu-yang

在 10 Jun 2007 00:46 時，张茂森 寫到：

> Hi all:
>
> I have tried to compress the output data, so I use the sentence below:
>
> TextOutputFormat.setCompressOutput(conf, true);
>
> After I finish my hadoop job, the output data is like these:
>
> Part-00000.deflate Part-00001.deflate
>
> And I use the hadoop dfs command to get these data:
>
> Hadoop dfs –get Part-00000.deflate ./
>
> But I can’t open the file part-00000.deflate got on my local disk  
> at all!
> (I’ve tried gunzip and unzip command, but failed)
>
> Would you please tell me the right way to inflate the file
> part-00000.deflate? Thank you very much!
>