How do I make sure my map output of pig script in lzo compressed?

[unionx <un...@foxmail.com>]

I have set up hadoop-lzo and elephant-bird, and I see them well loaded before the job, and the pig scripts can handle lzo files.


The question is, how do I know they have worked? If there is some way to see the map output? I just want to know the map output has been compressed.

Re: How do I make sure my map output of pig script in lzo compressed?

[Prashant Kommireddi <pr...@gmail.com>]

Check the Job Counters for "Map Output bytes" before and after setting
compression.

On Mon, Jun 18, 2012 at 7:47 PM, unionx <un...@foxmail.com> wrote:

> I have set up hadoop-lzo and elephant-bird, and I see them well loaded
> before the job, and the pig scripts can handle lzo files.
>
>
> The question is, how do I know they have worked? If there is some way to
> see the map output? I just want to know the map output has been compressed.