You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Vinayakumar B <vi...@huawei.com> on 2011/08/19 10:14:20 UTC
RE: Wonky reduce progress
Please check the defect in MAPREDUCE jira
https://issues.apache.org/jira/browse/MAPREDUCE-2264
This is because the compression is enabled for map outputs and statistics
are taken on compressed data instead of original data.
-----Original Message-----
From: Joey Echeverria [mailto:joey@cloudera.com]
Sent: Friday, August 19, 2011 3:07 AM
To: dev@hive.apache.org
Subject: Wonky reduce progress
I'm seeing really weird numbers in the JobTracker when monitoring jobs
launched by hives. Some jobs who above 100% completion while running
and others show less than 100% after the job completed. I tried
searching for JIRAs but didn't see any matches.
Has anyone else run into this?
-Joey
--
Joseph Echeverria
Cloudera, Inc.
443.305.9434
Re: Wonky reduce progress
Posted by Joey Echeverria <jo...@cloudera.com>.
Yup, that would do it. Thanks.
-Joey
On Fri, Aug 19, 2011 at 4:14 AM, Vinayakumar B <vi...@huawei.com> wrote:
>
> Please check the defect in MAPREDUCE jira
> https://issues.apache.org/jira/browse/MAPREDUCE-2264
>
> This is because the compression is enabled for map outputs and statistics
> are taken on compressed data instead of original data.
>
> -----Original Message-----
> From: Joey Echeverria [mailto:joey@cloudera.com]
> Sent: Friday, August 19, 2011 3:07 AM
> To: dev@hive.apache.org
> Subject: Wonky reduce progress
>
> I'm seeing really weird numbers in the JobTracker when monitoring jobs
> launched by hives. Some jobs who above 100% completion while running
> and others show less than 100% after the job completed. I tried
> searching for JIRAs but didn't see any matches.
>
> Has anyone else run into this?
>
> -Joey
>
> --
> Joseph Echeverria
> Cloudera, Inc.
> 443.305.9434
>
>
--
Joseph Echeverria
Cloudera, Inc.
443.305.9434