You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Marko Bauhardt <mb...@media-style.com> on 2005/12/12 23:03:39 UTC

Re: MapRed Generator

Hi,

Looks like this is a bug, but we didn't find the real problem source,  
may the partitioner?

Marko.

Am 23.11.2005 um 15:04 schrieb Anton Potehin:

> Class Generator
>
>
>
> We have 2 Reduce Tasks
>
>
>
> Limit = TopN / 2;
>
>
>
> Generator.Selector.Reduce for first task receive all K,V pairs from
> maps, but select only half of them (work limit)
>
> Generator.Selector.Reduce for second task doesn't receive pairs at  
> all!
>
>
>
> In result on output we have half of mapped pairs!
>
>
>
> This is bug? Or I'm don't understand something?
>