Re: we need more masscheckers

[Axb <ax...@gmail.com>]

On 02/27/2014 05:15 PM, John Hardin wrote:
> On Thu, 27 Feb 2014, Axb wrote:
>
>> Yesterday one of my masscheck jobs took very, VERY long.
>>
>> Iirc one could do this in some client server mode to be able to split
>> the job across several machines.
>
> You should be able to split your corpora into multiple files and
> allocate those files across multiple boxes and masscheck them in
> parallel - simply treat them as separate corpora with separate result
> sets, each box masschecking one sub-corpus and reporting results when
> completed.

corpora is in Maildirs - not so simple to split unless you go through a 
tone of scripting.

I'm just reducing the corpora's size/TTL and call it a day.


thx