java.lang.RuntimeException: problem advancing post rec#499959

[Pedro Costa <ps...@gmail.com>]

Hi,

I'm running the Terasort problem in cluster mode, and I've got a
RunTimeException in a Reduce Task.

java.lang.RuntimeException: problem advancing post rec#499959

(Please, see attachment)

What this error means? Is it a problem about wrong KEYOUT and VALUEOUT
in the Reduce Task?

Thanks,

-- 
Pedro

Re: java.lang.RuntimeException: problem advancing post rec#499959

[Pedro Costa <ps...@gmail.com>]

How can I check if it's data corruption? I'm running the terasort
example in a cluster, with 1GB of data of input stream.

The terasort example runs well with an input stream of 500MB.



On Fri, Jan 28, 2011 at 6:01 PM, Harsh J <qw...@gmail.com> wrote:
> This looks like a case of data corruption (of one/more intermediate
> files, a.k.a. IFiles).
>
> On Fri, Jan 28, 2011 at 11:21 PM, Pedro Costa <ps...@gmail.com> wrote:
>> Hi,
>>
>> I'm running the Terasort problem in cluster mode, and I've got a
>> RunTimeException in a Reduce Task.
>>
>> java.lang.RuntimeException: problem advancing post rec#499959
>>
>> (Please, see attachment)
>>
>> What this error means? Is it a problem about wrong KEYOUT and VALUEOUT
>> in the Reduce Task?
>>
>> Thanks,
>>
>> --
>> Pedro
>>
>
>
>
> --
> Harsh J
> www.harshj.com
>



-- 
Pedro

Re: java.lang.RuntimeException: problem advancing post rec#499959

[Harsh J <qw...@gmail.com>]

This looks like a case of data corruption (of one/more intermediate
files, a.k.a. IFiles).

On Fri, Jan 28, 2011 at 11:21 PM, Pedro Costa <ps...@gmail.com> wrote:
> Hi,
>
> I'm running the Terasort problem in cluster mode, and I've got a
> RunTimeException in a Reduce Task.
>
> java.lang.RuntimeException: problem advancing post rec#499959
>
> (Please, see attachment)
>
> What this error means? Is it a problem about wrong KEYOUT and VALUEOUT
> in the Reduce Task?
>
> Thanks,
>
> --
> Pedro
>



-- 
Harsh J
www.harshj.com