You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Geoffry Roberts <ge...@gmail.com> on 2012/02/08 22:45:46 UTC

Same Hadoop, Same MR Job, Different cluster

All,

I am setting up a new cluster on some new machines and am experiencing
errors that did not happen before.  I am using the same Hadoop-1.0 with the
same configuration, and the same jvm on both machines.  The thing that is
different is the OS. The old cluster was Ubuntu 10.10 and the new is Ubuntu
11.10.

Since the OS seems to be the difference, are there any issues with
Hadoop-1.0 and Ubuntu 11.10?

Also, I remember at one time Hadoop having troubles with ipv6.  Do I still
need to disable it?

The same job runs on the old but not on the new.

Error message is below.

Thanks

12/02/08 13:29:39 INFO mapred.JobClient:  map 0% reduce 0%
12/02/08 13:29:46 INFO mapred.JobClient: Task Id :
attempt_201202081216_0003_m_
000099_0, Status : FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)

12/02/08 13:29:46 WARN mapred.JobClient: Error reading task
outputhttp://q001q:50060/tasklog?plaintext=true&attemptid=attempt_201202081216_0003_m_000099_0&filter=stdout
12/02/08 13:29:46 WARN mapred.JobClient: Error reading task
outputhttp://q001q:50060/tasklog?plaintext=true&attemptid=attempt_201202081216_0003_m_000099_0&filter=stderr
12/02/08 13:29:52 INFO mapred.JobClient: Task Id :
attempt_201202081216_0003_r_000011_0, Status : FAILED
java.lang.Throwable: Child Error
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
        at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)


-- 
Geoffry Roberts

Re: Same Hadoop, Same MR Job, Different cluster

Posted by Geoffry Roberts <ge...@gmail.com>.
All,

This a follow up to my last post.

Turns out there was yet another hadoop cluster available running Ubuntu
10.10 on identical hardware to what i was using in may last post.  The
difference is between the two versions of Ubuntu: 10.10 vs 11.10. All else
is equal.

Things work on 10.10.  Things do not work on 11.10.

I can't explain.  I'm not going to try.  I'm rolling back to 10.10 for my
project.

On 8 February 2012 13:45, Geoffry Roberts <ge...@gmail.com> wrote:

> All,
>
> I am setting up a new cluster on some new machines and am experiencing
> errors that did not happen before.  I am using the same Hadoop-1.0 with the
> same configuration, and the same jvm on both machines.  The thing that is
> different is the OS. The old cluster was Ubuntu 10.10 and the new is Ubuntu
> 11.10.
>
> Since the OS seems to be the difference, are there any issues with
> Hadoop-1.0 and Ubuntu 11.10?
>
> Also, I remember at one time Hadoop having troubles with ipv6.  Do I still
> need to disable it?
>
> The same job runs on the old but not on the new.
>
> Error message is below.
>
> Thanks
>
> 12/02/08 13:29:39 INFO mapred.JobClient:  map 0% reduce 0%
> 12/02/08 13:29:46 INFO mapred.JobClient: Task Id :
> attempt_201202081216_0003_m_
> 000099_0, Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
>
> 12/02/08 13:29:46 WARN mapred.JobClient: Error reading task
> outputhttp://q001q:50060/tasklog?plaintext=true&attemptid=attempt_201202081216_0003_m_000099_0&filter=stdout
> 12/02/08 13:29:46 WARN mapred.JobClient: Error reading task
> outputhttp://q001q:50060/tasklog?plaintext=true&attemptid=attempt_201202081216_0003_m_000099_0&filter=stderr
> 12/02/08 13:29:52 INFO mapred.JobClient: Task Id :
> attempt_201202081216_0003_r_000011_0, Status : FAILED
> java.lang.Throwable: Child Error
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
> Caused by: java.io.IOException: Task process exit with nonzero status of 1.
>         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
>
>
> --
> Geoffry Roberts
>
>


-- 
Geoffry Roberts