You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jun Young Kim <ju...@gmail.com> on 2011/01/28 03:04:21 UTC
Too small initial heap problem.
Hi,
I have 9 cluster (1 master, 8 slaves) to run a hadoop.
when I executed my job in a master, I got the following errors.
11/01/28 10:58:01 INFO mapred.JobClient: Running job: job_201101271451_0011
11/01/28 10:58:02 INFO mapred.JobClient: map 0% reduce 0%
11/01/28 10:58:08 INFO mapred.JobClient: Task Id :
attempt_201101271451_0011_m_000041_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)
11/01/28 10:58:08 WARN *mapred.JobClient: Error reading task
output*http://hatest03.server:50060/tasklog?plaintext=true&taskid=attempt_201101271451_0011_m_000041_0&filter=stdout
11/01/28 10:58:08 WARN *mapred.JobClient: Error reading task
output*http://hatest03.server:50060/tasklog?plaintext=true&taskid=attempt_201101271451_0011_m_000041_0&filter=stderr
after going the hatest03.server, I've checked the directory which is
named attempt_201101271451_0011_m_000041_0.
there is an error msg in a stdout file.
Error occurred during initialization of VM
Too small initial heap
my configuration to use a heap size is
<property>
<name>
mapred.child.java.opts
</name>
<value>
-Xmx1024
</value>
</property>
and the physical memory size is "free -m"
$ free -m
total used free shared
buffers cached
Mem: 12001 4711 7290 0 197 4056
-/+ buffers/cache: 457 11544
Swap: 2047 0 2047
how can I fix this problem?
--
Junyoung Kim (juneng603@gmail.com)
Re: Too small initial heap problem.
Posted by Koji Noguchi <kn...@yahoo-inc.com>.
> -Xmx1024
>
This would be 1024 bytes heap.
Maybe you want -Xmx1024m ?
Koji
On 1/27/11 6:04 PM, "Jun Young Kim" <ju...@gmail.com> wrote:
Hi,
I have 9 cluster (1 master, 8 slaves) to run a hadoop.
when I executed my job in a master, I got the following errors.
11/01/28 10:58:01 INFO mapred.JobClient: Running job: job_201101271451_0011
11/01/28 10:58:02 INFO mapred.JobClient: map 0% reduce 0%
11/01/28 10:58:08 INFO mapred.JobClient: Task Id :
attempt_201101271451_0011_m_000041_0, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:418)
11/01/28 10:58:08 WARN *mapred.JobClient: Error reading task
output*http://hatest03.server:50060/tasklog?plaintext=true&taskid=attempt_201101271451_0011_m_000041_0&filter=stdout
11/01/28 10:58:08 WARN *mapred.JobClient: Error reading task
output*http://hatest03.server:50060/tasklog?plaintext=true&taskid=attempt_201101271451_0011_m_000041_0&filter=stderr
after going the hatest03.server, I've checked the directory which is
named attempt_201101271451_0011_m_000041_0.
there is an error msg in a stdout file.
Error occurred during initialization of VM
Too small initial heap
my configuration to use a heap size is
<property>
<name>
mapred.child.java.opts
</name>
<value>
-Xmx1024
</value>
</property>
and the physical memory size is "free -m"
$ free -m
total used free shared
buffers cached
Mem: 12001 4711 7290 0 197 4056
-/+ buffers/cache: 457 11544
Swap: 2047 0 2047
how can I fix this problem?
--
Junyoung Kim (juneng603@gmail.com)