You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Ruyue Ma <mr...@gmail.com> on 2009/02/09 07:03:51 UTC
Re: After hadoop jobtracker runs for a long time, jobtracker may
comsume 100% cpu (one cpu core is fully consume), why?
Our hadoop version is checked out from truck version at 2008.10.22.
When this problem appeared, our cluster didn't have any job running. The
cluster was idle!
On Mon, Feb 9, 2009 at 1:56 PM, Ruyue Ma <mr...@gmail.com> wrote:
> Hi, Everyone
>
> After hadoop jobtracker runs for a long time, jobtracker may comsume 100%
> cpu (one cpu core is fully consume).
>
> We have encountered this problem sever times. When it happens, it is hardly
> to submit job to jobtracker and visit the jobtracker web page.
>
> Anybody encounter this?
>
> is there an existed patch to fix it?
>
> Thanks
> Ruyue Ma
> Baidu.com
>
Re: After hadoop jobtracker runs for a long time, jobtracker may
comsume 100% cpu (one cpu core is fully consume), why?
Posted by Amar Kamat <am...@yahoo-inc.com>.
Ruyue Ma wrote:
> Our hadoop version is checked out from truck version at 2008.10.22.
>
> When this problem appeared, our cluster didn't have any job running. The
> cluster was idle!
>
How many jobs (total) were submitted to the cluster? What is the average
size of each job? Have you changed any default parameters and if yes
which ones?
There is an issue open on this (see
https://issues.apache.org/jira/browse/HADOOP-4766) for more details). Is
there any way to reproduce this?
Amar
>
> On Mon, Feb 9, 2009 at 1:56 PM, Ruyue Ma <mr...@gmail.com> wrote:
>
>
>> Hi, Everyone
>>
>> After hadoop jobtracker runs for a long time, jobtracker may comsume 100%
>> cpu (one cpu core is fully consume).
>>
>> We have encountered this problem sever times. When it happens, it is hardly
>> to submit job to jobtracker and visit the jobtracker web page.
>>
>> Anybody encounter this?
>>
>> is there an existed patch to fix it?
>>
>> Thanks
>> Ruyue Ma
>> Baidu.com
>>
>>
>
>