You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Youzha <yu...@gmail.com> on 2016/03/23 15:18:10 UTC
nodemanager inactive
hi i try to submit mapreduce job but sometimes the nodemanagers are dead
when the job running. i check the hdfs storage only use 20%. and i think
the yarn resource is still enough to run that job. anybody can help me why
this can happen? what requirement that nodemanagers needed? thx before
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Great that's good to know...
Sent from my iPhone
> On Mar 23, 2016, at 8:43 AM, tkg_cangkul <yu...@gmail.com> wrote:
>
> hi ron. thx for your reply.
> i think my problem has been solved now.
> the storage of log dir not sufficient. i don't know if the logs need much storage.
>
>> On 23/03/16 21:20, Ron Gonzalez wrote:
>> Did you take a look at the node manager logs?
>>
>> Thanks,
>> Ron
>>
>> Sent from my iPhone
>>
>> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>>
>>> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
>>>
>
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Great that's good to know...
Sent from my iPhone
> On Mar 23, 2016, at 8:43 AM, tkg_cangkul <yu...@gmail.com> wrote:
>
> hi ron. thx for your reply.
> i think my problem has been solved now.
> the storage of log dir not sufficient. i don't know if the logs need much storage.
>
>> On 23/03/16 21:20, Ron Gonzalez wrote:
>> Did you take a look at the node manager logs?
>>
>> Thanks,
>> Ron
>>
>> Sent from my iPhone
>>
>> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>>
>>> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
>>>
>
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Great that's good to know...
Sent from my iPhone
> On Mar 23, 2016, at 8:43 AM, tkg_cangkul <yu...@gmail.com> wrote:
>
> hi ron. thx for your reply.
> i think my problem has been solved now.
> the storage of log dir not sufficient. i don't know if the logs need much storage.
>
>> On 23/03/16 21:20, Ron Gonzalez wrote:
>> Did you take a look at the node manager logs?
>>
>> Thanks,
>> Ron
>>
>> Sent from my iPhone
>>
>> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>>
>>> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
>>>
>
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Great that's good to know...
Sent from my iPhone
> On Mar 23, 2016, at 8:43 AM, tkg_cangkul <yu...@gmail.com> wrote:
>
> hi ron. thx for your reply.
> i think my problem has been solved now.
> the storage of log dir not sufficient. i don't know if the logs need much storage.
>
>> On 23/03/16 21:20, Ron Gonzalez wrote:
>> Did you take a look at the node manager logs?
>>
>> Thanks,
>> Ron
>>
>> Sent from my iPhone
>>
>> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>>
>>> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
>>>
>
Re: nodemanager inactive
Posted by tkg_cangkul <yu...@gmail.com>.
hi ron. thx for your reply.
i think my problem has been solved now.
the storage of log dir not sufficient. i don't know if the logs need
much storage.
On 23/03/16 21:20, Ron Gonzalez wrote:
> Did you take a look at the node manager logs?
>
> Thanks,
> Ron
>
> Sent from my iPhone
>
> On Mar 23, 2016, at 7:18 AM, Youzha <yuza.rasfar@gmail.com
> <ma...@gmail.com>> wrote:
>
>> hi i try to submit mapreduce job but sometimes the nodemanagers are
>> dead when the job running. i check the hdfs storage only use 20%. and
>> i think the yarn resource is still enough to run that job. anybody
>> can help me why this can happen? what requirement that nodemanagers
>> needed? thx before
>>
Re: nodemanager inactive
Posted by tkg_cangkul <yu...@gmail.com>.
hi ron. thx for your reply.
i think my problem has been solved now.
the storage of log dir not sufficient. i don't know if the logs need
much storage.
On 23/03/16 21:20, Ron Gonzalez wrote:
> Did you take a look at the node manager logs?
>
> Thanks,
> Ron
>
> Sent from my iPhone
>
> On Mar 23, 2016, at 7:18 AM, Youzha <yuza.rasfar@gmail.com
> <ma...@gmail.com>> wrote:
>
>> hi i try to submit mapreduce job but sometimes the nodemanagers are
>> dead when the job running. i check the hdfs storage only use 20%. and
>> i think the yarn resource is still enough to run that job. anybody
>> can help me why this can happen? what requirement that nodemanagers
>> needed? thx before
>>
Re: nodemanager inactive
Posted by tkg_cangkul <yu...@gmail.com>.
hi ron. thx for your reply.
i think my problem has been solved now.
the storage of log dir not sufficient. i don't know if the logs need
much storage.
On 23/03/16 21:20, Ron Gonzalez wrote:
> Did you take a look at the node manager logs?
>
> Thanks,
> Ron
>
> Sent from my iPhone
>
> On Mar 23, 2016, at 7:18 AM, Youzha <yuza.rasfar@gmail.com
> <ma...@gmail.com>> wrote:
>
>> hi i try to submit mapreduce job but sometimes the nodemanagers are
>> dead when the job running. i check the hdfs storage only use 20%. and
>> i think the yarn resource is still enough to run that job. anybody
>> can help me why this can happen? what requirement that nodemanagers
>> needed? thx before
>>
Re: nodemanager inactive
Posted by tkg_cangkul <yu...@gmail.com>.
hi ron. thx for your reply.
i think my problem has been solved now.
the storage of log dir not sufficient. i don't know if the logs need
much storage.
On 23/03/16 21:20, Ron Gonzalez wrote:
> Did you take a look at the node manager logs?
>
> Thanks,
> Ron
>
> Sent from my iPhone
>
> On Mar 23, 2016, at 7:18 AM, Youzha <yuza.rasfar@gmail.com
> <ma...@gmail.com>> wrote:
>
>> hi i try to submit mapreduce job but sometimes the nodemanagers are
>> dead when the job running. i check the hdfs storage only use 20%. and
>> i think the yarn resource is still enough to run that job. anybody
>> can help me why this can happen? what requirement that nodemanagers
>> needed? thx before
>>
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Did you take a look at the node manager logs?
Thanks,
Ron
Sent from my iPhone
> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>
> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Did you take a look at the node manager logs?
Thanks,
Ron
Sent from my iPhone
> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>
> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Did you take a look at the node manager logs?
Thanks,
Ron
Sent from my iPhone
> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>
> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before
Re: nodemanager inactive
Posted by Ron Gonzalez <zl...@yahoo.com.INVALID>.
Did you take a look at the node manager logs?
Thanks,
Ron
Sent from my iPhone
> On Mar 23, 2016, at 7:18 AM, Youzha <yu...@gmail.com> wrote:
>
> hi i try to submit mapreduce job but sometimes the nodemanagers are dead when the job running. i check the hdfs storage only use 20%. and i think the yarn resource is still enough to run that job. anybody can help me why this can happen? what requirement that nodemanagers needed? thx before