You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Reyane Oukpedjo <ou...@gmail.com> on 2013/10/10 16:57:19 UTC
Hadoop-2.0.1 log files deletion
Hi there,
I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
multiple unit tests that can take more than a day to finish running.
However I realized the logs for the jobs are being deleted some how quickly
than the default 24 hours setting of mapreduce.job.userlog.retain.hours
property on mapred-site.xml. some of the job logs were deleted after 4
hours. Can this be a bug or if not is there any other property that
override this ?
Thank you.
Reyane OUKPEDJO
Re: Hadoop-2.0.1 log files deletion
Posted by Reyane Oukpedjo <ou...@gmail.com>.
Thanks problem solved!!!!.
Reyane OUKPEDJO
On 10 October 2013 11:10, Krishna Kishore Bonagiri
<wr...@gmail.com>wrote:
> Hi Reyane,
>
> Did you try yarn.nodemanager.log.retain-seconds? increasing that might
> help. The default value is 10800 seconds, that means 3 hours.
>
> Thanks,
> Kishore
>
>
> On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
>
>> Hi there,
>>
>> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
>> multiple unit tests that can take more than a day to finish running.
>> However I realized the logs for the jobs are being deleted some how quickly
>> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
>> property on mapred-site.xml. some of the job logs were deleted after 4
>> hours. Can this be a bug or if not is there any other property that
>> override this ?
>>
>>
>> Thank you.
>>
>> Reyane OUKPEDJO
>>
>>
>>
>>
>>
>>
>>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Reyane Oukpedjo <ou...@gmail.com>.
Thanks problem solved!!!!.
Reyane OUKPEDJO
On 10 October 2013 11:10, Krishna Kishore Bonagiri
<wr...@gmail.com>wrote:
> Hi Reyane,
>
> Did you try yarn.nodemanager.log.retain-seconds? increasing that might
> help. The default value is 10800 seconds, that means 3 hours.
>
> Thanks,
> Kishore
>
>
> On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
>
>> Hi there,
>>
>> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
>> multiple unit tests that can take more than a day to finish running.
>> However I realized the logs for the jobs are being deleted some how quickly
>> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
>> property on mapred-site.xml. some of the job logs were deleted after 4
>> hours. Can this be a bug or if not is there any other property that
>> override this ?
>>
>>
>> Thank you.
>>
>> Reyane OUKPEDJO
>>
>>
>>
>>
>>
>>
>>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Reyane Oukpedjo <ou...@gmail.com>.
Thanks problem solved!!!!.
Reyane OUKPEDJO
On 10 October 2013 11:10, Krishna Kishore Bonagiri
<wr...@gmail.com>wrote:
> Hi Reyane,
>
> Did you try yarn.nodemanager.log.retain-seconds? increasing that might
> help. The default value is 10800 seconds, that means 3 hours.
>
> Thanks,
> Kishore
>
>
> On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
>
>> Hi there,
>>
>> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
>> multiple unit tests that can take more than a day to finish running.
>> However I realized the logs for the jobs are being deleted some how quickly
>> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
>> property on mapred-site.xml. some of the job logs were deleted after 4
>> hours. Can this be a bug or if not is there any other property that
>> override this ?
>>
>>
>> Thank you.
>>
>> Reyane OUKPEDJO
>>
>>
>>
>>
>>
>>
>>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Reyane Oukpedjo <ou...@gmail.com>.
Thanks problem solved!!!!.
Reyane OUKPEDJO
On 10 October 2013 11:10, Krishna Kishore Bonagiri
<wr...@gmail.com>wrote:
> Hi Reyane,
>
> Did you try yarn.nodemanager.log.retain-seconds? increasing that might
> help. The default value is 10800 seconds, that means 3 hours.
>
> Thanks,
> Kishore
>
>
> On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
>
>> Hi there,
>>
>> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
>> multiple unit tests that can take more than a day to finish running.
>> However I realized the logs for the jobs are being deleted some how quickly
>> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
>> property on mapred-site.xml. some of the job logs were deleted after 4
>> hours. Can this be a bug or if not is there any other property that
>> override this ?
>>
>>
>> Thank you.
>>
>> Reyane OUKPEDJO
>>
>>
>>
>>
>>
>>
>>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Reyane,
Did you try yarn.nodemanager.log.retain-seconds? increasing that might
help. The default value is 10800 seconds, that means 3 hours.
Thanks,
Kishore
On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
> Hi there,
>
> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
> multiple unit tests that can take more than a day to finish running.
> However I realized the logs for the jobs are being deleted some how quickly
> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
> property on mapred-site.xml. some of the job logs were deleted after 4
> hours. Can this be a bug or if not is there any other property that
> override this ?
>
>
> Thank you.
>
> Reyane OUKPEDJO
>
>
>
>
>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Reyane,
Did you try yarn.nodemanager.log.retain-seconds? increasing that might
help. The default value is 10800 seconds, that means 3 hours.
Thanks,
Kishore
On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
> Hi there,
>
> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
> multiple unit tests that can take more than a day to finish running.
> However I realized the logs for the jobs are being deleted some how quickly
> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
> property on mapred-site.xml. some of the job logs were deleted after 4
> hours. Can this be a bug or if not is there any other property that
> override this ?
>
>
> Thank you.
>
> Reyane OUKPEDJO
>
>
>
>
>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Reyane,
Did you try yarn.nodemanager.log.retain-seconds? increasing that might
help. The default value is 10800 seconds, that means 3 hours.
Thanks,
Kishore
On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
> Hi there,
>
> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
> multiple unit tests that can take more than a day to finish running.
> However I realized the logs for the jobs are being deleted some how quickly
> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
> property on mapred-site.xml. some of the job logs were deleted after 4
> hours. Can this be a bug or if not is there any other property that
> override this ?
>
>
> Thank you.
>
> Reyane OUKPEDJO
>
>
>
>
>
>
>
Re: Hadoop-2.0.1 log files deletion
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Reyane,
Did you try yarn.nodemanager.log.retain-seconds? increasing that might
help. The default value is 10800 seconds, that means 3 hours.
Thanks,
Kishore
On Thu, Oct 10, 2013 at 8:27 PM, Reyane Oukpedjo <ou...@gmail.com>wrote:
> Hi there,
>
> I was running somme mapreduce jobs on hadoop-2.1.0-beta . These are
> multiple unit tests that can take more than a day to finish running.
> However I realized the logs for the jobs are being deleted some how quickly
> than the default 24 hours setting of mapreduce.job.userlog.retain.hours
> property on mapred-site.xml. some of the job logs were deleted after 4
> hours. Can this be a bug or if not is there any other property that
> override this ?
>
>
> Thank you.
>
> Reyane OUKPEDJO
>
>
>
>
>
>
>