delete _logs dir ?

[Mapred Learn <ma...@gmail.com>]

Hi,
I see that eveyr job has _logs dir that has history dir taking 1 block.

Is it safe to delete such _logs directories as we hv lot of them ?


Thanks,
JJ

RE: delete _logs dir ?

[Girish Ravi <gi...@srmtech.com>]

HI,

As far as I have seen the temporary files will be deleted at the end of Job execution.
The temporary files are the output of your map and reduce.

If it is not deleted, please confirm if there is any parameter set in your environment - to retain the logs.

Regards
Girish

________________________________________
From: Harsh J [harsh@cloudera.com]
Sent: Saturday, June 23, 2012 11:30 AM
To: mapreduce-user@hadoop.apache.org
Subject: Re: delete _logs dir ?

Yes, it should be safe to delete these for completed jobs (its usually
used to keep around job history files, which is moved to the done
location after the job is completed (in whatever end state)).

On Sat, Jun 23, 2012 at 6:22 AM, Mapred Learn <ma...@gmail.com> wrote:
> Hi,
> I see that eveyr job has _logs dir that has history dir taking 1 block.
>
> Is it safe to delete such _logs directories as we hv lot of them ?
>
>
> Thanks,
> JJ



--
Harsh J

Re: delete _logs dir ?

[Harsh J <ha...@cloudera.com>]

Yes, it should be safe to delete these for completed jobs (its usually
used to keep around job history files, which is moved to the done
location after the job is completed (in whatever end state)).

On Sat, Jun 23, 2012 at 6:22 AM, Mapred Learn <ma...@gmail.com> wrote:
> Hi,
> I see that eveyr job has _logs dir that has history dir taking 1 block.
>
> Is it safe to delete such _logs directories as we hv lot of them ?
>
>
> Thanks,
> JJ



-- 
Harsh J