You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by abhishek sharma <ab...@usc.edu> on 2010/03/16 01:54:38 UTC

Is there a way to suppress the attempt logs?

Hi all,

Hadoop creates a directory (and some files) for each map and reduce
task attempts in "logs/userlogs" on each tasktracker.

Is there a way to configure Hadoop not to create these attempt logs?

Thanks,
Abhishek

Re: Is there a way to suppress the attempt logs?

Posted by Bill Graham <bi...@gmail.com>.

Not sure if what you're asking is possible or not, but you could experiment
with these params to see if you could achieve a similar effect.

<property>
  <name>mapred.userlog.limit.kb</name>
  <value>0</value>
  <description>The maximum size of user-logs of each task in KB. 0 disables
the cap.
  </description>
</property>

<property>
  <name>mapred.userlog.retain.hours</name>
  <value>24</value>
  <description>The maximum time, in hours, for which the user-logs are to be
                                retained.
  </description>
</property>

On Mon, Mar 15, 2010 at 5:54 PM, abhishek sharma <ab...@usc.edu> wrote:

> Hi all,
>
> Hadoop creates a directory (and some files) for each map and reduce
> task attempts in "logs/userlogs" on each tasktracker.
>
> Is there a way to configure Hadoop not to create these attempt logs?
>
> Thanks,
> Abhishek
>

Re: Is there a way to suppress the attempt logs?

Posted by Arun C Murthy <ac...@yahoo-inc.com>.

Moving to mapreduce-user@

On Mar 15, 2010, at 5:54 PM, abhishek sharma wrote:

> Hi all,
>
> Hadoop creates a directory (and some files) for each map and reduce
> task attempts in "logs/userlogs" on each tasktracker.
>
> Is there a way to configure Hadoop not to create these attempt logs?
>

Not really, what is the use case?

Re: Is there a way to suppress the attempt logs?

Posted by Arun C Murthy <ac...@yahoo-inc.com>.

Moving to mapreduce-user@

On Mar 15, 2010, at 5:54 PM, abhishek sharma wrote:

> Hi all,
>
> Hadoop creates a directory (and some files) for each map and reduce
> task attempts in "logs/userlogs" on each tasktracker.
>
> Is there a way to configure Hadoop not to create these attempt logs?
>

Not really, what is the use case?