You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by Alex Newman <po...@gmail.com> on 2008/12/18 17:03:22 UTC

To many userlog files build up.

     So we were storing the a  hadoop.job.history.user.location
(attempt_blah) files on local disk on each node.  We keep them around for
about a week. We have had to reduce this to 1 day, because as the number of
files in that directory increases, eventually jobs fail to run on that
machine til I clear/move the logs out. I am guessing that this is a glob
failure.