[jira] [Created] (MESOS-4613) Mesos when used with --log_dir generates hundreds of thousands of log files per day

["Lukas Loesche (JIRA)" <ji...@apache.org>]

Lukas Loesche created MESOS-4613:
------------------------------------

             Summary: Mesos when used with --log_dir generates hundreds of thousands of log files per day
                 Key: MESOS-4613
                 URL: https://issues.apache.org/jira/browse/MESOS-4613
             Project: Mesos
          Issue Type: Bug
            Reporter: Lukas Loesche


We're using mesos with --log_dir=/var/log/mesos
Lately in addition to the mesos-master and mesos-slave log there's also been mesos-fetcher logs written into this directory.

It seems that every process generates a new log file with a unique file name containing the date and pid. For mesos-master and mesos-slave this makes sense. For mesos-fetcher not so much.

On a moderately busy agent it's currently generating 200k log files per day. On our particular system this would cause logrotate to segfault. And standard tools like 'rm mesos-fetcher*' won't work because there's too many files to expand the command.

I also noted that a lot of the created files are zero bytes. So for now we're running a cron every minute
{noformat}
find /var/log/mesos -size 0 -name 'mesos-fetcher*' -delete
{noformat}
as a workaround.

Anyways it would be nice if there was an option to make the mesos-fetcher write into a single log file instead of creating thousands of individual files.

Or if that's easier to implement an option to only write the master and slave log but not the fetcher logs.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)