You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@infra.apache.org by "Brett Porter (JIRA)" <ji...@apache.org> on 2007/08/20 14:49:30 UTC

[jira] Created: (INFRA-1324) set up log rotation / clean up for VMBuild

set up log rotation / clean up for VMBuild
------------------------------------------

                 Key: INFRA-1324
                 URL: https://issues.apache.org/jira/browse/INFRA-1324
             Project: Infrastructure
          Issue Type: Task
      Security Level: public (Regular issues)
          Components: Continuum
            Reporter: Brett Porter


Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).

Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647937#action_12647937 ] 

Gavin commented on INFRA-1324:
------------------------------

I ve added to the scrip the rest of the apache-continuum-1.2 log file types so that now files

*.request.log
*.stderrout.log
*.stderrout.log.*

are all deleted at 30 day mark also.

So, up to you if 30 days is a good mark.

As is stands that log dir went down from 977MB to 519MB and so should stay around that figure now.

Looking into the apache log situation now.

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647932#action_12647932 ] 

Gavin commented on INFRA-1324:
------------------------------

Ok, I've made a start, done some tests and works fine.

I've put a script at /home/continuum/delete_old_logs.sh

Currently this deletes logs older than 30 days from :

/opt/apache-continuum-1.2/logs/continuum.log.*

There is a crontab entry which runs this at  19:32 every day
and errors should now go to /home/continuum/cron.log

Now we just need to expand delete_old_logs.sh to include other logs to delete.
So, let me know what else you want including.



> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Closed: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gavin closed INFRA-1324.
------------------------

    Resolution: Fixed
      Assignee:     (was: Gavin)

All done

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gavin reassigned INFRA-1324:
----------------------------

    Assignee: Gavin

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647933#action_12647933 ] 

Gavin commented on INFRA-1324:
------------------------------

I've looked through the rest of /opt/* and it seems no other versions are actively logging any more, so no need to add them to any cron job - although perhaps to clear space you might want logs from them deleting (i.e- there are a lot of logs from 2007 and 2008 up to May when the logs stopped, so let me know if you want them clearing out.

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Gavin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647938#action_12647938 ] 

Gavin commented on INFRA-1324:
------------------------------

Ok, now I've added

error.log.30.gz will be deleted if it exists (so every 7 days)

You mention above you didnt want to do that to access.log ? (So I haven;t for now), rationale ?

I'll wait now for further instructions.

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Olivier Lamy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584331#action_12584331 ] 

Olivier Lamy commented on INFRA-1324:
-------------------------------------

A cleanup like 
continuum logs :
find /opt/continuum-1.1-beta-3/logs/ -mtime +14 -exec rm {} \; 
httpd logs :
find /var/log/apache2 -mtime +15 -exec rm {} \; 

ok ?

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Brett Porter (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648859#action_12648859 ] 

Brett Porter commented on INFRA-1324:
-------------------------------------

deleting the access logs is fine - I was attempting to say there's no need to retain them on a build box. Everything else looks good. I've cleaned up old installations and their associated logs

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>            Assignee: Gavin
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1324) set up log rotation / clean up for VMBuild

Posted by "Brett Porter (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584349#action_12584349 ] 

Brett Porter commented on INFRA-1324:
-------------------------------------

I would only include error.log in the latter one.

There is a script in Subversion for what is used on the other servers - it might be good to review that.

> set up log rotation / clean up for VMBuild
> ------------------------------------------
>
>                 Key: INFRA-1324
>                 URL: https://issues.apache.org/jira/browse/INFRA-1324
>             Project: Infrastructure
>          Issue Type: Task
>      Security Level: public(Regular issues) 
>          Components: Continuum
>            Reporter: Brett Porter
>
> Continuum logs are rotated - need to delete them after a sensible interval (2 weeks to a month depending on size).
> Need to check for rotation and clean up of httpd error and access logs (probably no need to retain these on vmbuild).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.