You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@infra.apache.org by "Brett Porter (JIRA)" <ji...@apache.org> on 2007/08/20 14:31:31 UTC
[jira] Created: (INFRA-1322) set up an external database and backup
regime
set up an external database and backup regime
---------------------------------------------
Key: INFRA-1322
URL: https://issues.apache.org/jira/browse/INFRA-1322
Project: Infrastructure
Issue Type: Improvement
Security Level: public (Regular issues)
Components: Continuum
Reporter: Brett Porter
Priority: Critical
currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659232#action_12659232 ]
Gavin commented on INFRA-1322:
------------------------------
I'll see about backing up the Home dir on a daily basis, probably to bia our backup machine.
1. Do you want it backing up anywhere else also for easy access?
2. Will someone in Continuum take care of converting to a database or do want me to go ahead and do that?
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (INFRA-1322) set up an external database and
backup regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gavin reassigned INFRA-1322:
----------------------------
Assignee: Gavin
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (INFRA-1322) set up an external database and backup
regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gavin updated INFRA-1322:
-------------------------
Assignee: (was: Gavin)
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (INFRA-1322) set up an external database and
backup regime
Posted by "Brett Porter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter reassigned INFRA-1322:
-----------------------------------
Assignee: Gavin
Database is already set up on vmbuild2
Gav has said he'll reimplement the data and database backup measures there. Let me know if I can help
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Olivier Lamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659415#action_12659415 ]
Olivier Lamy commented on INFRA-1322:
-------------------------------------
Thanks Gavin.
Yes you can exclude working-directory too.
Brett it looks some snapshots are deployed to /home/continuum/data/commons and /home/continuum/data/repositories/.
I'm not sure we have to backup this snapshot repositories. We could move this snapshots repos to an other part of the fs.
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659383#action_12659383 ]
Gavin commented on INFRA-1322:
------------------------------
Thanks Olivier,
I have excluded the build-output-directory and also the working-directory.
the working-directory is currently 9.1GB.
Let me know if you want the working-directory included or not.
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659418#action_12659418 ]
Gavin commented on INFRA-1322:
------------------------------
Ok great,
Once you've worked out where you moving the snapshots to I can then set up an rsync daemon as per https://issues.apache.org/jira/browse/INFRA-1318, that was next on my list.
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Olivier Lamy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659361#action_12659361 ]
Olivier Lamy commented on INFRA-1322:
-------------------------------------
Hi,
You can exclude the directory build-output-directory.
Brett : which external db do you want to use ? (mysql ingres ? )
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12659327#action_12659327 ]
Gavin commented on INFRA-1322:
------------------------------
Ok, so I've added a backup script and a cronjob to run it daily.
It currently backs up the whole of home/continuum/data/*
I think we can cut that down a bit, so I'll see about refining it, can you tell me what you want included for definate.
Brett, your added to the new apbackup group on vmbuild
the script is in /home/apbackup/bin/backups-vmbuild-daily.sh
the cronjob is run as apbackup user.
5 days worth of log files are kept in /home/apbackup
above script is versioned!
I'll wait your replies before carrying on.
Cheers
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (INFRA-1322) set up an external database and
backup regime
Posted by "Brett Porter (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895990#action_12895990 ]
Brett Porter commented on INFRA-1322:
-------------------------------------
from comments on IRC, this is now backing up to ~continuum/backups
The following is what remains to complete the vmbuild setup:
* ship backups to bia
* test log cleanup and add to cron
* confirm ntp is correctly operating or vm time synced (not sure if its an issue, this was a problem on vmbuild1 that Joe fixed and I saw it was in the root cron before)
Thanks Gav!
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Assignee: Gavin
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Closed: (INFRA-1322) set up an external database and backup
regime
Posted by "Gavin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/INFRA-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gavin closed INFRA-1322.
------------------------
Assignee: (was: Gavin)
Resolution: Fixed
ntpd server done
backups running to bia
log job removal looks fine
all cronned
> set up an external database and backup regime
> ---------------------------------------------
>
> Key: INFRA-1322
> URL: https://issues.apache.org/jira/browse/INFRA-1322
> Project: Infrastructure
> Issue Type: Improvement
> Security Level: public(Regular issues)
> Components: Continuum
> Reporter: Brett Porter
> Priority: Critical
>
> currently, Continuum uses an in-memory Derby database, stored in the Continuum home directory. We need to start backing that up regularly.
> It would definitely be worth investigating an alternative database that is more consistent with other setups so we can re-use backup scripts.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.