You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Ian Davis <ia...@gmail.com> on 2004/07/27 15:23:47 UTC

Repository destoryed at random on OS X using new DB, etc.

This is really frustrating... my respository has died *twice* now in
as many months on OS X. I have no idea how to repair it -- I tried
'svnadmin recover' and that seems to have made things worse (!).

First some version numbers. OS X 10.3.3, svn 1.0.1, Berkley DB 4.2.52.
I know there are OS X issues with earlier versions of the DB, but the
docs say this one should be OK. The respository is on my local
filesystem and is for my own use on a personal programming project.


Here's the basic message I got when I tried to commit:
[ian@cobalt ~/Sites/molprobity3]% svn ci
svn: Commit failed (details follow):
svn: Berkeley DB error while checkpointing after Berkeley DB
transaction for filesystem /Users/ian/Sites/svnrepos/db:
Invalid argument
svn: Your commit message was left in a temporary file:
svn:    '/Users/ian/Sites/molprobity3/svn-commit.tmp'


The same thing happens when I try updating:
[ian@cobalt ~/Sites/molprobity3]% svn up
svn: Berkeley DB error while checkpointing after Berkeley DB
transaction for filesystem /Users/ian/Sites/svnrepos/db:
Invalid argument


After 'svnadmin recover', things get worse and this new error message persists:
[ian@cobalt ~/Sites]% svnadmin recover svnrepos/
Please wait; recovering the repository may take some time...
svn: DB_RUNRECOVERY: Fatal error, run database recovery


Further recover attempts produce the same result. My only thoughts on
why this is happening are (1) there are some symlinks inside the
project directory (those these are ignored and not versioned) and (2)
there are some files that I don't have permissions to access inside
the project (again, ignored and not versioned). Sometimes I've gone
for months at a time using svn without any problems... Then this
happens without warning.

Somebody, please help! How do I fix this, and how can I keep it from
happening again??

Much thanks,
Ian

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ian Davis <ia...@gmail.com>.
No, it looks like I started with svn 0.34 and later upgraded to 1.0.1.
It's failed twice, but both long after I upgraded to 1.0.1. Doing a
dump/load cycle fixed it (temporarily, at least) both times. I can't
be absolutely sure that this is true, but I think it is, b/c this was
the first project I ever tried using svn on and I have both 0.34 and
1.0.1 in /usr/local. I think I used the same version of BDB for both,
though -- I only remember compiling it once...
Ian


On Fri, 30 Jul 2004 10:33:05 -0500, Ben Collins-Sussman
<su...@collab.net> wrote:
> Ian:  did you upgrade your svn or BDB at any point since you started
> using this repository?  Or has all the software remained constant from
> the very beginning?

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ben Collins-Sussman <su...@collab.net>.
On Wed, 2004-07-28 at 06:48, Ian Davis wrote:
> Hi Max, thanks for all the help and advice. I'll be suitably careful
> in following it. However, my repository has died in this way twice
> now, and neither time was there anything odd about the check-in
> attempt except that it failed. No power failures, hung processes, file
> system defects, nada. Now it's true that my Powerbook does hang
> sometimes when it goes to sleep and I have to remove the battery (!)
> to convince it to shut off and reboot, and these episodes have
> happened in the time since my last check-in to this repository.
> However, the repository wasn't being accessed anytime around the
> failure, and there hasn't been any damage to other parts of the
> system, so that seems unlikely to me.
> 
> Good luck!
> Ian

Ian:  did you upgrade your svn or BDB at any point since you started
using this repository?  Or has all the software remained constant from
the very beginning?



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ian Davis <ia...@gmail.com>.
Hi Max, thanks for all the help and advice. I'll be suitably careful
in following it. However, my repository has died in this way twice
now, and neither time was there anything odd about the check-in
attempt except that it failed. No power failures, hung processes, file
system defects, nada. Now it's true that my Powerbook does hang
sometimes when it goes to sleep and I have to remove the battery (!)
to convince it to shut off and reboot, and these episodes have
happened in the time since my last check-in to this repository.
However, the repository wasn't being accessed anytime around the
failure, and there hasn't been any damage to other parts of the
system, so that seems unlikely to me.

Good luck!
Ian

On Wed, 28 Jul 2004 09:54:06 +0100, Max Bowsher <ma...@ukf.net> wrote:
> My initial analysis suggests that a write to the database logs is somehow
> 'getting lost', leaving the databases updated to a later version than there
> are log records. BDB then reports this as "Invalid argument".
> 
> So, our question to you is:
> 
> Did anything unusual of any kind happen around the time the repos became
> broken? Power failure? Unclean reboot? Svn process hung?
> 
> It is possible that nothing odd happened - there might be a bug in BDB.
> 
> Max.
> 
> PS: We are tracking this issue in:
> http://subversion.tigris.org/issues/show_bug.cgi?id=1968

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Max Bowsher <ma...@ukf.net>.
Ian Davis wrote:
> OK, here's my repository as captured by 'tar czf', weighing in at about
20Mb:
> http://kinemage.biochem.duke.edu/~iwd/mp3svnrepos.040727.tgz
>
> Have at it ;) All I ask is that you would let me know if you can
> figure out what went wrong.

My initial analysis suggests that a write to the database logs is somehow
'getting lost', leaving the databases updated to a later version than there
are log records. BDB then reports this as "Invalid argument".

So, our question to you is:

Did anything unusual of any kind happen around the time the repos became
broken? Power failure? Unclean reboot? Svn process hung?

It is possible that nothing odd happened - there might be a bug in BDB.

Max.

PS: We are tracking this issue in:
http://subversion.tigris.org/issues/show_bug.cgi?id=1968


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ian Davis <ia...@gmail.com>.
Yes, R40 is (as far as I know) the latest revision. I think I was
trying to commit 41 when everything died.
Ian

On Tue, 27 Jul 2004 18:23:18 +0100, Max Bowsher <ma...@ukf.net> wrote:
> What is the youngest revision that should be present in this repository? Is
> it r40?

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Max Bowsher <ma...@ukf.net>.
Ian Davis wrote:
> OK, here's my repository as captured by 'tar czf', weighing in at about
20Mb:
> http://kinemage.biochem.duke.edu/~iwd/mp3svnrepos.040727.tgz
>
> Have at it ;) All I ask is that you would let me know if you can
> figure out what went wrong. In the meantime, I think I'll switch to
> FSFS. I never liked having to build and use Berkley DB anyway --
> thanks to the developers for this nice new feature!

Thankyou!

What is the youngest revision that should be present in this repository? Is
it r40?

Max.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ian Davis <ia...@gmail.com>.
OK, here's my repository as captured by 'tar czf', weighing in at about 20Mb:
   http://kinemage.biochem.duke.edu/~iwd/mp3svnrepos.040727.tgz

Have at it ;)  All I ask is that you would let me know if you can
figure out what went wrong. In the meantime, I think I'll switch to
FSFS. I never liked having to build and use Berkley DB anyway --
thanks to the developers for this nice new feature!

Cheers,
Ian

PS Sorry Ben, meant to send this to the list too the first time. Jeez,
I can't even use email right... maybe the svn bug was a user
malfunction ;)

> This looks like another case of issue 1968.  Can you post a tarball of
> your repository for us to inspect?  Pretty please?  We'd like to figure
> out what's going on.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org


Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Max Bowsher <ma...@ukf.net>.
Ian Davis wrote:
> Sure, I can post a tarball. Where do I post it, and how?

On any web or ftp site, then send the URL in an email to this list.

> Regarding Francois's suggestion of using FSFS instead -- is that
> stable enough to rely on?

Yes. FSFS will be in the 1.1.0 release.

Max.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ian Davis <ia...@gmail.com>.
Sure, I can post a tarball. Where do I post it, and how?

Regarding Francois's suggestion of using FSFS instead -- is that
stable enough to rely on?

Thanks,
Ian

On Tue, 27 Jul 2004 10:40:52 -0500, Ben Collins-Sussman
<su...@collab.net> wrote:
> This looks like another case of issue 1968.  Can you post a tarball of
> your repository for us to inspect?  Pretty please?  We'd like to figure
> out what's going on.

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by Ben Collins-Sussman <su...@collab.net>.
On Tue, 2004-07-27 at 10:23, Ian Davis wrote:

> Here's the basic message I got when I tried to commit:
> [ian@cobalt ~/Sites/molprobity3]% svn ci
> svn: Commit failed (details follow):
> svn: Berkeley DB error while checkpointing after Berkeley DB
> transaction for filesystem /Users/ian/Sites/svnrepos/db:
> Invalid argument
> svn: Your commit message was left in a temporary file:
> svn:    '/Users/ian/Sites/molprobity3/svn-commit.tmp'
> 
> 
> The same thing happens when I try updating:
> [ian@cobalt ~/Sites/molprobity3]% svn up
> svn: Berkeley DB error while checkpointing after Berkeley DB
> transaction for filesystem /Users/ian/Sites/svnrepos/db:
> Invalid argument
> 
> 
> After 'svnadmin recover', things get worse and this new error message persists:
> [ian@cobalt ~/Sites]% svnadmin recover svnrepos/
> Please wait; recovering the repository may take some time...
> svn: DB_RUNRECOVERY: Fatal error, run database recovery
> 


This looks like another case of issue 1968.  Can you post a tarball of
your repository for us to inspect?  Pretty please?  We'd like to figure
out what's going on.




---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: Repository destoryed at random on OS X using new DB, etc.

Posted by François Beausoleil <fb...@ftml.net>.
Hello Ian,

Ian Davis wrote:
> Somebody, please help! How do I fix this, and how can I keep it from
> happening again??

Have you tried dumping the repository ?
$ svadmin dump svnrepos/

Once you have a dump, your data'll be safe and you can try using the 
FSFS backend in 1.1.0.

Hope that helps,
François



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org