You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Yoann Vandoorselaere <yo...@prelude-ids.org> on 2004/11/02 23:59:15 UTC

svn and berkeley db corruption

Hi,

After some try recovering a database with the help of people from #svn
on Freenode, they suggested me to drop a mail here thinking you might
have an insight on what to do in the current situation.

The problem started with the following error while trying to do an "svn
update":

svn: Berkeley DB error while opening 'copies' table for
filesystem /var/lib/svn/prelude/db: Invalid argument 

I then logged on the server, shut down every services using SVN, and ran
"svnadmin recover prelude", which gave me the same error message. 

At this point I made a backup of the problematic svn repository, and
went to #svn to gather some help.

People from #svn suggested to run: "db_recover -vech prelude"
This gave:

db_recover: Finding last valid log LSN: file: 2903 offset 385784
db_recover: Recovery starting from [1482][28]
db_recover: Recovery complete at Wed Nov  3 00:38:00 2004
db_recover: Maximum transaction ID 82e7bf52 Recovery checkpoint [2903][385784]
db_recover: Recovery complete at Wed Nov  3 00:38:00 2004
db_recover: Maximum transaction id 80000000 Recovery checkpoint [2903][385784]

But then running "svnadmin recover prelude" or "svnadmin dump prelude"
still gave the same error: 

svnadmin dump prelude > /var/tmp/prelude.dump
svn: Berkeley DB error while opening 'copies' table for filesystem prelude/db:
Invalid argument

Trying to run db_recover again, gave:

db_recover: Finding last valid log LSN: file: 1 offset 686
db_recover: Recovery starting from [1][28]
db_recover: DB_ENV->log_flush: LSN past current end-of-log
db_recover: transactions: unable to flush page: 0
db_recover: txn_checkpoint: failed to flush the buffer cache Invalid argument
db_recover: PANIC: Invalid argument
db_recover: fatal region error detected; run recovery
db_recover: DB_ENV->open: DB_RUNRECOVERY: Fatal error, run database recovery

At which point people from #svn suggested to send a mail here.

Any help would be greatly appreciated,

Thanks in advance,


Note: the system is using subversion 1.0.9 with db-4.1.
      Please CC me on reply since I am not on the list.

-- 
Yoann Vandoorselaere <yo...@prelude-ids.org>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: svn and berkeley db corruption

Posted by Yoann Vandoorselaere <yo...@prelude-ids.org>.
On Wed, 2004-11-03 at 02:15 +0100, Yoann Vandoorselaere wrote:
> On Wed, 2004-11-03 at 00:59 +0100, Yoann Vandoorselaere wrote:
> > Hi,
> > 
> > After some try recovering a database with the help of people from #svn
> > on Freenode, they suggested me to drop a mail here thinking you might
> > have an insight on what to do in the current situation.
> 
> [...]
> 
> I made a full tgz of the SVN repository available from:
> http://prelude-ids.org/prelude-svn-repo.tgz
> 
> I hope this will eventually help tracing the problem.

I tried upgrading to SVN 1.1.1 to see if that has any effect on
recovery. svnadmin recover still fail, but with the following error:

svnadmin recover prelude
Repository lock acquired.
Please wait; recovering the repository may take some time...

Recovery completed.
svn: Berkeley DB error while opening 'copies' table for filesystem prelude/db:
Invalid argument
svn: bdb: call implies an access method which is inconsistent with previous calls

> > Note: the system is using subversion 1.0.9 with db-4.1.
> >       Please CC me on reply since I am not on the list.

-- 
Yoann Vandoorselaere <yo...@prelude-ids.org>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: svn and berkeley db corruption

Posted by Odhiambo Washington <wa...@wananchi.com>.
* Max Bowsher <ma...@ukf.net> [20041104 15:44]: wrote:
> Yoann Vandoorselaere wrote:
> >On Wed, 2004-11-03 at 00:59 +0100, Yoann Vandoorselaere wrote:
> >>Hi,
> >>
> >>After some try recovering a database with the help of people from #svn
> >>on Freenode, they suggested me to drop a mail here thinking you might
> >>have an insight on what to do in the current situation.
> >
> >[...]
> >
> >I made a full tgz of the SVN repository available from:
> >http://prelude-ids.org/prelude-svn-repo.tgz
> >
> >I hope this will eventually help tracing the problem.
> 
> I recovered Yoann's repository.
> 
> For anyone interested, this was the "copies table type field corrupted from 
> btree to recno for no apparent reason" bug.

New bug in the wild? ;)
Please tell us (newbies) how you did it.

BTW, kindly point me towards some scripts for making backups of
repositories.




        cheers
       - wash 
+----------------------------------+-----------------------------------------+
Odhiambo Washington                     . WANANCHI ONLINE LTD (Nairobi, KE)  |
<wash at wananchi dot com>              . 1ere Etage, Loita Hse, Loita St.,  |
GSM: (+254) 722 743 223                 . # 10286, 00100 NAIROBI             |
GSM: (+254) 733 744 121                 . (+254) 020 313 985 - 9             |
+---------------------------------+------------------------------------------+
"Oh My God! They killed init! You Bastards!"  
						 --from a /. post

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: svn and berkeley db corruption

Posted by Ben Collins-Sussman <su...@collab.net>.
On Nov 4, 2004, at 6:41 AM, Max Bowsher wrote:
>
> I recovered Yoann's repository.
>
> For anyone interested, this was the "copies table type field corrupted 
> from btree to recno for no apparent reason" bug.
>

This was the bug that seemed to happen all the time with db 4.1, 
especially on OS X.  And sure enough, this is exactly what Yoann was 
using.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: svn and berkeley db corruption

Posted by Max Bowsher <ma...@ukf.net>.
Yoann Vandoorselaere wrote:
> On Wed, 2004-11-03 at 00:59 +0100, Yoann Vandoorselaere wrote:
>> Hi,
>>
>> After some try recovering a database with the help of people from #svn
>> on Freenode, they suggested me to drop a mail here thinking you might
>> have an insight on what to do in the current situation.
>
> [...]
>
> I made a full tgz of the SVN repository available from:
> http://prelude-ids.org/prelude-svn-repo.tgz
>
> I hope this will eventually help tracing the problem.

I recovered Yoann's repository.

For anyone interested, this was the "copies table type field corrupted from 
btree to recno for no apparent reason" bug.

Max.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: svn and berkeley db corruption

Posted by Yoann Vandoorselaere <yo...@prelude-ids.org>.
On Wed, 2004-11-03 at 00:59 +0100, Yoann Vandoorselaere wrote:
> Hi,
> 
> After some try recovering a database with the help of people from #svn
> on Freenode, they suggested me to drop a mail here thinking you might
> have an insight on what to do in the current situation.

[...]

I made a full tgz of the SVN repository available from:
http://prelude-ids.org/prelude-svn-repo.tgz

I hope this will eventually help tracing the problem.

Thanks,

> Note: the system is using subversion 1.0.9 with db-4.1.
>       Please CC me on reply since I am not on the list.

-- 
Yoann Vandoorselaere <yo...@prelude-ids.org>


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org