problems with large repository

[Alfonso Urdaneta <AU...@indra-systems.com>]

So I was able to talk my company into trying out subversion, and so I
appear to be having issues.  Our reposotiry is going to be something
like 50k files.  I'm partially through testing, and as of right now, I
have about 16k / 400M worth of files checked in to svn.  Note that this
is less than 1/3 of what I intend to put in there, which is why I am
very concerned about scaling issues.

For some reason, I am unable to do a full checkout.  I know that it is
not a network issue, as my test machine and server are on their own hub,
isolated from the network.  Checkouts fail, and when I do a cleanup, I
get errors along the lines of

C:\code\h60_fast\indra>svn cleanup
svn: In directory 'JSAF4\trunk\libsrc\libphysdb\physdb_data'
svn: Error processing command 'modify-wcprop' in
'JSAF4\trunk\libsrc\libphysdb\p
hysdb_data'
svn: 'JSAF4\trunk\libsrc\libphysdb\physdb_data\vehicle_US_LCU.rdr' is
not under
version control

even though I can clearly see the file under viewvc.  

Server is linux, client is windows, I am running the command line svn
client, not the tortoise one.

Suggestions ?

--
alfonso e. urdaneta
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

This e-mail and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom
they are addressed.
If you have received this e-mail in error please notify the
originator of the message. This footer also confirms that this
e-mail message has been scanned for the presence of computer viruses.

Any views expressed in this message are those of the individual
sender, except where the sender specifies and with authority,
states them to be the views of Indra Systems, Inc.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: problems with large repository

[Talden <ta...@gmail.com>]

Be sure that the problem isn't a path length limitation on the client
file-system.  This one's bitten me before.  Windows may not be able to
create the file because the total path-length is longer than the
windows limit.

--
Talden

On 30/11/06, Alfonso Urdaneta <AU...@indra-systems.com> wrote:
> So I was able to talk my company into trying out subversion, and so I
> appear to be having issues.  Our reposotiry is going to be something
> like 50k files.  I'm partially through testing, and as of right now, I
> have about 16k / 400M worth of files checked in to svn.  Note that this
> is less than 1/3 of what I intend to put in there, which is why I am
> very concerned about scaling issues.
>
> For some reason, I am unable to do a full checkout.  I know that it is
> not a network issue, as my test machine and server are on their own hub,
> isolated from the network.  Checkouts fail, and when I do a cleanup, I
> get errors along the lines of
>
> C:\code\h60_fast\indra>svn cleanup
> svn: In directory 'JSAF4\trunk\libsrc\libphysdb\physdb_data'
> svn: Error processing command 'modify-wcprop' in
> 'JSAF4\trunk\libsrc\libphysdb\p
> hysdb_data'
> svn: 'JSAF4\trunk\libsrc\libphysdb\physdb_data\vehicle_US_LCU.rdr' is
> not under
> version control
>
> even though I can clearly see the file under viewvc.
>
> Server is linux, client is windows, I am running the command line svn
> client, not the tortoise one.
>
> Suggestions ?
>
> --
> alfonso e. urdaneta
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
>
> This e-mail and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom
> they are addressed.
> If you have received this e-mail in error please notify the
> originator of the message. This footer also confirms that this
> e-mail message has been scanned for the presence of computer viruses.
>
> Any views expressed in this message are those of the individual
> sender, except where the sender specifies and with authority,
> states them to be the views of Indra Systems, Inc.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: problems with large repository

[Nathan Kidd <na...@spicycrypto.ca>]

Alfonso Urdaneta wrote:
> ...as of right now, I have about 16k / 400M worth of files checked in
> to svn.  Note that this is less than 1/3 of what I intend to put in
> there, which is why I am very concerned about scaling issues.

We regularly have working copies in the 25k file/500MB range, and have
never had problems.  Other people have much larger repositories.  I 
don't think your issue is related to any inherent scaling issue in 
Subversion.

> Checkouts fail,

How do they fail?  What is the error message?  Does it always fail at
the same point, on the same file?

> and when I do a cleanup, I get errors along the lines of 
> C:\code\h60_fast\indra>svn cleanup svn: In directory
> 'JSAF4\trunk\libsrc\libphysdb\physdb_data' svn: Error processing
> command 'modify-wcprop' in 'JSAF4\trunk\libsrc\libphysdb\p 
> hysdb_data' svn:
> 'JSAF4\trunk\libsrc\libphysdb\physdb_data\vehicle_US_LCU.rdr' is not
> under version control
> 
> even though I can clearly see the file under viewvc.

A cleanup error message has to do with a broken working copy and isn't 
related to the repository itself.  Did the svn checkout actually crash? 
  Unless it crashed hard I don't think it should ever leave the working 
copy in a broken state. But then unless you're using 1.4.2 client maybe 
it is a bug that's already been fixed.

> Server is linux, client is windows, I am running the command line svn
>  client, not the tortoise one.

What OS versions on server and client?
What version of svn are you running on the server and client?  Did you 
build them yourself or are they the stock/distro binaries?
What server type (svnserve or apache)?  What backend (fsfs or bdb)?

-Nathan

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org

Re: problems with large repository

[Ryan Schmidt <su...@ryandesign.com>]

On Nov 29, 2006, at 09:17, Alfonso Urdaneta wrote:

> So I was able to talk my company into trying out subversion, and so I
> appear to be having issues.  Our reposotiry is going to be something
> like 50k files.  I'm partially through testing, and as of right now, I
> have about 16k / 400M worth of files checked in to svn.  Note that  
> this
> is less than 1/3 of what I intend to put in there, which is why I am
> very concerned about scaling issues.
>
> For some reason, I am unable to do a full checkout.  I know that it is
> not a network issue, as my test machine and server are on their own  
> hub,
> isolated from the network.  Checkouts fail,

In what way do checkouts fail? What error message appears? Do you get  
the same message if you check out just a part of the repository? Is  
it just one section of the repository that displays this error when  
you check it out?


> and when I do a cleanup, I get errors along the lines of
>
> C:\code\h60_fast\indra>svn cleanup
> svn: In directory 'JSAF4\trunk\libsrc\libphysdb\physdb_data'
> svn: Error processing command 'modify-wcprop' in
> 'JSAF4\trunk\libsrc\libphysdb\p
> hysdb_data'
> svn: 'JSAF4\trunk\libsrc\libphysdb\physdb_data\vehicle_US_LCU.rdr' is
> not under
> version control
>
> even though I can clearly see the file under viewvc.
>
> Server is linux, client is windows, I am running the command line svn
> client, not the tortoise one.

Do you have a case collision here -- two files in the repository  
whose names differ only in case, for example like  
"vehicle_US_LCU.rdr" and "vehicle_us_lcu.rdr"? Subversion's case- 
sensitive file system has no problem storing two such files, but  
Windows' case-insensitive file system cannot have both of these files  
in the same directory. Subversion does not display very useful error  
messages in case this situation comes about. If this is the situation  
you have, then decide whether you really need both of these files. If  
not, delete the one you don't need (by using direct repository URLs  
-- "svn rm url://to/server/.../physdb_data/vehicle_us_lcu.rdr"). If  
you do need both, and you need them both to be in the same directory,  
then you cannot check out on Windows (or the default Mac OS X file  
system either). This is not a problem of Subversion, but of the file  
system you're using on the client.


-- 
To reply to the mailing list, use your mailer's Reply To All function


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org