Apache/mod_dav_svn.so failing on large directories on Windows?

[Arild Fines <ar...@broadpark.no>]

Env: Debug builds of both apache and mod_dav_svn.so on Windows XP.

I have a large repository consisting of 700+ small files(mostly pickled
Python objects) in one single directory. Trying to check out that directory
through Apache causes Apache to consume massive amounts of memory(I have
seen it go up to 7-800 megs in the Task Manager before I managed to kill the
process), and eventually the svn client fails with the following
message(this is of course if I do not kill Apache first):

j:\subversion\subversion\libsvn_ra_dav\fetch.c:1014
svn_error: #21096 : <RA layer request failed>
  could not fetch directory entries

j:\subversion\subversion\libsvn_ra_dav\util.c:81
svn_error: #21096 : <RA layer request failed>
  PROPFIND of /svn/rogiefaq/!svn/bc/1/: Could not read chunk size: Line too
long

The message "Could not read chunk size: Line too long" seems to originate
from Neon, not from svn code.

After doing a little experimentation, it seems that the breaking point is
somewhere between 400 and 450 files in a single directory. Other
repositories with a lot more files than this, but spread out over several
directories, seem to work fine.
Even for successfull checkouts Apache seems to consume an excessive amount
of memory; 100-200 megs seem to be the norm.
So - am I missing something here?

Arild Fines



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org

Re: Apache/mod_dav_svn.so failing on large directories on Windows?

[Justin Erenkrantz <je...@apache.org>]

On Sat, Jun 29, 2002 at 09:14:26PM +0200, Arild Fines wrote:
> j:\subversion\subversion\libsvn_ra_dav\fetch.c:1014
> svn_error: #21096 : <RA layer request failed>
>   could not fetch directory entries
> 
> j:\subversion\subversion\libsvn_ra_dav\util.c:81
> svn_error: #21096 : <RA layer request failed>
>   PROPFIND of /svn/rogiefaq/!svn/bc/1/: Could not read chunk size: Line too
> long
> 
> The message "Could not read chunk size: Line too long" seems to originate
> from Neon, not from svn code.

Nah, this looks like an httpd error code.  Can you get a network
trace?  If SVN is sending really long lines, we should fix that.
I'm guessing that it might be sending all files in a directory on
a single line.  If so, we should be mime-continuing the line
(' ' or '\t' at the beginning of the line) once it reaches a
certain length.

If you can provide the HTTP headers used in this case, that
should be sufficient to point me in the right direction.  -- justin

P.S.  Why am I suddenly getting all of the SVN mail now?  It seems
there was a backlog.  It's either on apache.org or svn.collab.net
and they share the same admins.  =)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@subversion.tigris.org
For additional commands, e-mail: dev-help@subversion.tigris.org