You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Pierre-Charles David <pi...@wanadoo.fr> on 2005/06/22 16:58:34 UTC
Client failing in presence of huge files (> 2GB)
Hi.
The svn client stops working correctly when a huge file is present in
the current directory, even if the said file is not managed by svn.
Steps to reproduce:
~/tmp$ svnadmin create repo
~/tmp$ svn co file://$PWD/repo t
~/tmp$ cd t
~/tmp/t$ dd if=/dev/zero of=huge count=1 seek=4M
~/tmp/t$ ls -lh
-rw-r--r-- 1 pcdavid pcdavid 2,1G 2005-06-22 18:43 huge
~/tmp/t$ svn status -v
svn: Can't read directory '.': Partial results are valid but processing
is incomplete
This happens with:
- svn, version 1.1.1 (r11581) [version included in Ubuntu Hoary]
- svn, version 1.2.0 (r14790) [locally compiled and installed]
Note that it works OK with a 1G file, or if the file is inside a
directory which is itself not managed by svn.
I don't know if it's relevant, but the underlying filesystem is
ReiserFS3 under Linux 2.6.10.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Client failing in presence of huge files (> 2GB)
Posted by Ben Collins-Sussman <su...@collab.net>.
On Jun 22, 2005, at 7:49 PM, David Ripton wrote:
>
> So it appears the problem is automatically fixed, if you run a new
> enough
> version of apr.
>
Yes, apr < 1.0 doesn't support largefiles unless you configure it to
do so. apr >=1.0 supports largefiles automatically.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Client failing in presence of huge files (> 2GB)
Posted by David Ripton <dr...@ripton.net>.
On 2005.06.22 13:12:15 +0000, kfogel@collab.net wrote:
> Pierre-Charles David <pi...@wanadoo.fr> writes:
> > The svn client stops working correctly when a huge file is present in
> > the current directory, even if the said file is not managed by svn.
> >
> > Steps to reproduce:
> >
> > ~/tmp$ svnadmin create repo
> > ~/tmp$ svn co file://$PWD/repo t
> > ~/tmp$ cd t
> > ~/tmp/t$ dd if=/dev/zero of=huge count=1 seek=4M
> > ~/tmp/t$ ls -lh
> > -rw-r--r-- 1 pcdavid pcdavid 2,1G 2005-06-22 18:43 huge
> > ~/tmp/t$ svn status -v
> > svn: Can't read directory '.': Partial results are valid but processing
> > is incomplete
> >
> > This happens with:
> > - svn, version 1.1.1 (r11581) [version included in Ubuntu Hoary]
> > - svn, version 1.2.0 (r14790) [locally compiled and installed]
> >
> > Note that it works OK with a 1G file, or if the file is inside a
> > directory which is itself not managed by svn.
> >
> > I don't know if it's relevant, but the underlying filesystem is
> > ReiserFS3 under Linux 2.6.10.
>
> Hmmm, you may have to rebuilt against an APR compiled with largefile
> support ("-DLARGEFILE", maybe? not sure).
Another data point:
1. I can reproduce the problem with svn 1.2.0 on x86 Gentoo Linux, from
the stock ebuild. Different error message:
$ /usr/bin/svn st
svn: Can't check path 'huge': Value too large for defined data type
2. svn 1.2.0 on amd64 Gentoo (with everything compiled 64-bit) works
fine, as you'd expect.
3. I recompiled apr 1.1.1 + apr-util 1.1.2 + svn latest trunk by hand on
the x86 Gentoo box, and it worked. There were lots of -D_LARGEFILE64
args to gcc flying around, even though I did *not* explicitly pass
anything special to ./configure asking for large file support. It
appears that large file support is now the default, and you have to say
--disable-lfs if you don't want it.
So it appears the problem is automatically fixed, if you run a new enough
version of apr.
For older apr versions you probably need to find the magic argument to
apr's ./configure to turn on large file support. The changelog and the
code both recommend not turning this on in 0.9.6, so maybe you're better
off upgrading apr.
--
David Ripton dripton@ripton.net
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: Client failing in presence of huge files (> 2GB)
Posted by kf...@collab.net.
Pierre-Charles David <pi...@wanadoo.fr> writes:
> The svn client stops working correctly when a huge file is present in
> the current directory, even if the said file is not managed by svn.
>
> Steps to reproduce:
>
> ~/tmp$ svnadmin create repo
> ~/tmp$ svn co file://$PWD/repo t
> ~/tmp$ cd t
> ~/tmp/t$ dd if=/dev/zero of=huge count=1 seek=4M
> ~/tmp/t$ ls -lh
> -rw-r--r-- 1 pcdavid pcdavid 2,1G 2005-06-22 18:43 huge
> ~/tmp/t$ svn status -v
> svn: Can't read directory '.': Partial results are valid but processing
> is incomplete
>
> This happens with:
> - svn, version 1.1.1 (r11581) [version included in Ubuntu Hoary]
> - svn, version 1.2.0 (r14790) [locally compiled and installed]
>
> Note that it works OK with a 1G file, or if the file is inside a
> directory which is itself not managed by svn.
>
> I don't know if it's relevant, but the underlying filesystem is
> ReiserFS3 under Linux 2.6.10.
Hmmm, you may have to rebuilt against an APR compiled with largefile
support ("-DLARGEFILE", maybe? not sure).
We really need a FAQ item about this; if you do rebuild, would you
consider writing one? If so, send it as a patch to the dev@ list,
putting "[PATCH]" in the subject line. Further hints available at
http://subversion.tigris.org/mailing-list-guidelines.html#patches.
Good luck,
-Karl
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org