You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@subversion.apache.org by Robert Guthrie <rg...@pobox.com> on 2004/07/15 21:01:42 UTC
svn bug with HUGE files
I had a file in a directory that was 12,162,160,632 bytes in a directory
where I have svn:ignore set to '*'. The property doesn't have anything
to do with it, except that I would think that ignored files couldn't
affect svn stat and other svn commands. But it does.
$ svn stat
svn: Can't read directory 'tempdir': Partial results are valid but
processing is incomplete
After delete the file, svn stat gives me nothing, as expected, as it's a
test repository with 3 directories all commited to the repository and no
files.
So Really big files seem to make svn choke, even if they're not supposed
to be handled by svn.
Should I file this as a bug, or did I miss it in my search?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: svn bug with HUGE files
Posted by Robert Guthrie <rg...@pobox.com>.
Ben Reser wrote:
> On Thu, 15 Jul 2004 16:54:18 -0500, Robert Guthrie <rg...@pobox.com> wrote:
>
>
> Did you build APR with large file support? APR 0.9 doesn't default to
> this. Make sure that the following extra flag gets passed to the
> compiler when building APR:
> -D_FILE_OFFSET_BITS=64
No, I didn't. I'll give that a try, but why should it matter? I'm
ignoring those files, so why should it ever care how big they are?
Thanks for the tip though, I'll let you know if it fixes the issue.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: svn bug with HUGE files
Posted by Ben Reser <br...@gmail.com>.
On Thu, 15 Jul 2004 16:54:18 -0500, Robert Guthrie <rg...@pobox.com> wrote:
> Well, my experiment was with
> 1. a repository that I created for the purpose of testing
> 2. a working copy that I checked out under userid "rguthr"
> 3. a copy of the huge file in question, which I copied with the "rguthr"
> user.
>
> But, just to make sure I'm not crazy....
>
> rguthr $> ls -l . tempdir
> .:
> total 0
> drwxr-s--- 3 rguthr cmt 256 Jul 15 16:46 tempdir/
>
> tempdir:
> total 23754400
> -rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile1
> -rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile2
> -rw-r----- 1 rguthr cmt 12162160632 Jul 15 16:42 reallybigfile
>
> rguthr $> svn stat
> svn: Can't read directory 'tempdir': Partial results are valid but
> processing is incomplete
> rguthr $> rm tempdir/reallybigfile
> rguthr $> svn stat # no response, because svn:ignore '*' on tempdir
> rguthr $> whoami
> rguthr
>
> ... so the empty files, and just about any other reasonablly sized ones
> seem not to cause this problem. Just outlandishly huge ones.
> Unfortunately, we end up with really huge files all the time here, but
> really, this shouldn't be a problem for subversion, should it?
Did you build APR with large file support? APR 0.9 doesn't default to
this. Make sure that the following extra flag gets passed to the
compiler when building APR:
-D_FILE_OFFSET_BITS=64
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: svn bug with HUGE files
Posted by Robert Guthrie <rg...@pobox.com>.
By the way, I'm running statically linked versions of svnadmin and svn
(client) from 1.1.0 rc1, though the same problem appeared before (I
believe) with v1.0.x.
If there's any other detail or experiments I can do, please let me know.
Robert Guthrie wrote:
> Ben Collins-Sussman wrote:
>
>> On Thu, 2004-07-15 at 16:01, Robert Guthrie wrote:
>>
>>> $ svn stat
>>> svn: Can't read directory 'tempdir': Partial results are valid but
>>> processing is incomplete
>>
>>
>>
>> Aren't you the guy who was posting earlier about sharing a working copy,
>> and didn't you post the exact same error message?
>
>
> Yes, I am. Sorry, I should have concluded that thread...
>
>>
>> In both cases, that error smells like a permission issue. How about
>> showing us an 'ls -l' of the directory? Perhaps you had write access to
>> the dir, but not read access to the huge file?
>
>
> Well, my experiment was with
> 1. a repository that I created for the purpose of testing
> 2. a working copy that I checked out under userid "rguthr"
> 3. a copy of the huge file in question, which I copied with the "rguthr"
> user.
>
> But, just to make sure I'm not crazy....
>
> rguthr $> ls -l . tempdir
> .:
> total 0
> drwxr-s--- 3 rguthr cmt 256 Jul 15 16:46 tempdir/
>
> tempdir:
> total 23754400
> -rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile1
> -rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile2
> -rw-r----- 1 rguthr cmt 12162160632 Jul 15 16:42 reallybigfile
>
> rguthr $> svn stat
> svn: Can't read directory 'tempdir': Partial results are valid but
> processing is incomplete
> rguthr $> rm tempdir/reallybigfile
> rguthr $> svn stat # no response, because svn:ignore '*' on tempdir
> rguthr $> whoami
> rguthr
>
>
> ... so the empty files, and just about any other reasonablly sized ones
> seem not to cause this problem. Just outlandishly huge ones.
> Unfortunately, we end up with really huge files all the time here, but
> really, this shouldn't be a problem for subversion, should it?
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
> For additional commands, e-mail: users-help@subversion.tigris.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: svn bug with HUGE files
Posted by Robert Guthrie <rg...@pobox.com>.
Ben Collins-Sussman wrote:
> On Thu, 2004-07-15 at 16:01, Robert Guthrie wrote:
>>$ svn stat
>>svn: Can't read directory 'tempdir': Partial results are valid but
>>processing is incomplete
>
>
> Aren't you the guy who was posting earlier about sharing a working copy,
> and didn't you post the exact same error message?
Yes, I am. Sorry, I should have concluded that thread...
>
> In both cases, that error smells like a permission issue. How about
> showing us an 'ls -l' of the directory? Perhaps you had write access to
> the dir, but not read access to the huge file?
Well, my experiment was with
1. a repository that I created for the purpose of testing
2. a working copy that I checked out under userid "rguthr"
3. a copy of the huge file in question, which I copied with the "rguthr"
user.
But, just to make sure I'm not crazy....
rguthr $> ls -l . tempdir
.:
total 0
drwxr-s--- 3 rguthr cmt 256 Jul 15 16:46 tempdir/
tempdir:
total 23754400
-rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile1
-rw-r----- 1 rguthr cmt 0 Jul 15 16:46 emptyfile2
-rw-r----- 1 rguthr cmt 12162160632 Jul 15 16:42 reallybigfile
rguthr $> svn stat
svn: Can't read directory 'tempdir': Partial results are valid but
processing is incomplete
rguthr $> rm tempdir/reallybigfile
rguthr $> svn stat # no response, because svn:ignore '*' on tempdir
rguthr $> whoami
rguthr
... so the empty files, and just about any other reasonablly sized ones
seem not to cause this problem. Just outlandishly huge ones.
Unfortunately, we end up with really huge files all the time here, but
really, this shouldn't be a problem for subversion, should it?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org
Re: svn bug with HUGE files
Posted by Ben Collins-Sussman <su...@collab.net>.
On Thu, 2004-07-15 at 16:01, Robert Guthrie wrote:
> I had a file in a directory that was 12,162,160,632 bytes in a directory
> where I have svn:ignore set to '*'. The property doesn't have anything
> to do with it, except that I would think that ignored files couldn't
> affect svn stat and other svn commands. But it does.
>
>
> $ svn stat
> svn: Can't read directory 'tempdir': Partial results are valid but
> processing is incomplete
Aren't you the guy who was posting earlier about sharing a working copy,
and didn't you post the exact same error message?
In both cases, that error smells like a permission issue. How about
showing us an 'ls -l' of the directory? Perhaps you had write access to
the dir, but not read access to the huge file?
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@subversion.tigris.org
For additional commands, e-mail: users-help@subversion.tigris.org