Re: Checkout really slow in Windows with lots of files in one directory

[Daniel Shahaf <d....@daniel.shahaf.name>]

Johan Corveleyn wrote on Wed, Jan 26, 2011 at 17:15:40 +0100:
> If I have more time, I'll try to search the archives some more.

If it helps your code/mail grepping, I believe you're talking about 
svn_io_open_uniquely_named().

(I found it by doing `fgrep '.%' subversion/libsvn_subr/*c`.)

Re: Checkout really slow in Windows with lots of files in one directory

[Neil Bird <ne...@jibbyjobby.co.uk>]

Around about 01/02/11 15:36, Neil Bird typed ...
> I've had no response from the email I sent him privately, so I may try that
> myself, and maybe then raise a ticket (or whatever system they use) to ask
> for the backport if it works.

   My bad, I just found Thunderbird has mis-threaded his reply.  He never 
tried it as they were using a workaround.

   I'll give it a bash myself, as our workaround is still sucking in 7+ minutes.

-- 
[neil@fnx ~]# rm -f .signature
[neil@fnx ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@fnx ~]# exit

Re: Checkout really slow in Windows with lots of files in one directory

[Neil Bird <ne...@jibbyjobby.co.uk>]

Around about 28/01/11 04:32, Daniel Shahaf typed ...
> (I don't recall why the fixes on trunk weren't backported, but I imagine
> the threads linked from this thread say why.)

   The threads (that I've see) all peter out, with the last event being some 
saying a colleague was about to compile 1.6 with that fix backported to see 
if it helped.

   I've had no response from the email I sent him privately, so I may try 
that myself, and maybe then raise a ticket (or whatever system they use) to 
ask for the backport if it works.

   There may be a good reason it can't be done (there was a 'cleaner' way 
that couldn't have been done due to it being an API change, apparently, but 
this seems to be drop-in).

-- 
[neil@fnx ~]# rm -f .signature
[neil@fnx ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@fnx ~]# exit

Re: Checkout really slow in Windows with lots of files in one directory

[Daniel Shahaf <d....@daniel.shahaf.name>]

This will probably be backported to 1.6.(x+1) if someone tells dev@ what
revisions should be backported, or provides patches that we can apply. 

(I don't recall why the fixes on trunk weren't backported, but I imagine
the threads linked from this thread say why.)

Neil Bird wrote on Thu, Jan 27, 2011 at 08:23:50 +0000:
> Around about 27/01/11 01:40, Johan Corveleyn typed ...
>> http://svn.haxx.se/dev/archive-2010-04/0180.shtml
>>
>> Maybe someone else can comment more on this, and why it wasn't
>> backported to 1.6 (or is it?).
>
>   Excellent, yes, that would seem to be it.  I did notice the huge number 
> of counted .tmp files in .svn/tmp but didn't think anything of it.
>
>   The thread petered out with someone trying the 1.7  
> svn_io_open_unique_file impl. in a 1.6 build, but I can't see any 
> feedback from that (so I'm afraid I'm going to cheekily Cc: the guys who 
> posted that that was being tried!).
>
>
>   For now, I think I'm happy to simply be aware of the situation;  as I  
> posted earlier, we're going to split the files up across a no. of diff.  
> dirs. so hopefully that won't bite us.
>
>   If we are still suffering even after that, I'll try the above patched  
> myself, and then maybe I'll raise a ticket.
>
> -- 
> [neil@fnx ~]# rm -f .signature
> [neil@fnx ~]# ls -l .signature
> ls: .signature: No such file or directory
> [neil@fnx ~]# exit

Re: Checkout really slow in Windows with lots of files in one directory

[Neil Bird <ne...@jibbyjobby.co.uk>]

Around about 27/01/11 01:40, Johan Corveleyn typed ...
> http://svn.haxx.se/dev/archive-2010-04/0180.shtml
>
> Maybe someone else can comment more on this, and why it wasn't
> backported to 1.6 (or is it?).

   Excellent, yes, that would seem to be it.  I did notice the huge number 
of counted .tmp files in .svn/tmp but didn't think anything of it.

   The thread petered out with someone trying the 1.7 
svn_io_open_unique_file impl. in a 1.6 build, but I can't see any feedback 
from that (so I'm afraid I'm going to cheekily Cc: the guys who posted that 
that was being tried!).


   For now, I think I'm happy to simply be aware of the situation;  as I 
posted earlier, we're going to split the files up across a no. of diff. 
dirs. so hopefully that won't bite us.

   If we are still suffering even after that, I'll try the above patched 
myself, and then maybe I'll raise a ticket.

-- 
[neil@fnx ~]# rm -f .signature
[neil@fnx ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@fnx ~]# exit

Re: Checkout really slow in Windows with lots of files in one directory

[Johan Corveleyn <jc...@gmail.com>]

On Wed, Jan 26, 2011 at 7:32 PM, Daniel Shahaf <d....@daniel.shahaf.name> wrote:
> Johan Corveleyn wrote on Wed, Jan 26, 2011 at 17:15:40 +0100:
>> If I have more time, I'll try to search the archives some more.
>
> If it helps your code/mail grepping, I believe you're talking about
> svn_io_open_uniquely_named().

Thanks, Daniel! That was exactly the search term I needed. Here is the
thread (from the dev-list) that describes exactly the same problem:

http://svn.haxx.se/dev/archive-2010-04/0180.shtml

Neil, please read that thread, and you'll see that it describes
exactly the same problem. It contains some interesting discussions and
points. As far as I understand it, it has been fixed for 1.7, but not
backported to 1.6 (backport was suggested, but the discussion ended
somewhere "in the middle").

Maybe someone else can comment more on this, and why it wasn't
backported to 1.6 (or is it?).

HTH,
-- 
Johan