You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@subversion.apache.org by Kevin Radke <km...@gmail.com> on 2009/10/21 15:28:28 UTC
Re: [PATCH] Stop leaking RA connections for each referenced
svn:external in an update
(Sorry for the top post, but I wasn't sure I should put a new in-line
diff into the actual conversation)
Here is a new "svn diff" patch with the missed iter_pool for the uuid2 call...
[[[
Use iter_pool instead of pool to avoid leaving RA connections open
until process exit for each svn:external.
*subversion/libsvn_client/externals.c
]]]
Index: subversion/libsvn_client/externals.c
===================================================================
--- subversion/libsvn_client/externals.c (revision 40148)
+++ subversion/libsvn_client/externals.c (working copy)
@@ -776,13 +776,14 @@
new_item->url, NULL,
&(new_item->peg_revision),
&(new_item->revision), ib->ctx,
- ib->pool));
+ ib->iter_pool));
- SVN_ERR(svn_ra_get_uuid2(ra_session, &ra_cache.repos_uuid, ib->pool));
+ SVN_ERR(svn_ra_get_uuid2(ra_session, &ra_cache.repos_uuid,
+ ib->iter_pool));
SVN_ERR(svn_ra_get_repos_root2(ra_session, &ra_cache.repos_root_url,
- ib->pool));
+ ib->iter_pool));
SVN_ERR(svn_ra_check_path(ra_session, "", ra_cache.ra_revnum, &kind,
- ib->pool));
+ ib->iter_pool));
if (svn_node_none == kind)
return svn_error_createf(SVN_ERR_RA_ILLEGAL_URL, NULL,
On Wed, Oct 21, 2009 at 10:18 AM, Stefan Sperling <st...@elego.de> wrote:
> On Wed, Oct 21, 2009 at 10:07:26AM -0500, Kevin Radke wrote:
>> Subversion is leaking RA connections (TCP connections) for each
>> svn:external referenced during a checkout/update. This patch fixes
>> that by using the iter_pool in the loop instead of the global pool
>> which is only cleaned up at process exit. With this applied, an svn
>> update with thousands of externals no longer keeps thousands of TCP
>> connections in the CLOSE_WAIT state on the client and FIN_WAIT_2 state
>> on the server.
>>
>> This problem causes Windows XP SP3 to appear to lock up, the svn
>> update to fail, and typically disconnects current network connections
>> when Subversion uses more than around 500 connections. Linux appears
>> to successfully complete the update, but uses a large amount of
>> resources. (netstat -t | grep CLOSE_WAIT | wc -l)
>>
>> This is a simple patch, so I am attaching it inline. I believe it
>> should be back ported to the 1.6.x release since that is where I
>> observed the problem.
>
> Nice, thanks!
>
>> Kevin R.
>>
>> [[[
>> Use iter_pool instead of pool to avoid leaving RA connections open
>> until process exit for each svn:external.
>>
>> *subversion/libsvn_client/externals.c
>> ]]]
>
> Please use diff -u (or svn diff) to create patches in the future.
>
>> *** subversion/libsvn_client/externals.c.orig 2009-10-21
>> 09:45:19.000000000 -0500
>> --- subversion/libsvn_client/externals.c 2009-10-21 09:45:45.000000000 -0500
>> ***************
>> *** 776,788 ****
>> new_item->url, NULL,
>> &(new_item->peg_revision),
>> &(new_item->revision), ib->ctx,
>> ! ib->pool));
>>
>> SVN_ERR(svn_ra_get_uuid2(ra_session, &ra_cache.repos_uuid, ib->pool));
>> SVN_ERR(svn_ra_get_repos_root2(ra_session, &ra_cache.repos_root_url,
>> ! ib->pool));
>> SVN_ERR(svn_ra_check_path(ra_session, "", ra_cache.ra_revnum, &kind,
>> ! ib->pool));
>>
>> if (svn_node_none == kind)
>> return svn_error_createf(SVN_ERR_RA_ILLEGAL_URL, NULL,
>> --- 776,788 ----
>> new_item->url, NULL,
>> &(new_item->peg_revision),
>> &(new_item->revision), ib->ctx,
>> ! ib->iter_pool));
>>
>> SVN_ERR(svn_ra_get_uuid2(ra_session, &ra_cache.repos_uuid, ib->pool));
>
> Why not also put the repos_uuid into the iterpool?
>
> Stefan
>
>> SVN_ERR(svn_ra_get_repos_root2(ra_session, &ra_cache.repos_root_url,
>> ! ib->iter_pool));
>> SVN_ERR(svn_ra_check_path(ra_session, "", ra_cache.ra_revnum, &kind,
>> ! ib->iter_pool));
>>
>> if (svn_node_none == kind)
>> return svn_error_createf(SVN_ERR_RA_ILLEGAL_URL, NULL,
>>
>> ------------------------------------------------------
>> http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=2409821
>
> --
> printf("Eh???/n");
>
------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=2409831
Re: [PATCH] Stop leaking RA connections for each referenced
svn:external in an update
Posted by Kevin Radke <km...@gmail.com>.
On Wed, Oct 21, 2009 at 11:05 AM, Stefan Sperling <st...@elego.de> wrote:
> On Wed, Oct 21, 2009 at 10:28:28AM -0500, Kevin Radke wrote:
>> (Sorry for the top post, but I wasn't sure I should put a new in-line
>> diff into the actual conversation)
>>
>>
>> Here is a new "svn diff" patch with the missed iter_pool for the uuid2 call...
>
> Thanks, r40152.
>
> BTW this was filed some time ago as issue #3487.
> http://subversion.tigris.org/issues/show_bug.cgi?id=3487
I originally thought it might be related to #1448, but that one has
been open since 2003 and the code I changed was a fairly recent
addition for file level externals...
Kevin R.
------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=2409852
Re: [PATCH] Stop leaking RA connections for each referenced
svn:external in an update
Posted by Stefan Sperling <st...@elego.de>.
On Wed, Oct 21, 2009 at 10:28:28AM -0500, Kevin Radke wrote:
> (Sorry for the top post, but I wasn't sure I should put a new in-line
> diff into the actual conversation)
>
>
> Here is a new "svn diff" patch with the missed iter_pool for the uuid2 call...
Thanks, r40152.
BTW this was filed some time ago as issue #3487.
http://subversion.tigris.org/issues/show_bug.cgi?id=3487
Stefan
------------------------------------------------------
http://subversion.tigris.org/ds/viewMessage.do?dsForumId=462&dsMessageId=2409850