You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by Rob Wilkerson <r....@gmail.com> on 2006/08/22 00:04:17 UTC

[users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

All -

I know this is somewhat off-topic and I apologize for that, but I'm
not having any luck on the Subversion mailing list so I thought I'd
ask the question from this end and see if someone can give me any
suggestions on where to look and/or possible causes.

I'm trying to commit a large code base merge using Subversion over
HTTP through Apache 2.2.2.  The commit seems to be rolling along
nicely when suddenly it simply fails with a message that it could not
connect to the server.  The Apache error and access logs
(/var/log/httpd/error_log and /var/log/httpd/access_log) give no
indication that it was even aware of the transaction, much less that
it failed.  Smaller commits, on the other hand, work fine.

I've tried - at the suggestion of a member of the Subversion mailing
list - to disable the XML request body checking (LimitXMLRequestBody
0), but that made no difference at all.  Are there any other
directives that might prevent a connection from being severed?  Is
there any way to be sure that it's apache severing the connection?
Can any other process sever an HTTP connection?

I'm running:
FC5
Apache 2.2.2
SELinux is disabled
Subversion 1.3.2
mod_python 3.2.8
(I think those are all of the relevant line items)

Again, I apologize if this is too far off-topic, but I'm desperate.  I
had to at least give it a shot.

Thanks.

-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
I don't know what to say, then.  As soon as I turned it on the commit
I've been trying to complete for 2 days worked.  And then I did
another one.  I guess I'll have to see how it holds up over time.  For
now, at least, I'm the only one accessing this server.  I'll be
opening it up to my other developers this week, though.  that will be
the real test.

Thanks.

On 8/22/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/22/06, Rob Wilkerson <r....@gmail.com> wrote:
> > Well, I found the problem, Joshua, and I'm hoping you (or someone) can
> > help me understand it a little better.  I dug through my httpd.conf
> > file and saw that the KeepAlive directive was set to Off so I turned
> > it on.
> >
> > That seems quite logical, but I'd like to understand it better in a
> > practical example.  I read the docs, but they didn't really tell me
> > how it applies to my situation (or maybe I'm just too dense to get
> > it).
> >
> > Can someone help me understand what that setting does and how it works?
>
> Well, it is explained here:
> http://httpd.apache.org/docs/2.2/mod/core.html#keepalive
>
> But it shouldn't have anything directly to do with your problem.  More
> likely, there is some network problem that is triggered by the massive
> number of connections that svn is making to apache.  Perhaps it is
> triggering an Anti-DoS rule someplace.  Turning KeepAlive on allows
> the same requests to be made with fewer separate connections.
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Joshua Slive <jo...@slive.ca>.
On 8/22/06, Rob Wilkerson <r....@gmail.com> wrote:
> Well, I found the problem, Joshua, and I'm hoping you (or someone) can
> help me understand it a little better.  I dug through my httpd.conf
> file and saw that the KeepAlive directive was set to Off so I turned
> it on.
>
> That seems quite logical, but I'd like to understand it better in a
> practical example.  I read the docs, but they didn't really tell me
> how it applies to my situation (or maybe I'm just too dense to get
> it).
>
> Can someone help me understand what that setting does and how it works?

Well, it is explained here:
http://httpd.apache.org/docs/2.2/mod/core.html#keepalive

But it shouldn't have anything directly to do with your problem.  More
likely, there is some network problem that is triggered by the massive
number of connections that svn is making to apache.  Perhaps it is
triggering an Anti-DoS rule someplace.  Turning KeepAlive on allows
the same requests to be made with fewer separate connections.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
Well, I found the problem, Joshua, and I'm hoping you (or someone) can
help me understand it a little better.  I dug through my httpd.conf
file and saw that the KeepAlive directive was set to Off so I turned
it on.

That seems quite logical, but I'd like to understand it better in a
practical example.  I read the docs, but they didn't really tell me
how it applies to my situation (or maybe I'm just too dense to get
it).

Can someone help me understand what that setting does and how it works?

Thanks.

On 8/21/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> > That's the thing...I don't see anything.  I'm not a server guy, but
> > there just doesn't seem to be anything to see.  There's the error
> > message on the client side, but nothing to support it in any log file
> > I know of or can find.  I've pasted the end of a tail -f I just ran
> > while attempting another commit:
>
> Well, you'll need to look at the network trace.
>
> You should also try committing from a different client to see if that
> is the problem.
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Joshua Slive <jo...@slive.ca>.
On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> That's the thing...I don't see anything.  I'm not a server guy, but
> there just doesn't seem to be anything to see.  There's the error
> message on the client side, but nothing to support it in any log file
> I know of or can find.  I've pasted the end of a tail -f I just ran
> while attempting another commit:

Well, you'll need to look at the network trace.

You should also try committing from a different client to see if that
is the problem.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
That's the thing...I don't see anything.  I'm not a server guy, but
there just doesn't seem to be anything to see.  There's the error
message on the client side, but nothing to support it in any log file
I know of or can find.  I've pasted the end of a tail -f I just ran
while attempting another commit:

172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irbuttonsetcol.cfm
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irbuttonsetcol.xml
HTTP/1.1" 207 836 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/!svn/vcc/default HTTP/1.1" 207 474 "-" "SVN/1.3.2
(r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irbuttonsetcol.xml
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimage.cfm
HTTP/1.1" 207 822 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/!svn/vcc/default HTTP/1.1" 207 474 "-" "SVN/1.3.2
(r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimage.cfm
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimage.xml
HTTP/1.1" 207 822 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/!svn/vcc/default HTTP/1.1" 207 474 "-" "SVN/1.3.2
(r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimage.xml
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimagebutton.cfm
HTTP/1.1" 207 834 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/!svn/vcc/default HTTP/1.1" 207 474 "-" "SVN/1.3.2
(r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimagebutton.cfm
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimagebutton.xml
HTTP/1.1" 207 834 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/!svn/vcc/default HTTP/1.1" 207 474 "-" "SVN/1.3.2
(r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "COPY
/repos/siteexecutive/!svn/bc/67/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimagebutton.xml
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "PROPFIND
/repos/siteexecutive/branches/dev/tahoe-code-reorg/mod/addons/semod_imagerotator/classes/irimagegroup.cfm
HTTP/1.1" 207 832 "-" "SVN/1.3.2 (r19776) neon/0.25.5"
172.16.1.102 - rwilkerson [21/Aug/2006:20:23:39 -0400] "DELETE
/repos/siteexecutive/!svn/act/73cd2cf2-57af-2f4f-836d-cdef56e365d3
HTTP/1.1" 204 - "-" "SVN/1.3.2 (r19776) neon/0.25.5"

Nothing in there looks like an error to me.  Or maybe I just can't see
it any more.

On 8/21/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> > I just ran a tail -f on the Apache access_log while attempting the
> > commit and it's definitely logging requests.  A lot of them.  And then
> > it just stops.  The server reports no error (at least not in the logs
> > I've checked), but the client does.  Could something else be
> > terminating the connection?
>
> Now we're getting back into the real of probable subversion problems.
>
> There is no "connection" as such that exists through the entire
> commit.  Each request/response is independent when viewed from the
> webserver.  So there is probably an error occuring on one of the
> requests that is causing the whole commit to fail.  Do you see errors
> in any of the requests in the access log?  Is there anything in the
> error log?
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Joshua Slive <jo...@slive.ca>.
On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> I just ran a tail -f on the Apache access_log while attempting the
> commit and it's definitely logging requests.  A lot of them.  And then
> it just stops.  The server reports no error (at least not in the logs
> I've checked), but the client does.  Could something else be
> terminating the connection?

Now we're getting back into the real of probable subversion problems.

There is no "connection" as such that exists through the entire
commit.  Each request/response is independent when viewed from the
webserver.  So there is probably an error occuring on one of the
requests that is causing the whole commit to fail.  Do you see errors
in any of the requests in the access log?  Is there anything in the
error log?

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
I just ran a tail -f on the Apache access_log while attempting the
commit and it's definitely logging requests.  A lot of them.  And then
it just stops.  The server reports no error (at least not in the logs
I've checked), but the client does.  Could something else be
terminating the connection?

On 8/21/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> > I'll take a look at the forensics and the packet trace.  The server is
> > on a LAN - I don't believe there are any proxies involved, but I'm not
> > the guy who has to put together the servers.  I'm just the guy that
> > has to communicate with them.  I'll ask about that.  A tracert,
> > though, shows no hops between the client and the server.
> >
> > Subversion provides atomic commits so, although I see no evidence on
> > the server side, I assume that's because the commit process failed so
> > Subversion actually committed nothing.  And, to be honest, I can't be
> > completely sure the commit fails mid-stream, but I See a lot of
> > generated output indicating the process is doing what it's supposed to
> > (adding and removing files from the repository) and then the failure
> > message.  That's what leads me to think it's a mid-stream failure.  If
> > someone who knows more than I do (should be a lot of those people
> > about) can offer another suggestion, I'm all ears.
>
> Apache logs every request it receives.  So regardless of whether the
> commit transaction fails or not, there should be stuff in the apache
> access_log.  If there is not, it indicates that either apache didn't
> receive the request at all, or that the apache process serving the
> request crashed before it could do the logging.  In the latter case,
> you would usually see a segmentation fault signalled in the error log.
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
I'll take another look, but I don't recall seeing anything that looked
out of the ordinary.  I did a tcpdump while performing a commit and
that looked okay, too, I guess.  I have no idea what a lot of it
means, but here's the summary:

username [~]$ sudo /usr/sbin/tcpdump host balt-002494 and port 80 >>
~/tcpdump.out
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 96 bytes
44502 packets captured
89010 packets received by filter
0 packets dropped by kernel

A tail on the output doesn't show anything that looks out of the
ordinary - at least not to a layman.  Just in case, though, I've
pasted it below:

18:54:35.173448 IP seprojects.mydomain.com.http >
balt-002494.mydomain.com.interactionweb: S 1002731913:1002731913(0)
ack 3899603588 win 5840 <mss 1460,nop,nop,sackOK>
18:54:35.176655 IP balt-002494.mydomain.com.interactionweb >
seprojects.mydomain.com.http: . ack 1 win 65535
18:54:35.176736 IP balt-002494.mydomain.com.interactionweb >
seprojects.mydomain.com.http: P 1:516(515) ack 1 win 65535
18:54:35.184612 IP seprojects.mydomain.com.http >
balt-002494.mydomain.com.interactionweb: . ack 516 win 6432
18:54:35.441586 IP seprojects.mydomain.com.http >
balt-002494.mydomain.com.interactionweb: P 1:306(305) ack 516 win 6432
18:54:35.441972 IP seprojects.mydomain.com.http >
balt-002494.mydomain.com.interactionweb: F 306:306(0) ack 516 win 6432
18:54:35.445499 IP balt-002494.mydomain.com.interactionweb >
seprojects.mydomain.com.http: F 516:516(0) ack 306 win 65230
18:54:35.445639 IP mydomain.sysalli.com.http >
balt-002494.mydomain.com.interactionweb: . ack 517 win 6432
18:54:35.445515 IP balt-002494.mydomain.com.interactionweb >
seprojects.mydomain.com.http: . ack 307 win 65230

Does it mean anything to you?

On 8/21/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> > I'll take a look at the forensics and the packet trace.  The server is
> > on a LAN - I don't believe there are any proxies involved, but I'm not
> > the guy who has to put together the servers.  I'm just the guy that
> > has to communicate with them.  I'll ask about that.  A tracert,
> > though, shows no hops between the client and the server.
> >
> > Subversion provides atomic commits so, although I see no evidence on
> > the server side, I assume that's because the commit process failed so
> > Subversion actually committed nothing.  And, to be honest, I can't be
> > completely sure the commit fails mid-stream, but I See a lot of
> > generated output indicating the process is doing what it's supposed to
> > (adding and removing files from the repository) and then the failure
> > message.  That's what leads me to think it's a mid-stream failure.  If
> > someone who knows more than I do (should be a lot of those people
> > about) can offer another suggestion, I'm all ears.
>
> Apache logs every request it receives.  So regardless of whether the
> commit transaction fails or not, there should be stuff in the apache
> access_log.  If there is not, it indicates that either apache didn't
> receive the request at all, or that the apache process serving the
> request crashed before it could do the logging.  In the latter case,
> you would usually see a segmentation fault signalled in the error log.
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Joshua Slive <jo...@slive.ca>.
On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> I'll take a look at the forensics and the packet trace.  The server is
> on a LAN - I don't believe there are any proxies involved, but I'm not
> the guy who has to put together the servers.  I'm just the guy that
> has to communicate with them.  I'll ask about that.  A tracert,
> though, shows no hops between the client and the server.
>
> Subversion provides atomic commits so, although I see no evidence on
> the server side, I assume that's because the commit process failed so
> Subversion actually committed nothing.  And, to be honest, I can't be
> completely sure the commit fails mid-stream, but I See a lot of
> generated output indicating the process is doing what it's supposed to
> (adding and removing files from the repository) and then the failure
> message.  That's what leads me to think it's a mid-stream failure.  If
> someone who knows more than I do (should be a lot of those people
> about) can offer another suggestion, I'm all ears.

Apache logs every request it receives.  So regardless of whether the
commit transaction fails or not, there should be stuff in the apache
access_log.  If there is not, it indicates that either apache didn't
receive the request at all, or that the apache process serving the
request crashed before it could do the logging.  In the latter case,
you would usually see a segmentation fault signalled in the error log.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Rob Wilkerson <r....@gmail.com>.
I'll take a look at the forensics and the packet trace.  The server is
on a LAN - I don't believe there are any proxies involved, but I'm not
the guy who has to put together the servers.  I'm just the guy that
has to communicate with them.  I'll ask about that.  A tracert,
though, shows no hops between the client and the server.

Subversion provides atomic commits so, although I see no evidence on
the server side, I assume that's because the commit process failed so
Subversion actually committed nothing.  And, to be honest, I can't be
completely sure the commit fails mid-stream, but I See a lot of
generated output indicating the process is doing what it's supposed to
(adding and removing files from the repository) and then the failure
message.  That's what leads me to think it's a mid-stream failure.  If
someone who knows more than I do (should be a lot of those people
about) can offer another suggestion, I'm all ears.

Thanks.

On 8/21/06, Joshua Slive <jo...@slive.ca> wrote:
> On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> > All -
> >
> > I know this is somewhat off-topic and I apologize for that, but I'm
> > not having any luck on the Subversion mailing list so I thought I'd
> > ask the question from this end and see if someone can give me any
> > suggestions on where to look and/or possible causes.
> >
> > I'm trying to commit a large code base merge using Subversion over
> > HTTP through Apache 2.2.2.  The commit seems to be rolling along
> > nicely when suddenly it simply fails with a message that it could not
> > connect to the server.  The Apache error and access logs
> > (/var/log/httpd/error_log and /var/log/httpd/access_log) give no
> > indication that it was even aware of the transaction, much less that
> > it failed.  Smaller commits, on the other hand, work fine.
> >
> > I've tried - at the suggestion of a member of the Subversion mailing
> > list - to disable the XML request body checking (LimitXMLRequestBody
> > 0), but that made no difference at all.  Are there any other
> > directives that might prevent a connection from being severed?  Is
> > there any way to be sure that it's apache severing the connection?
> > Can any other process sever an HTTP connection?
> >
> > I'm running:
> > FC5
> > Apache 2.2.2
> > SELinux is disabled
> > Subversion 1.3.2
> > mod_python 3.2.8
> > (I think those are all of the relevant line items)
> >
> > Again, I apologize if this is too far off-topic, but I'm desperate.  I
> > had to at least give it a shot.
>
> Doesn't seem that far off-topic to me.
>
> If you are saying that the request seems to partially complete from
> the client side, but you see no evidence of it at all in the apache
> error or access logs, that may suggest an apache process crash.  If
> that is the case, you can use mod_log_forensic to verify that the
> server is crashing, and you can use the instructions here to try to
> get a backtrace giving details of the problem:
> http://httpd.apache.org/docs/2.2/mod/mod_log_forensic.html
> http://httpd.apache.org/dev/debugging.html#crashes
>
> If an apache process crash is not the problem, then you should look at
> a packet trace:
> http://httpd.apache.org/dev/debugging.html#tcpdump
>
> It is, of course, possible that there is a proxy inbetween you and the
> server that could be messing up the connection.  One way around that
> is to use SSL, since proxies are less likely to mess with SSL
> connections.
>
> Joshua.
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>


-- 

Rob Wilkerson

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] SOT: Subversion Connection to Apache Fails Mid-Stream

Posted by Joshua Slive <jo...@slive.ca>.
On 8/21/06, Rob Wilkerson <r....@gmail.com> wrote:
> All -
>
> I know this is somewhat off-topic and I apologize for that, but I'm
> not having any luck on the Subversion mailing list so I thought I'd
> ask the question from this end and see if someone can give me any
> suggestions on where to look and/or possible causes.
>
> I'm trying to commit a large code base merge using Subversion over
> HTTP through Apache 2.2.2.  The commit seems to be rolling along
> nicely when suddenly it simply fails with a message that it could not
> connect to the server.  The Apache error and access logs
> (/var/log/httpd/error_log and /var/log/httpd/access_log) give no
> indication that it was even aware of the transaction, much less that
> it failed.  Smaller commits, on the other hand, work fine.
>
> I've tried - at the suggestion of a member of the Subversion mailing
> list - to disable the XML request body checking (LimitXMLRequestBody
> 0), but that made no difference at all.  Are there any other
> directives that might prevent a connection from being severed?  Is
> there any way to be sure that it's apache severing the connection?
> Can any other process sever an HTTP connection?
>
> I'm running:
> FC5
> Apache 2.2.2
> SELinux is disabled
> Subversion 1.3.2
> mod_python 3.2.8
> (I think those are all of the relevant line items)
>
> Again, I apologize if this is too far off-topic, but I'm desperate.  I
> had to at least give it a shot.

Doesn't seem that far off-topic to me.

If you are saying that the request seems to partially complete from
the client side, but you see no evidence of it at all in the apache
error or access logs, that may suggest an apache process crash.  If
that is the case, you can use mod_log_forensic to verify that the
server is crashing, and you can use the instructions here to try to
get a backtrace giving details of the problem:
http://httpd.apache.org/docs/2.2/mod/mod_log_forensic.html
http://httpd.apache.org/dev/debugging.html#crashes

If an apache process crash is not the problem, then you should look at
a packet trace:
http://httpd.apache.org/dev/debugging.html#tcpdump

It is, of course, possible that there is a proxy inbetween you and the
server that could be messing up the connection.  One way around that
is to use SSL, since proxies are less likely to mess with SSL
connections.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org