You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by Dale <da...@spiderhost.com> on 2003/07/28 18:48:14 UTC

[users@httpd] Intermittent Load Problems

I have been experiencing an intermittent problem with a Red hat Linux
server running apache 1.3.27

What I notice is that whenever a PHP/Mysql site (so it seems) the server
fails to respond, timeout, to future HTTP requests.  A few minutes (~10)
later everything is ok.  A reload of the HTTPD process will fix the
problem.  The server is not under high load, <250 concurrent
connections.  

No noticeable errors in Mysql Logs
No noticeable errors in httpd log

A TCPDUMP shows incoming http requests but no response from server.
Changed NICS, Cable, and switch port

Other network applications work fine on server.
About 200 sites on this server.

Apache config
-------------
ServerType standalone
ServerRoot "/usr/local/apache"
PidFile /usr/local/apache/logs/httpd.pid
ScoreBoardFile /usr/local/apache/logs/httpd.scoreboard
Timeout 300
KeepAlive Off
MaxKeepAliveRequests 300
KeepAliveTimeout 15
MinSpareServers 16
MaxSpareServers 50
StartServers 10
MaxClients 256
MaxRequestsPerChild 10000

Hardware/Software
-----------------
Apache 1.3.27
Redhat Linux 2.4.18-3smp
Compaq Hardware
Php 4.2.3
Mysql 3.23.55

Thanks in advance,

Dale



---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


RE: [users@httpd] Intermittent Load Problems

Posted by Dale <da...@spiderhost.com>.
It looks like it is fixed now.  It was related to this bug

http://rhn.redhat.com/errata/RHBA-2002-085.html

With the strace we saw a lot of these errors

ENOTTY (Inappropriate ioctl for device)

Thanks for all of your help

-----Original Message-----
From: htsang [mailto:htsang] On Behalf Of Victor Tsang
Sent: Tuesday, July 29, 2003 10:39 PM
To: users@httpd.apache.org
Subject: Re: [users@httpd] Intermittent Load Problems


use the mysqladmin processlist command to check if there's any query
locking your mysql server, that is quite a common cause of web service
slow down.

and for strace, do a ps -auxw | grep httpd and do a strace -p <pid> on
any of them.  If your apache children are suffering from one common
problem, sooner or later you will see strace's output slow down on
something.  

strace output is not easy to understand but it should give you some good
hints of what is causing your problem.


Tor.


Dale wrote:
> 
> Possibly, although when we had mysql logging enable we did not see any

> errors.  What am I looking for with the strace?  I assume the syntax 
> would just be strace -f /usr/local/apache/bin/httpsd ?
> 
> -----Original Message-----
> From: htsang [mailto:htsang] On Behalf Of Victor Tsang
> Sent: Tuesday, July 29, 2003 6:53 AM
> To: users@httpd.apache.org
> Subject: Re: [users@httpd] Intermittent Load Problems
> 
> Could it by the mysql server?  do a strace on your httpd process and 
> see what is tieing them up.
> 
> Tor.
> 
> Dale wrote:
> >
> > I have been experiencing an intermittent problem with a Red hat 
> > Linux server running apache 1.3.27
> >
> > What I notice is that whenever a PHP/Mysql site (so it seems) the 
> > server fails to respond, timeout, to future HTTP requests.  A few 
> > minutes (~10) later everything is ok.  A reload of the HTTPD process

> > will fix the problem.  The server is not under high load, <250 
> > concurrent connections.
> >
> > No noticeable errors in Mysql Logs
> > No noticeable errors in httpd log
> >
> > A TCPDUMP shows incoming http requests but no response from server. 
> > Changed NICS, Cable, and switch port
> >
> > Other network applications work fine on server.
> > About 200 sites on this server.
> >
> > Apache config
> > -------------
> > ServerType standalone
> > ServerRoot "/usr/local/apache"
> > PidFile /usr/local/apache/logs/httpd.pid
> > ScoreBoardFile /usr/local/apache/logs/httpd.scoreboard
> > Timeout 300
> > KeepAlive Off
> > MaxKeepAliveRequests 300
> > KeepAliveTimeout 15
> > MinSpareServers 16
> > MaxSpareServers 50
> > StartServers 10
> > MaxClients 256
> > MaxRequestsPerChild 10000
> >
> > Hardware/Software
> > -----------------
> > Apache 1.3.27
> > Redhat Linux 2.4.18-3smp
> > Compaq Hardware
> > Php 4.2.3
> > Mysql 3.23.55
> >
> > Thanks in advance,
> >
> > Dale
> >
> > --------------------------------------------------------------------
> > -
> > The official User-To-User support forum of the Apache HTTP Server
> > Project. See <URL:http://httpd.apache.org/userslist.html> for more
> > info. To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> >    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> > For additional commands, e-mail: users-help@httpd.apache.org
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server 
> Project. See <URL:http://httpd.apache.org/userslist.html> for more 
> info. To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server 
> Project. See <URL:http://httpd.apache.org/userslist.html> for more 
> info. To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server
Project. See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] Intermittent Load Problems

Posted by Victor Tsang <vi...@outblaze.com>.
use the mysqladmin processlist command to check if there's any query
locking your mysql server, that is quite a common cause of web service
slow down.

and for strace, do a ps -auxw | grep httpd and do a strace -p <pid> on
any of them.  If your apache children are suffering from one common
problem, sooner or later you will see strace's output slow down on
something.  

strace output is not easy to understand but it should give you some good
hints of what is causing your problem.


Tor.


Dale wrote:
> 
> Possibly, although when we had mysql logging enable we did not see any
> errors.  What am I looking for with the strace?  I assume the syntax
> would just be strace -f /usr/local/apache/bin/httpsd ?
> 
> -----Original Message-----
> From: htsang [mailto:htsang] On Behalf Of Victor Tsang
> Sent: Tuesday, July 29, 2003 6:53 AM
> To: users@httpd.apache.org
> Subject: Re: [users@httpd] Intermittent Load Problems
> 
> Could it by the mysql server?  do a strace on your httpd process and see
> what is tieing them up.
> 
> Tor.
> 
> Dale wrote:
> >
> > I have been experiencing an intermittent problem with a Red hat Linux
> > server running apache 1.3.27
> >
> > What I notice is that whenever a PHP/Mysql site (so it seems) the
> > server fails to respond, timeout, to future HTTP requests.  A few
> > minutes (~10) later everything is ok.  A reload of the HTTPD process
> > will fix the problem.  The server is not under high load, <250
> > concurrent connections.
> >
> > No noticeable errors in Mysql Logs
> > No noticeable errors in httpd log
> >
> > A TCPDUMP shows incoming http requests but no response from server.
> > Changed NICS, Cable, and switch port
> >
> > Other network applications work fine on server.
> > About 200 sites on this server.
> >
> > Apache config
> > -------------
> > ServerType standalone
> > ServerRoot "/usr/local/apache"
> > PidFile /usr/local/apache/logs/httpd.pid
> > ScoreBoardFile /usr/local/apache/logs/httpd.scoreboard
> > Timeout 300
> > KeepAlive Off
> > MaxKeepAliveRequests 300
> > KeepAliveTimeout 15
> > MinSpareServers 16
> > MaxSpareServers 50
> > StartServers 10
> > MaxClients 256
> > MaxRequestsPerChild 10000
> >
> > Hardware/Software
> > -----------------
> > Apache 1.3.27
> > Redhat Linux 2.4.18-3smp
> > Compaq Hardware
> > Php 4.2.3
> > Mysql 3.23.55
> >
> > Thanks in advance,
> >
> > Dale
> >
> > ---------------------------------------------------------------------
> > The official User-To-User support forum of the Apache HTTP Server
> > Project. See <URL:http://httpd.apache.org/userslist.html> for more
> > info. To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> >    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> > For additional commands, e-mail: users-help@httpd.apache.org
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server
> Project. See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


RE: [users@httpd] Intermittent Load Problems

Posted by Dale <da...@spiderhost.com>.
Possibly, although when we had mysql logging enable we did not see any
errors.  What am I looking for with the strace?  I assume the syntax
would just be strace -f /usr/local/apache/bin/httpsd ?

-----Original Message-----
From: htsang [mailto:htsang] On Behalf Of Victor Tsang
Sent: Tuesday, July 29, 2003 6:53 AM
To: users@httpd.apache.org
Subject: Re: [users@httpd] Intermittent Load Problems


Could it by the mysql server?  do a strace on your httpd process and see
what is tieing them up.

Tor.

Dale wrote:
> 
> I have been experiencing an intermittent problem with a Red hat Linux 
> server running apache 1.3.27
> 
> What I notice is that whenever a PHP/Mysql site (so it seems) the 
> server fails to respond, timeout, to future HTTP requests.  A few 
> minutes (~10) later everything is ok.  A reload of the HTTPD process 
> will fix the problem.  The server is not under high load, <250 
> concurrent connections.
> 
> No noticeable errors in Mysql Logs
> No noticeable errors in httpd log
> 
> A TCPDUMP shows incoming http requests but no response from server. 
> Changed NICS, Cable, and switch port
> 
> Other network applications work fine on server.
> About 200 sites on this server.
> 
> Apache config
> -------------
> ServerType standalone
> ServerRoot "/usr/local/apache"
> PidFile /usr/local/apache/logs/httpd.pid
> ScoreBoardFile /usr/local/apache/logs/httpd.scoreboard
> Timeout 300
> KeepAlive Off
> MaxKeepAliveRequests 300
> KeepAliveTimeout 15
> MinSpareServers 16
> MaxSpareServers 50
> StartServers 10
> MaxClients 256
> MaxRequestsPerChild 10000
> 
> Hardware/Software
> -----------------
> Apache 1.3.27
> Redhat Linux 2.4.18-3smp
> Compaq Hardware
> Php 4.2.3
> Mysql 3.23.55
> 
> Thanks in advance,
> 
> Dale
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server 
> Project. See <URL:http://httpd.apache.org/userslist.html> for more 
> info. To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server
Project. See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: [users@httpd] Intermittent Load Problems

Posted by Victor Tsang <vi...@outblaze.com>.
Could it by the mysql server?  do a strace on your httpd process and see
what is tieing them up.

Tor.

Dale wrote:
> 
> I have been experiencing an intermittent problem with a Red hat Linux
> server running apache 1.3.27
> 
> What I notice is that whenever a PHP/Mysql site (so it seems) the server
> fails to respond, timeout, to future HTTP requests.  A few minutes (~10)
> later everything is ok.  A reload of the HTTPD process will fix the
> problem.  The server is not under high load, <250 concurrent
> connections.
> 
> No noticeable errors in Mysql Logs
> No noticeable errors in httpd log
> 
> A TCPDUMP shows incoming http requests but no response from server.
> Changed NICS, Cable, and switch port
> 
> Other network applications work fine on server.
> About 200 sites on this server.
> 
> Apache config
> -------------
> ServerType standalone
> ServerRoot "/usr/local/apache"
> PidFile /usr/local/apache/logs/httpd.pid
> ScoreBoardFile /usr/local/apache/logs/httpd.scoreboard
> Timeout 300
> KeepAlive Off
> MaxKeepAliveRequests 300
> KeepAliveTimeout 15
> MinSpareServers 16
> MaxSpareServers 50
> StartServers 10
> MaxClients 256
> MaxRequestsPerChild 10000
> 
> Hardware/Software
> -----------------
> Apache 1.3.27
> Redhat Linux 2.4.18-3smp
> Compaq Hardware
> Php 4.2.3
> Mysql 3.23.55
> 
> Thanks in advance,
> 
> Dale
> 
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>    "   from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org