You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by gary lim <ga...@gmail.com> on 2009/12/16 17:20:07 UTC
[users@httpd] Apache intermittent crash - HELP!!!
Dear all,
1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU
3.00GHz GNU/Linux
2. The below info are my machine config and log output
3. Kindly advise how to resolve intermittent apache crash even after
performance tuning
*httpd.conf output
*# prefork MPM [DEFAULT IF USE=-threads]
# StartServers: number of server processes to start
# MinSpareServers: minimum number of server processes which are kept spare
# MaxSpareServers: maximum number of server processes which are kept spare
# MaxClients: maximum number of server processes allowed to start
# MaxRequestsPerChild: maximum number of requests a server process serves
<IfModule prefork.c>
StartServers 2
MinSpareServers 4
MaxSpareServers 6
MaxClients 100
MaxRequestsPerChild 500
</IfModule>
# worker MPM [DEFAULT IF USE=threads]
# StartServers: initial number of server processes to start
# MaxClients: maximum number of simultaneous client connections
# MinSpareThreads: minimum number of worker threads which are kept spare
# MaxSpareThreads: maximum number of worker threads which are kept spare
# ThreadsPerChild: constant number of worker threads in each server process
# MaxRequestsPerChild: maximum number of requests a server process serves
<IfModule worker.c>
StartServers 2
MaxClients 100
MinSpareThreads 25
MaxSpareThreads 75
ThreadsPerChild 25
MaxRequestsPerChild 500
</IfModule>
*top output
*top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
0.80
Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi, 0.0% si
Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
*apache2 error log
**** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b4faf0 ***
[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x086a1170 ***
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b48c08 ***
[Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not exit,
sending a SIGKILL
[Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not exit,
sending a SIGKILL
*Joomla / PHP / Apache
*System Information
*PHP built On:* Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
19:20:15 SGT 2006 i686 *Database Version:* 5.0.24a-log *PHP
Version:* 5.1.6-pl4-gentoo
*Web Server:* Apache *WebServer to PHP interface:* apache2handler
*Joomla!
Version:* Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00 UTC *User
Agent:* Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
*Mysql
*mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
5.1
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hi daniel,
1. Glibc version - (GNU libc) 2.4
2. Our default http.conf is experiencing the intermittent apache crash,
hence the performance tuning when we detected that apache has use up all the
swap probably due to memory leak
gary
On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt
<cr...@cryptodan.net>wrote:
> -->From: gary lim
> -->Sent: 16 December, 2009 16:20
> -->To: users@httpd.apache.org
> -->Subject: [users@httpd] Apache intermittent crash - HELP!!!
> -->
> -->
> -->Dear all,
>
> -->
> -->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
> CPU 3.00GHz GNU/Linux
> -->2. The below info are my machine config and log output
> -->3. Kindly advise how to resolve intermittent apache crash even after
> performance tuning
> -->
> -->apache2 error log
>
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b4faf0 ***
> -->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
> consider raising the MaxClients setting
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x086a1170 ***
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b48c08 ***
>
>
>
> Gary,
>
> What version of glibc do you have? The glibc detected could be causing
> this since its producing a dump code. I would revert back to a default
> setup with your httpd.conf file, and just use the basics you need for your
> site to run. If you get no crashes then its an issue with your performance
> tuning.
>
> Thanks,
> Daniel
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Daniel Reinhardt <cr...@cryptodan.net>.
--------------------------------------------------
From: "Justin Pasher" <ju...@newmediagateway.com>
Sent: 18 December, 2009 21:20
To: <us...@httpd.apache.org>
Subject: Re: [users@httpd] Apache intermittent crash - HELP!!!
> Just a couple things to point out (but nothing specific to fixing your probem)
> ...
>
> gary lim wrote:
>> Hi Daniel,
>> *top output
>> *top - 04:58:52 up 160 days, 4:02, 1 user, load average: 0.08, 0.04, 0.05
>> Tasks: 69 total, 2 running, 67 sleeping, 0 stopped, 0 zombie
>> Cpu(s): 1.9% us, 5.0% sy, 0.0% ni, 93.2% id, 0.0% wa, 0.0% hi, 0.0% si
>> Mem: 917652k total, 908144k used, 9508k free, 32660k buffers
>> Swap: 1048568k total, 37856k used, 1010712k free, 179480k cached
>>
>>
>> Model: *Dell PowerEdge 850*
>> CPU:Intel *Pentium IV 3.0GHz* / 2MB, 800MHz FSB
>> RAM: *2GB **DDR-2 SDRAM* 533MHz w/ ECC*
>> *Harddisk: *02 x SATA* (7200RPM) HDD (non-RAID)
>
> Not sure if you noticed or not, but all of your memory is not actually <
> showing up as available to the kernel. Are you running a kernel with <
> "bigmem"-style support? If not, you're missing out on half of your RAM. <
I would be willing to guess, that his kernel is not using his full ram, and if
your system is running out of 10Gigs of Swap something else needs to be done
with the computer. I have a similar setup, and my swap hardly gets used.
However, I am sure my site/server doesn't get anywhere near the hits yours does.
I am, however, running Ubuntu 9.10, a few game servers, webmin, mysql, php,
apache 2.2.12, ssh, postfix, and a few other process. I am also running Gnome
Desktop Environment, because I like to use it when I am cleaning my main
gaming/workstation PC.
I would look into recompiling your Kernel with RAM support upto 4gig or greater,
seeing your machine is only 32bit, I would recommend using upto 4Gig support in
the memory section. After that see if it makes a difference, if you do not see
a difference, then post what you are running on the machine. The more
information you provide the better we can diagnose your issue with your server,
and get down to the root cause of your crashes.
Here are my system specs: http://www.cryptodan.net/sys/index.php?disp=dynamic
Thanks,
Daniel
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
yes, before we disable any PHP module, we want to be careful to only do it
only if necessary since it under production
On Sat, Dec 19, 2009 at 6:55 AM, Justin Pasher
<ju...@newmediagateway.com>wrote:
> gary lim wrote:
>
>> Hu justin,
>>
>> 1. Because its a production site, we are unable to disable the PHP
>> modules/script......From the log output below, we are having difficulty to
>> pinpoint the source of error. I just spent the last couple of hours to run
>> through the pages and see if the log shows up any systematic
>> error...unfortunately, wasn't able to replicate the source of problem
>> causing the glibc issue. Not sure if this only happen during high
>> loading....
>>
>
> I knew you would say that, but that doesn't change what I suggested. It's
> like the situation where someone has suspected flaky hardware (e.g. bad
> RAM), but they can't reboot the server to run memtest86 because it's
> production. It won't get you any closer to a solution when you can't test
> all possible avenues, especially when it's very difficult to even replicate
> the issue consistently.
>
> --
>
> Justin Pasher
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hi justin,
yes, we are working on this avenue which will take some time....in the
meantime, we need to try to resolve the crash issue in our production
system.
On Sat, Dec 19, 2009 at 7:00 AM, Justin Pasher
<ju...@newmediagateway.com>wrote:
> Justin Pasher wrote:
>
>> gary lim wrote:
>>
>>> Hu justin,
>>>
>>> 1. Because its a production site, we are unable to disable the PHP
>>> modules/script......From the log output below, we are having difficulty to
>>> pinpoint the source of error. I just spent the last couple of hours to run
>>> through the pages and see if the log shows up any systematic
>>> error...unfortunately, wasn't able to replicate the source of problem
>>> causing the glibc issue. Not sure if this only happen during high
>>> loading....
>>>
>>
> One other thought... You said the server is running under Xen. Can you not
> just clone the virtual machine instance and play around with the test one?
> I'm not sure what sort of online cloning capabilities Xen supports, so I
> don't know if it would require a shutdown or not.
>
> --
> Justin Pasher
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Justin Pasher <ju...@newmediagateway.com>.
Justin Pasher wrote:
> gary lim wrote:
>> Hu justin,
>>
>> 1. Because its a production site, we are unable to disable the PHP
>> modules/script......From the log output below, we are having
>> difficulty to pinpoint the source of error. I just spent the last
>> couple of hours to run through the pages and see if the log shows up
>> any systematic error...unfortunately, wasn't able to replicate the
>> source of problem causing the glibc issue. Not sure if this only
>> happen during high loading....
One other thought... You said the server is running under Xen. Can you
not just clone the virtual machine instance and play around with the
test one? I'm not sure what sort of online cloning capabilities Xen
supports, so I don't know if it would require a shutdown or not.
--
Justin Pasher
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Justin Pasher <ju...@newmediagateway.com>.
gary lim wrote:
> Hu justin,
>
> 1. Because its a production site, we are unable to disable the PHP
> modules/script......From the log output below, we are having
> difficulty to pinpoint the source of error. I just spent the last
> couple of hours to run through the pages and see if the log shows up
> any systematic error...unfortunately, wasn't able to replicate the
> source of problem causing the glibc issue. Not sure if this only
> happen during high loading....
I knew you would say that, but that doesn't change what I suggested.
It's like the situation where someone has suspected flaky hardware (e.g.
bad RAM), but they can't reboot the server to run memtest86 because it's
production. It won't get you any closer to a solution when you can't
test all possible avenues, especially when it's very difficult to even
replicate the issue consistently.
--
Justin Pasher
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hu justin,
1. Because its a production site, we are unable to disable the PHP
modules/script......From the log output below, we are having difficulty to
pinpoint the source of error. I just spent the last couple of hours to run
through the pages and see if the log shows up any systematic
error...unfortunately, wasn't able to replicate the source of problem
causing the glibc issue. Not sure if this only happen during high
loading....
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x086a1170 ***
*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b48c08 ***
[Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,
sending a SIGTERM
[Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,
sending a SIGTERM
2. The mem usage is correct because we are running the web server as a Xen
Virtual Machine.
On Sat, Dec 19, 2009 at 5:20 AM, Justin Pasher
<ju...@newmediagateway.com>wrote:
> Just a couple things to point out (but nothing specific to fixing your
> probem) ...
>
>
> gary lim wrote:
>
>> Hi Daniel,
>>
>> After performance tuning of apache, the mem usage is now more managable.
>> However, the apache still experience intermittent crash which we suspect is
>> due to certain PHP module running in our joomla website.
>>
>
> If it really is the PHP module that is crashing it, there's really no other
> way to test that theory unless you disable it and see if the crashes
> persist.
>
> *top output
>>
>> *top - 04:58:52 up 160 days, 4:02, 1 user, load average: 0.08, 0.04,
>> 0.05
>> Tasks: 69 total, 2 running, 67 sleeping, 0 stopped, 0 zombie
>> Cpu(s): 1.9% us, 5.0% sy, 0.0% ni, 93.2% id, 0.0% wa, 0.0% hi, 0.0%
>> si
>> Mem: 917652k total, 908144k used, 9508k free, 32660k buffers
>> Swap: 1048568k total, 37856k used, 1010712k free, 179480k cached
>>
>>
>> Model: *Dell PowerEdge 850*
>> CPU:Intel *Pentium IV 3.0GHz* / 2MB, 800MHz FSB
>> RAM: *2GB **DDR-2 SDRAM* 533MHz w/ ECC*
>> *Harddisk: *02 x SATA* (7200RPM) HDD (non-RAID)
>>
>
> Not sure if you noticed or not, but all of your memory is not actually
> showing up as available to the kernel. Are you running a kernel with
> "bigmem"-style support? If not, you're missing out on half of your RAM.
>
> *Apache Version
>>
>> *Server version: Apache/2.0.58
>> Server built: Dec 12 2006 21:41:17
>>
>
> There is always the 2.2 branch, which I'd recommend trying out if possible.
> Perhaps this is a locked down distro release with only the older version
> available (RHEL/CentOS?).
>
>
> --
> Justin Pasher
>
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Justin Pasher <ju...@newmediagateway.com>.
Just a couple things to point out (but nothing specific to fixing your
probem) ...
gary lim wrote:
> Hi Daniel,
>
> After performance tuning of apache, the mem usage is now more
> managable. However, the apache still experience intermittent crash
> which we suspect is due to certain PHP module running in our joomla
> website.
If it really is the PHP module that is crashing it, there's really no
other way to test that theory unless you disable it and see if the
crashes persist.
> *top output
> *top - 04:58:52 up 160 days, 4:02, 1 user, load average: 0.08,
> 0.04, 0.05
> Tasks: 69 total, 2 running, 67 sleeping, 0 stopped, 0 zombie
> Cpu(s): 1.9% us, 5.0% sy, 0.0% ni, 93.2% id, 0.0% wa, 0.0% hi,
> 0.0% si
> Mem: 917652k total, 908144k used, 9508k free, 32660k buffers
> Swap: 1048568k total, 37856k used, 1010712k free, 179480k cached
>
>
> Model: *Dell PowerEdge 850*
> CPU:Intel *Pentium IV 3.0GHz* / 2MB, 800MHz FSB
> RAM: *2GB **DDR-2 SDRAM* 533MHz w/ ECC*
> *Harddisk: *02 x SATA* (7200RPM) HDD (non-RAID)
Not sure if you noticed or not, but all of your memory is not actually
showing up as available to the kernel. Are you running a kernel with
"bigmem"-style support? If not, you're missing out on half of your RAM.
> *Apache Version
> *Server version: Apache/2.0.58
> Server built: Dec 12 2006 21:41:17
There is always the 2.2 branch, which I'd recommend trying out if
possible. Perhaps this is a locked down distro release with only the
older version available (RHEL/CentOS?).
--
Justin Pasher
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hi Daniel,
After performance tuning of apache, the mem usage is now more managable.
However, the apache still experience intermittent crash which we suspect is
due to certain PHP module running in our joomla website.
*top output
*top - 04:58:52 up 160 days, 4:02, 1 user, load average: 0.08, 0.04, 0.05
Tasks: 69 total, 2 running, 67 sleeping, 0 stopped, 0 zombie
Cpu(s): 1.9% us, 5.0% sy, 0.0% ni, 93.2% id, 0.0% wa, 0.0% hi, 0.0% si
Mem: 917652k total, 908144k used, 9508k free, 32660k buffers
Swap: 1048568k total, 37856k used, 1010712k free, 179480k cached
Model: *Dell PowerEdge 850*
CPU:Intel *Pentium IV 3.0GHz* / 2MB, 800MHz FSB
RAM: *2GB **DDR-2 SDRAM* 533MHz w/ ECC*
*Harddisk: *02 x SATA* (7200RPM) HDD (non-RAID)
*Apache Version
*Server version: Apache/2.0.58
Server built: Dec 12 2006 21:41:17
Server version: Apache/2.0.58
Server built: Dec 12 2006 21:41:17
Server's Module Magic Number: 20020903:12
Server loaded: APR 0.9.12, APR-UTIL 0.9.12
Compiled using: APR 0.9.12, APR-UTIL 0.9.12
Architecture: 32-bit
Server compiled with....
-D APACHE_MPM_DIR="server/mpm/prefork"
-D APR_HAS_SENDFILE
-D APR_HAS_MMAP
-D APR_HAVE_IPV6 (IPv4-mapped addresses enabled)
-D APR_USE_SYSVSEM_SERIALIZE
-D APR_USE_PTHREAD_SERIALIZE
-D SINGLE_LISTEN_UNSERIALIZED_ACCEPT
-D APR_HAS_OTHER_CHILD
-D AP_HAVE_RELIABLE_PIPED_LOGS
-D HTTPD_ROOT="/usr"
-D SUEXEC_BIN="/usr/sbin/suexec2"
-D DEFAULT_PIDLOG="/var/run/httpd.pid"
-D DEFAULT_SCOREBOARD="logs/apache_runtime_status"
-D DEFAULT_LOCKFILE="/var/run/accept.lock"
-D DEFAULT_ERRORLOG="logs/error_log"
-D AP_TYPES_CONFIG_FILE="/etc/apache2/mime.types"
-D SERVER_CONFIG_FILE="/etc/apache2/httpd.conf"
Compiled in modules:
core.c
prefork.c
http_core.c
mod_so.c
On Thu, Dec 17, 2009 at 10:22 PM, Daniel Reinhardt
<cr...@cryptodan.net>wrote:
>
> *From:* gary lim <ga...@gmail.com>
> *Sent:* 17 December, 2009 5:05
> *To:* users@httpd.apache.org
> *Subject:* Re: [users@httpd] Apache intermittent crash - HELP!!!
>
> Hi daniel,
>
> 1. the intermittent crash happens even before we did any performance tuning
> of the apache.
>
> 2. the reason why we did the tuning is because we want to limit the apache
> memory usage which previously was due to apache using up all the swap mem
> causing the crash.
>
> rgds
>
>
> On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt <
> cryptodan@cryptodan.net> wrote:
>
>> -->From: gary lim
>> -->Sent: 16 December, 2009 16:20
>> -->To: users@httpd.apache.org
>> -->Subject: [users@httpd] Apache intermittent crash - HELP!!!
>> -->
>> -->
>> -->Dear all,
>>
>> -->
>> -->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>> CPU 3.00GHz GNU/Linux
>> -->2. The below info are my machine config and log output
>> -->3. Kindly advise how to resolve intermittent apache crash even after
>> performance tuning
>> -->
>> -->apache2 error log
>>
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b4faf0 ***
>> -->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>> consider raising the MaxClients setting
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x086a1170 ***
>> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b48c08 ***
>>
>>
>>
>> Gary,
>>
>> What version of glibc do you have? The glibc detected could be causing
>> this since its producing a dump code. I would revert back to a default
>> setup with your httpd.conf file, and just use the basics you need for your
>> site to run. If you get no crashes then its an issue with your performance
>> tuning.
>>
>> Thanks,
>> Daniel
>>
>> ---------------------------------------------------------------------
>> The official User-To-User support forum of the Apache HTTP Server Project.
>> See <URL:http://httpd.apache.org/userslist.html> for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>
> Gary,
>
> If your application is using all of the SWAP memory maybe its time to
> rebuild the system with more swap space or upgrade the RAM. Can you post
> the server specs for us? I have never seen an application take full use of
> all the memory and all the allocated swap space. You have hardware issues
> that need to be dealt with before attempting to solve the software ones.
>
> When you list your system specs, can you also tell us if your Kernel has
> support for higher memory system configs?
>
> Thanks,
> Daniel
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Daniel Reinhardt <cr...@cryptodan.net>.
From: gary lim
Sent: 17 December, 2009 5:05
To: users@httpd.apache.org
Subject: Re: [users@httpd] Apache intermittent crash - HELP!!!
Hi daniel,
1. the intermittent crash happens even before we did any performance tuning of the apache.
2. the reason why we did the tuning is because we want to limit the apache memory usage which previously was due to apache using up all the swap mem causing the crash.
rgds
On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt <cr...@cryptodan.net> wrote:
-->From: gary lim
-->Sent: 16 December, 2009 16:20
-->To: users@httpd.apache.org
-->Subject: [users@httpd] Apache intermittent crash - HELP!!!
-->
-->
-->Dear all,
-->
-->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux
-->2. The below info are my machine config and log output
-->3. Kindly advise how to resolve intermittent apache crash even after performance tuning
-->
-->apache2 error log
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x08b4faf0 ***
-->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting, consider raising the MaxClients setting
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x086a1170 ***
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x08b48c08 ***
Gary,
What version of glibc do you have? The glibc detected could be causing this since its producing a dump code. I would revert back to a default setup with your httpd.conf file, and just use the basics you need for your site to run. If you get no crashes then its an issue with your performance tuning.
Thanks,
Daniel
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Gary,
If your application is using all of the SWAP memory maybe its time to rebuild the system with more swap space or upgrade the RAM. Can you post the server specs for us? I have never seen an application take full use of all the memory and all the allocated swap space. You have hardware issues that need to be dealt with before attempting to solve the software ones.
When you list your system specs, can you also tell us if your Kernel has support for higher memory system configs?
Thanks,
Daniel
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hi daniel,
1. the intermittent crash happens even before we did any performance tuning
of the apache.
2. the reason why we did the tuning is because we want to limit the apache
memory usage which previously was due to apache using up all the swap mem
causing the crash.
rgds
On Thu, Dec 17, 2009 at 12:42 PM, Daniel Reinhardt
<cr...@cryptodan.net>wrote:
> -->From: gary lim
> -->Sent: 16 December, 2009 16:20
> -->To: users@httpd.apache.org
> -->Subject: [users@httpd] Apache intermittent crash - HELP!!!
> -->
> -->
> -->Dear all,
>
> -->
> -->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
> CPU 3.00GHz GNU/Linux
> -->2. The below info are my machine config and log output
> -->3. Kindly advise how to resolve intermittent apache crash even after
> performance tuning
> -->
> -->apache2 error log
>
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b4faf0 ***
> -->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
> consider raising the MaxClients setting
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x086a1170 ***
> -->*** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b48c08 ***
>
>
>
> Gary,
>
> What version of glibc do you have? The glibc detected could be causing
> this since its producing a dump code. I would revert back to a default
> setup with your httpd.conf file, and just use the basics you need for your
> site to run. If you get no crashes then its an issue with your performance
> tuning.
>
> Thanks,
> Daniel
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Daniel Reinhardt <cr...@cryptodan.net>.
-->From: gary lim
-->Sent: 16 December, 2009 16:20
-->To: users@httpd.apache.org
-->Subject: [users@httpd] Apache intermittent crash - HELP!!!
-->
-->
-->Dear all,
-->
-->1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
CPU 3.00GHz GNU/Linux
-->2. The below info are my machine config and log output
-->3. Kindly advise how to resolve intermittent apache crash even after
performance tuning
-->
-->apache2 error log
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b4faf0 ***
-->[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x086a1170 ***
-->*** glibc detected *** /usr/sbin/apache2: double free or corruption
(fasttop): 0x08b48c08 ***
Gary,
What version of glibc do you have? The glibc detected could be causing this
since its producing a dump code. I would revert back to a default setup
with your httpd.conf file, and just use the basics you need for your site to
run. If you get no crashes then its an issue with your performance tuning.
Thanks,
Daniel
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
hi Rodrigo,
XCache doesn't seem to be installed in our setup....
*phpinfo()
*PHP Version => 5.1.6-pl4-gentoo
System => Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23 19:20:15 SGT
2006 i686
Build Date => Dec 11 2006 15:41:50
Configure Command => './configure' '--prefix=/usr/lib/php5'
'--host=i686-pc-linux-gnu' '--mandir=/usr/lib/php5/man' '
--infodir=/usr/lib/php5/info' '--sysconfdir=/etc'
'--cache-file=./config.cache' '--enable-cli' '--disable-cgi' '--with
-config-file-path=/etc/php/cli-php5'
'--with-config-file-scan-dir=/etc/php/cli-php5/ext-active' '--without-pear'
'--di
sable-bcmath' '--with-bz2' '--disable-calendar' '--disable-ctype'
'--without-curl' '--without-curlwrappers' '--disable
-dbase' '--disable-exif' '--without-fbsql' '--without-fdftk'
'--disable-filepro' '--disable-ftp' '--with-gettext' '--w
ithout-gmp' '--disable-hash' '--without-hwapi' '--without-iconv'
'--without-informix' '--without-kerberos' '--disable-
mbstring' '--with-mcrypt' '--disable-memory-limit' '--without-mhash'
'--without-ming' '--without-msql' '--without-mssq
l' '--with-ncurses' '--with-openssl' '--with-openssl-dir=/usr'
'--disable-pcntl' '--disable-pdo' '--without-pgsql' '--
disable-posix' '--with-pspell' '--without-recode' '--disable-simplexml'
'--disable-shmop' '--without-snmp' '--disable-
soap' '--disable-sockets' '--without-sybase' '--without-sybase-ct'
'--disable-sysvmsg' '--disable-sysvsem' '--disable-
sysvshm' '--without-tidy' '--disable-tokenizer' '--disable-wddx'
'--disable-xmlreader' '--disable-xmlwriter' '--withou
t-xmlrpc' '--without-xsl' '--with-zlib' '--disable-debug' '--enable-dba'
'--without-cdb' '--with-db4' '--without-flatf
ile' '--with-gdbm' '--without-inifile' '--without-qdbm'
'--with-freetype-dir=/usr' '--with-t1lib=/usr' '--disable-gd-j
is-conv' '--enable-gd-native-ttf' '--with-jpeg-dir=/usr'
'--with-png-dir=/usr' '--without-xpm-dir' '--with-gd' '--with
-mysql=/usr/lib/mysql' '--with-mysql-sock=/var/run/mysqld/mysqld.sock'
'--without-mysqli' '--with-readline' '--without
-libedit' '--without-mm' '--without-sqlite'
Server API => Command Line Interface
Virtual Directory Support => disabled
Configuration File (php.ini) Path => /etc/php/cli-php5/php.ini
Scan this dir for additional .ini files => /etc/php/cli-php5/ext-active
PHP API => 20041225
PHP Extension => 20050922
Zend Extension => 220051025
Debug Build => no
Thread Safety => disabled
Zend Memory Manager => enabled
IPv6 Support => enabled
Registered PHP Streams => php, file, http, ftp, compress.bzip2,
compress.zlib, https, ftps
Registered Stream Socket Transports => tcp, udp, unix, udg, ssl, sslv3,
sslv2, tls
Registered Stream Filters => string.rot13, string.toupper, string.tolower,
string.strip_tags, convert.*, consumed, bzi
p2.*, zlib.*
This program makes use of the Zend Scripting Language Engine:
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
Configuration
PHP Core
Directive => Local Value => Master Value
allow_call_time_pass_reference => On => On
allow_url_fopen => Off => Off
always_populate_raw_post_data => Off => Off
arg_separator.input => & => &
arg_separator.output => & => &
asp_tags => Off => Off
auto_append_file => no value => no value
auto_globals_jit => On => On
auto_prepend_file => no value => no value
browscap => no value => no value
default_charset => no value => no value
default_mimetype => text/html => text/html
define_syslog_variables => Off => Off
disable_classes => no value => no value
disable_functions => no value => no value
display_errors => On => On
display_startup_errors => Off => Off
doc_root => no value => no value
docref_ext => no value => no value
docref_root => no value => no value
enable_dl => On => On
error_append_string => no value => no value
error_log => no value => no value
error_prepend_string => no value => no value
error_reporting => 2039 => 2039
expose_php => On => On
extension_dir => /usr/lib/php5/lib/php/extensions/no-debug-non-zts-20050922
=> /usr/lib/php5/lib/php/extensions/no-deb
ug-non-zts-20050922
file_uploads => On => On
highlight.bg => #FFFFFF => #FFFFFF
highlight.comment => #FF8000 => #FF8000
highlight.default => #0000BB => #0000BB
highlight.html => #000000 => #000000
highlight.keyword => #007700 => #007700
highlight.string => #DD0000 => #DD0000
html_errors => Off => On
ignore_repeated_errors => Off => Off
ignore_repeated_source => Off => Off
ignore_user_abort => Off => Off
implicit_flush => On => Off
include_path => .:/usr/share/php5:/usr/share/php =>
.:/usr/share/php5:/usr/share/php
log_errors => Off => Off
log_errors_max_len => 1024 => 1024
magic_quotes_gpc => On => On
magic_quotes_runtime => Off => Off
magic_quotes_sybase => Off => Off
mail.force_extra_parameters => no value => no value
max_execution_time => 0 => 30
max_input_time => -1 => 60
open_basedir => no value => no value
output_buffering => 0 => no value
output_handler => no value => no value
post_max_size => 8M => 8M
precision => 12 => 12
realpath_cache_size => 16K => 16K
realpath_cache_ttl => 120 => 120
register_argc_argv => On => On
register_globals => Off => Off
register_long_arrays => On => On
report_memleaks => On => On
report_zend_debug => Off => Off
safe_mode => Off => Off
safe_mode_exec_dir => no value => no value
safe_mode_gid => Off => Off
safe_mode_include_dir => no value => no value
sendmail_from => no value => no value
sendmail_path => /usr/sbin/sendmail -t -i => /usr/sbin/sendmail -t -i
serialize_precision => 100 => 100
short_open_tag => On => On
SMTP => localhost => localhost
smtp_port => 25 => 25
sql.safe_mode => Off => Off
track_errors => Off => Off
unserialize_callback_func => no value => no value
upload_max_filesize => 2M => 2M
upload_tmp_dir => no value => no value
user_dir => no value => no value
variables_order => EGPCS => EGPCS
xmlrpc_error_number => 0 => 0
xmlrpc_errors => Off => Off
y2k_compliance => On => On
zend.ze1_compatibility_mode => Off => Off
bz2
BZip2 Support => Enabled
Stream Wrapper support => compress.bz2://
Stream Filter support => bzip2.decompress, bzip2.compress
BZip2 Version => 1.0.3, 15-Feb-2005
date
date/time support => enabled
Timezone Database Version => 2006.1
Timezone Database => internal
Default timezone => Asia/Singapore
Directive => Local Value => Master Value
date.default_latitude => 31.7667 => 31.7667
date.default_longitude => 35.2333 => 35.2333
date.sunrise_zenith => 90.583333 => 90.583333
date.sunset_zenith => 90.583333 => 90.583333
date.timezone => no value => no value
dba
DBA support => enabled
Supported handlers => gdbm db4
dom
DOM/XML => enabled
DOM/XML API Version => 20031129
libxml Version => 2.6.26
HTML Support => enabled
XPath Support => enabled
XPointer Support => enabled
Schema Support => enabled
RelaxNG Support => enabled
gd
GD Support => enabled
GD Version => bundled (2.0.28 compatible)
FreeType Support => enabled
FreeType Linkage => with freetype
FreeType Version => 2.1.10
T1Lib Support => enabled
GIF Read Support => enabled
GIF Create Support => enabled
JPG Support => enabled
PNG Support => enabled
WBMP Support => enabled
XBM Support => enabled
gettext
GetText Support => enabled
libxml
libXML support => active
libXML Version => 2.6.26
libXML streams => enabled
mcrypt
mcrypt support => enabled
Version => 2.5.7
Api No => 20021217
Supported ciphers => cast-128 gost rijndael-128 twofish arcfour cast-256
loki97 rijndael-192 saferplus wake blowfish-c
ompat des rijndael-256 serpent xtea blowfish enigma rc2 tripledes
Supported modes => cbc cfb ctr ecb ncfb nofb ofb stream
Directive => Local Value => Master Value
mcrypt.algorithms_dir => no value => no value
mcrypt.modes_dir => no value => no value
mysql
MySQL Support => enabled
Active Persistent Links => 0
Active Links => 0
Client API version => 5.0.24a
MYSQL_MODULE_TYPE => external
MYSQL_SOCKET => /var/run/mysqld/mysqld.sock
MYSQL_INCLUDE => -I/usr/include/mysql
MYSQL_LIBS => -L/usr/lib -lmysqlclient
Directive => Local Value => Master Value
mysql.allow_persistent => On => On
mysql.connect_timeout => 60 => 60
mysql.default_host => no value => no value
mysql.default_password => no value => no value
mysql.default_port => no value => no value
mysql.default_socket => no value => no value
mysql.default_user => no value => no value
mysql.max_links => Unlimited => Unlimited
mysql.max_persistent => Unlimited => Unlimited
mysql.trace_mode => Off => Off
ncurses
ncurses support => enabled
ncurses library version => 5.5
color support => yes
openssl
OpenSSL support => enabled
OpenSSL Version => OpenSSL 0.9.8c 05 Sep 2006
pcre
PCRE (Perl Compatible Regular Expressions) Support => enabled
PCRE Library Version => 6.6 06-Feb-2006
pspell
PSpell Support => enabled
Reflection
Reflection => enabled
Version => $Id: php_reflection.c,v 1.164.2.33 2006/03/29 14:28:42 tony2001
Exp $
session
Session Support => enabled
Registered save handlers => files user
Registered serializer handlers => php php_binary
Directive => Local Value => Master Value
session.auto_start => Off => Off
session.bug_compat_42 => On => On
session.bug_compat_warn => On => On
session.cache_expire => 180 => 180
session.cache_limiter => nocache => nocache
session.cookie_domain => no value => no value
session.cookie_lifetime => 0 => 0
session.cookie_path => / => /
session.cookie_secure => Off => Off
session.entropy_file => no value => no value
session.entropy_length => 0 => 0
session.gc_divisor => 100 => 100
session.gc_maxlifetime => 1440 => 1440
session.gc_probability => 1 => 1
session.hash_bits_per_character => 4 => 4
session.hash_function => 0 => 0
session.name => PHPSESSID => PHPSESSID
session.referer_check => no value => no value
session.save_handler => files => files
session.save_path => no value => no value
session.serialize_handler => php => php
session.use_cookies => On => On
session.use_only_cookies => Off => Off
session.use_trans_sid => 0 => 0
SPL
SPL support => enabled
Interfaces => Countable, OuterIterator, RecursiveIterator, SeekableIterator,
SplObserver, SplSubject
Classes => AppendIterator, ArrayIterator, ArrayObject,
BadFunctionCallException, BadMethodCallException, CachingIterat
or, DirectoryIterator, DomainException, EmptyIterator, FilterIterator,
InfiniteIterator, InvalidArgumentException, Ite
ratorIterator, LengthException, LimitIterator, LogicException,
NoRewindIterator, OutOfBoundsException, OutOfRangeExcep
tion, OverflowException, ParentIterator, RangeException,
RecursiveArrayIterator, RecursiveCachingIterator, RecursiveDi
rectoryIterator, RecursiveFilterIterator, RecursiveIteratorIterator,
RuntimeException, SplFileInfo, SplFileObject, Spl
ObjectStorage, SplTempFileObject, UnderflowException,
UnexpectedValueException
standard
Regex Library => Bundled library enabled
Dynamic Library Support => enabled
Path to sendmail => /usr/sbin/sendmail -t -i
Directive => Local Value => Master Value
assert.active => 1 => 1
assert.bail => 0 => 0
assert.callback => no value => no value
assert.quiet_eval => 0 => 0
assert.warning => 1 => 1
auto_detect_line_endings => 0 => 0
default_socket_timeout => 60 => 60
safe_mode_allowed_env_vars => PHP_ => PHP_
safe_mode_protected_env_vars => LD_LIBRARY_PATH => LD_LIBRARY_PATH
url_rewriter.tags => a=href,area=href,frame=src,input=src,form=,fieldset= =>
a=href,area=href,frame=src,input=src,form
=,fieldset=
user_agent => no value => no value
xml
XML Support => active
XML Namespace Support => active
libxml2 Version => 2.6.26
zlib
ZLib Support => enabled
Stream Wrapper support => compress.zlib://
Stream Filter support => zlib.inflate, zlib.deflate
Compiled Version => 1.2.3
Linked Version => 1.2.3
Directive => Local Value => Master Value
zlib.output_compression => Off => Off
zlib.output_compression_level => -1 => -1
zlib.output_handler => no value => no value
Additional Modules
Module Name
readline
On Thu, Dec 17, 2009 at 10:13 AM, Rodrigo Aliste P. <ra...@gmail.com>wrote:
> Gary:
>
> The same thing happened to one of my servers. After long research I got to
> the conclusion that the problem was caused by the XCache module. If you have
> it, try to disable it.
>
>
> Rodrigo
>
> 2009/12/16 gary lim <ga...@gmail.com>
>
> Hi,
>>
>> 1. Unfortunately, our website depend heavily on PHP to operate, so it not
>> possible for us to disable it. We also highly suspect that the crash is
>> related to one of our php module because we are running a lot of Joomla
>> component.
>>
>> 2. unfortunately, we are unable to track which module is causing this
>> issue. Any idea how we can check which script is causing the problem because
>> this has been going on for weeks and we are still unable to determine the
>> source.
>>
>> 3. Kindly advise how we can perform the migration of our existing codebase
>> to FastCGI/SCGI without breaking the current website?
>>
>>
>> rgds
>>
>>
>> On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans <te...@googlemail.com>wrote:
>>
>>> On Wed, Dec 16, 2009 at 4:20 PM, gary lim <ga...@gmail.com> wrote:
>>> >
>>> > Dear all,
>>> >
>>> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>>> CPU 3.00GHz GNU/Linux
>>> > 2. The below info are my machine config and log output
>>> > 3. Kindly advise how to resolve intermittent apache crash even after
>>> performance tuning
>>> >
>>> > httpd.conf output
>>> > # prefork MPM [DEFAULT IF USE=-threads]
>>> > # StartServers: number of server processes to start
>>> > # MinSpareServers: minimum number of server processes which are kept
>>> spare
>>> > # MaxSpareServers: maximum number of server processes which are kept
>>> spare
>>> > # MaxClients: maximum number of server processes allowed to start
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> > <IfModule prefork.c>
>>> > StartServers 2
>>> > MinSpareServers 4
>>> > MaxSpareServers 6
>>> > MaxClients 100
>>> > MaxRequestsPerChild 500
>>> > </IfModule>
>>> >
>>> > # worker MPM [DEFAULT IF USE=threads]
>>> > # StartServers: initial number of server processes to start
>>> > # MaxClients: maximum number of simultaneous client connections
>>> > # MinSpareThreads: minimum number of worker threads which are kept
>>> spare
>>> > # MaxSpareThreads: maximum number of worker threads which are kept
>>> spare
>>> > # ThreadsPerChild: constant number of worker threads in each server
>>> process
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> > <IfModule worker.c>
>>> > StartServers 2
>>> > MaxClients 100
>>> > MinSpareThreads 25
>>> > MaxSpareThreads 75
>>> > ThreadsPerChild 25
>>> > MaxRequestsPerChild 500
>>> > </IfModule>
>>> >
>>> >
>>> >
>>> > top output
>>> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
>>> 0.80
>>> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
>>> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi,
>>> 0.0% si
>>> > Mem: 917652k total, 858880k used, 58772k free, 142820k
>>> buffers
>>> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>>> >
>>> > apache2 error log
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b4faf0 ***
>>> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>>> consider raising the MaxClients setting
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x086a1170 ***
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b48c08 ***
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
>>> exit, sending a SIGKILL
>>> >
>>> >
>>> > Joomla / PHP / Apache
>>> > System Information
>>> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
>>> 19:20:15 SGT 2006 i686
>>> > Database Version: 5.0.24a-log
>>> > PHP Version: 5.1.6-pl4-gentoo
>>> > Web Server: Apache
>>> > WebServer to PHP interface: apache2handler
>>> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008
>>> 23:00 UTC
>>> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US;
>>> rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>>> >
>>> > Mysql
>>> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using
>>> readline 5.1
>>> >
>>>
>>> Does it work if you disable PHP? Does it still exhibit problems if you
>>> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
>>> For my money, the double free()s are coming from PHP or a PHP module.
>>>
>>> Cheers
>>>
>>> Tom
>>>
>>> ---------------------------------------------------------------------
>>> The official User-To-User support forum of the Apache HTTP Server
>>> Project.
>>> See <URL:http://httpd.apache.org/userslist.html> for more info.
>>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>>> For additional commands, e-mail: users-help@httpd.apache.org
>>>
>>>
>>
>
>
> --
> Rodrigo Aliste P.
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by "Rodrigo Aliste P." <ra...@gmail.com>.
I just noticed that your error log shows:
[Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
consider raising the MaxClients setting
so try adjusting your MaxClient setting and your prefork settings. (
http://httpd.apache.org/docs/2.0/mod/prefork.html)
I'm not an expert on tuning those settings, but I'm sure someone else here
could help you.
2009/12/16 Rodrigo Aliste P. <ra...@gmail.com>
> Gary:
>
> The same thing happened to one of my servers. After long research I got to
> the conclusion that the problem was caused by the XCache module. If you have
> it, try to disable it.
>
>
> Rodrigo
>
> 2009/12/16 gary lim <ga...@gmail.com>
>
> Hi,
>>
>> 1. Unfortunately, our website depend heavily on PHP to operate, so it not
>> possible for us to disable it. We also highly suspect that the crash is
>> related to one of our php module because we are running a lot of Joomla
>> component.
>>
>> 2. unfortunately, we are unable to track which module is causing this
>> issue. Any idea how we can check which script is causing the problem because
>> this has been going on for weeks and we are still unable to determine the
>> source.
>>
>> 3. Kindly advise how we can perform the migration of our existing codebase
>> to FastCGI/SCGI without breaking the current website?
>>
>>
>> rgds
>>
>>
>> On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans <te...@googlemail.com>wrote:
>>
>>> On Wed, Dec 16, 2009 at 4:20 PM, gary lim <ga...@gmail.com> wrote:
>>> >
>>> > Dear all,
>>> >
>>> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>>> CPU 3.00GHz GNU/Linux
>>> > 2. The below info are my machine config and log output
>>> > 3. Kindly advise how to resolve intermittent apache crash even after
>>> performance tuning
>>> >
>>> > httpd.conf output
>>> > # prefork MPM [DEFAULT IF USE=-threads]
>>> > # StartServers: number of server processes to start
>>> > # MinSpareServers: minimum number of server processes which are kept
>>> spare
>>> > # MaxSpareServers: maximum number of server processes which are kept
>>> spare
>>> > # MaxClients: maximum number of server processes allowed to start
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> > <IfModule prefork.c>
>>> > StartServers 2
>>> > MinSpareServers 4
>>> > MaxSpareServers 6
>>> > MaxClients 100
>>> > MaxRequestsPerChild 500
>>> > </IfModule>
>>> >
>>> > # worker MPM [DEFAULT IF USE=threads]
>>> > # StartServers: initial number of server processes to start
>>> > # MaxClients: maximum number of simultaneous client connections
>>> > # MinSpareThreads: minimum number of worker threads which are kept
>>> spare
>>> > # MaxSpareThreads: maximum number of worker threads which are kept
>>> spare
>>> > # ThreadsPerChild: constant number of worker threads in each server
>>> process
>>> > # MaxRequestsPerChild: maximum number of requests a server process
>>> serves
>>> > <IfModule worker.c>
>>> > StartServers 2
>>> > MaxClients 100
>>> > MinSpareThreads 25
>>> > MaxSpareThreads 75
>>> > ThreadsPerChild 25
>>> > MaxRequestsPerChild 500
>>> > </IfModule>
>>> >
>>> >
>>> >
>>> > top output
>>> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
>>> 0.80
>>> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
>>> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi,
>>> 0.0% si
>>> > Mem: 917652k total, 858880k used, 58772k free, 142820k
>>> buffers
>>> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>>> >
>>> > apache2 error log
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b4faf0 ***
>>> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>>> consider raising the MaxClients setting
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x086a1170 ***
>>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>>> (fasttop): 0x08b48c08 ***
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not
>>> exit, sending a SIGTERM
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
>>> exit, sending a SIGKILL
>>> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
>>> exit, sending a SIGKILL
>>> >
>>> >
>>> > Joomla / PHP / Apache
>>> > System Information
>>> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
>>> 19:20:15 SGT 2006 i686
>>> > Database Version: 5.0.24a-log
>>> > PHP Version: 5.1.6-pl4-gentoo
>>> > Web Server: Apache
>>> > WebServer to PHP interface: apache2handler
>>> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008
>>> 23:00 UTC
>>> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US;
>>> rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>>> >
>>> > Mysql
>>> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using
>>> readline 5.1
>>> >
>>>
>>> Does it work if you disable PHP? Does it still exhibit problems if you
>>> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
>>> For my money, the double free()s are coming from PHP or a PHP module.
>>>
>>> Cheers
>>>
>>> Tom
>>>
>>> ---------------------------------------------------------------------
>>> The official User-To-User support forum of the Apache HTTP Server
>>> Project.
>>> See <URL:http://httpd.apache.org/userslist.html> for more info.
>>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>>> For additional commands, e-mail: users-help@httpd.apache.org
>>>
>>>
>>
>
>
> --
> Rodrigo Aliste P.
>
>
--
Rodrigo Aliste P.
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by "Rodrigo Aliste P." <ra...@gmail.com>.
Gary:
The same thing happened to one of my servers. After long research I got to
the conclusion that the problem was caused by the XCache module. If you have
it, try to disable it.
Rodrigo
2009/12/16 gary lim <ga...@gmail.com>
> Hi,
>
> 1. Unfortunately, our website depend heavily on PHP to operate, so it not
> possible for us to disable it. We also highly suspect that the crash is
> related to one of our php module because we are running a lot of Joomla
> component.
>
> 2. unfortunately, we are unable to track which module is causing this
> issue. Any idea how we can check which script is causing the problem because
> this has been going on for weeks and we are still unable to determine the
> source.
>
> 3. Kindly advise how we can perform the migration of our existing codebase
> to FastCGI/SCGI without breaking the current website?
>
>
> rgds
>
>
> On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans <te...@googlemail.com>wrote:
>
>> On Wed, Dec 16, 2009 at 4:20 PM, gary lim <ga...@gmail.com> wrote:
>> >
>> > Dear all,
>> >
>> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
>> CPU 3.00GHz GNU/Linux
>> > 2. The below info are my machine config and log output
>> > 3. Kindly advise how to resolve intermittent apache crash even after
>> performance tuning
>> >
>> > httpd.conf output
>> > # prefork MPM [DEFAULT IF USE=-threads]
>> > # StartServers: number of server processes to start
>> > # MinSpareServers: minimum number of server processes which are kept
>> spare
>> > # MaxSpareServers: maximum number of server processes which are kept
>> spare
>> > # MaxClients: maximum number of server processes allowed to start
>> > # MaxRequestsPerChild: maximum number of requests a server process
>> serves
>> > <IfModule prefork.c>
>> > StartServers 2
>> > MinSpareServers 4
>> > MaxSpareServers 6
>> > MaxClients 100
>> > MaxRequestsPerChild 500
>> > </IfModule>
>> >
>> > # worker MPM [DEFAULT IF USE=threads]
>> > # StartServers: initial number of server processes to start
>> > # MaxClients: maximum number of simultaneous client connections
>> > # MinSpareThreads: minimum number of worker threads which are kept spare
>> > # MaxSpareThreads: maximum number of worker threads which are kept spare
>> > # ThreadsPerChild: constant number of worker threads in each server
>> process
>> > # MaxRequestsPerChild: maximum number of requests a server process
>> serves
>> > <IfModule worker.c>
>> > StartServers 2
>> > MaxClients 100
>> > MinSpareThreads 25
>> > MaxSpareThreads 75
>> > ThreadsPerChild 25
>> > MaxRequestsPerChild 500
>> > </IfModule>
>> >
>> >
>> >
>> > top output
>> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
>> 0.80
>> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
>> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi,
>> 0.0% si
>> > Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
>> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>> >
>> > apache2 error log
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b4faf0 ***
>> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
>> consider raising the MaxClients setting
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x086a1170 ***
>> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
>> (fasttop): 0x08b48c08 ***
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
>> sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not
>> exit, sending a SIGTERM
>> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
>> exit, sending a SIGKILL
>> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
>> exit, sending a SIGKILL
>> >
>> >
>> > Joomla / PHP / Apache
>> > System Information
>> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
>> 19:20:15 SGT 2006 i686
>> > Database Version: 5.0.24a-log
>> > PHP Version: 5.1.6-pl4-gentoo
>> > Web Server: Apache
>> > WebServer to PHP interface: apache2handler
>> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008
>> 23:00 UTC
>> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
>> Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>> >
>> > Mysql
>> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
>> 5.1
>> >
>>
>> Does it work if you disable PHP? Does it still exhibit problems if you
>> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
>> For my money, the double free()s are coming from PHP or a PHP module.
>>
>> Cheers
>>
>> Tom
>>
>> ---------------------------------------------------------------------
>> The official User-To-User support forum of the Apache HTTP Server Project.
>> See <URL:http://httpd.apache.org/userslist.html> for more info.
>> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
>> " from the digest: users-digest-unsubscribe@httpd.apache.org
>> For additional commands, e-mail: users-help@httpd.apache.org
>>
>>
>
--
Rodrigo Aliste P.
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by gary lim <ga...@gmail.com>.
Hi,
1. Unfortunately, our website depend heavily on PHP to operate, so it not
possible for us to disable it. We also highly suspect that the crash is
related to one of our php module because we are running a lot of Joomla
component.
2. unfortunately, we are unable to track which module is causing this issue.
Any idea how we can check which script is causing the problem because this
has been going on for weeks and we are still unable to determine the source.
3. Kindly advise how we can perform the migration of our existing codebase
to FastCGI/SCGI without breaking the current website?
rgds
On Thu, Dec 17, 2009 at 12:28 AM, Tom Evans <te...@googlemail.com>wrote:
> On Wed, Dec 16, 2009 at 4:20 PM, gary lim <ga...@gmail.com> wrote:
> >
> > Dear all,
> >
> > 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4
> CPU 3.00GHz GNU/Linux
> > 2. The below info are my machine config and log output
> > 3. Kindly advise how to resolve intermittent apache crash even after
> performance tuning
> >
> > httpd.conf output
> > # prefork MPM [DEFAULT IF USE=-threads]
> > # StartServers: number of server processes to start
> > # MinSpareServers: minimum number of server processes which are kept
> spare
> > # MaxSpareServers: maximum number of server processes which are kept
> spare
> > # MaxClients: maximum number of server processes allowed to start
> > # MaxRequestsPerChild: maximum number of requests a server process serves
> > <IfModule prefork.c>
> > StartServers 2
> > MinSpareServers 4
> > MaxSpareServers 6
> > MaxClients 100
> > MaxRequestsPerChild 500
> > </IfModule>
> >
> > # worker MPM [DEFAULT IF USE=threads]
> > # StartServers: initial number of server processes to start
> > # MaxClients: maximum number of simultaneous client connections
> > # MinSpareThreads: minimum number of worker threads which are kept spare
> > # MaxSpareThreads: maximum number of worker threads which are kept spare
> > # ThreadsPerChild: constant number of worker threads in each server
> process
> > # MaxRequestsPerChild: maximum number of requests a server process serves
> > <IfModule worker.c>
> > StartServers 2
> > MaxClients 100
> > MinSpareThreads 25
> > MaxSpareThreads 75
> > ThreadsPerChild 25
> > MaxRequestsPerChild 500
> > </IfModule>
> >
> >
> >
> > top output
> > top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85,
> 0.80
> > Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
> > Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi, 0.0%
> si
> > Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
> > Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
> >
> > apache2 error log
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b4faf0 ***
> > [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting,
> consider raising the MaxClients setting
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x086a1170 ***
> > *** glibc detected *** /usr/sbin/apache2: double free or corruption
> (fasttop): 0x08b48c08 ***
> > [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit,
> sending a SIGTERM
> > [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit,
> sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not
> exit, sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not
> exit, sending a SIGKILL
> > [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not
> exit, sending a SIGKILL
> >
> >
> > Joomla / PHP / Apache
> > System Information
> > PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23
> 19:20:15 SGT 2006 i686
> > Database Version: 5.0.24a-log
> > PHP Version: 5.1.6-pl4-gentoo
> > Web Server: Apache
> > WebServer to PHP interface: apache2handler
> > Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00
> UTC
> > User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15)
> Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
> >
> > Mysql
> > mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline
> 5.1
> >
>
> Does it work if you disable PHP? Does it still exhibit problems if you
> run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
> For my money, the double free()s are coming from PHP or a PHP module.
>
> Cheers
>
> Tom
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Tom Evans <te...@googlemail.com>.
On Wed, Dec 16, 2009 at 4:20 PM, gary lim <ga...@gmail.com> wrote:
>
> Dear all,
>
> 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux
> 2. The below info are my machine config and log output
> 3. Kindly advise how to resolve intermittent apache crash even after performance tuning
>
> httpd.conf output
> # prefork MPM [DEFAULT IF USE=-threads]
> # StartServers: number of server processes to start
> # MinSpareServers: minimum number of server processes which are kept spare
> # MaxSpareServers: maximum number of server processes which are kept spare
> # MaxClients: maximum number of server processes allowed to start
> # MaxRequestsPerChild: maximum number of requests a server process serves
> <IfModule prefork.c>
> StartServers 2
> MinSpareServers 4
> MaxSpareServers 6
> MaxClients 100
> MaxRequestsPerChild 500
> </IfModule>
>
> # worker MPM [DEFAULT IF USE=threads]
> # StartServers: initial number of server processes to start
> # MaxClients: maximum number of simultaneous client connections
> # MinSpareThreads: minimum number of worker threads which are kept spare
> # MaxSpareThreads: maximum number of worker threads which are kept spare
> # ThreadsPerChild: constant number of worker threads in each server process
> # MaxRequestsPerChild: maximum number of requests a server process serves
> <IfModule worker.c>
> StartServers 2
> MaxClients 100
> MinSpareThreads 25
> MaxSpareThreads 75
> ThreadsPerChild 25
> MaxRequestsPerChild 500
> </IfModule>
>
>
>
> top output
> top - 00:09:00 up 157 days, 23:12, 2 users, load average: 0.67, 0.85, 0.80
> Tasks: 47 total, 1 running, 46 sleeping, 0 stopped, 0 zombie
> Cpu(s): 8.3% us, 1.4% sy, 0.0% ni, 88.0% id, 2.2% wa, 0.0% hi, 0.0% si
> Mem: 917652k total, 858880k used, 58772k free, 142820k buffers
> Swap: 1048568k total, 37844k used, 1010724k free, 434476k cached
>
> apache2 error log
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x08b4faf0 ***
> [Tue Dec 15 13:04:22 2009] [error] server reached MaxClients setting, consider raising the MaxClients setting
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x086a1170 ***
> *** glibc detected *** /usr/sbin/apache2: double free or corruption (fasttop): 0x08b48c08 ***
> [Wed Dec 16 23:53:07 2009] [warn] child process 1325 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 19910 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 10569 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 16964 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:07 2009] [warn] child process 19718 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 1325 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 19910 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 10569 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 16964 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:09 2009] [warn] child process 19718 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 1325 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 19910 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 10569 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 16964 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:11 2009] [warn] child process 19718 still did not exit, sending a SIGTERM
> [Wed Dec 16 23:53:13 2009] [error] child process 1325 still did not exit, sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 19910 still did not exit, sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 10569 still did not exit, sending a SIGKILL
> [Wed Dec 16 23:53:13 2009] [error] child process 16964 still did not exit, sending a SIGKILL
>
>
> Joomla / PHP / Apache
> System Information
> PHP built On: Linux trillian 2.6.16.29-ab1-xenU #1 SMP Sat Sep 23 19:20:15 SGT 2006 i686
> Database Version: 5.0.24a-log
> PHP Version: 5.1.6-pl4-gentoo
> Web Server: Apache
> WebServer to PHP interface: apache2handler
> Joomla! Version: Joomla! 1.0.15 Stable [ Daytime ] 22 February 2008 23:00 UTC
> User Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.15) Gecko/2009101601 Firefox/3.0.15 (.NET CLR 3.5.30729)
>
> Mysql
> mysql Ver 14.12 Distrib 5.0.24a, for pc-linux-gnu (i686) using readline 5.1
>
Does it work if you disable PHP? Does it still exhibit problems if you
run PHP out of process, eg using fastcgi or scgi (can PHP talk SCGI?).
For my money, the double free()s are coming from PHP or a PHP module.
Cheers
Tom
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org
Re: [users@httpd] Apache intermittent crash - HELP!!!
Posted by Nick Kew <ni...@webthing.com>.
On 16 Dec 2009, at 16:20, gary lim wrote:
> Dear all,
>
> 1. I'm using Linux 2.6.16.29 and running on i686 Intel(R) Pentium(R) 4 CPU 3.00GHz GNU/Linux
but no sign of your APR and Apache versions.
--
Nick Kew
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org