You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@httpd.apache.org by Webmaster <we...@filarescue.org> on 2004/07/16 16:57:44 UTC

Re[2]: [users@httpd] uh oh...

*This message was transferred with a trial version of CommuniGate(tm) Pro*

(Apologies for the long email - there is a copy/paste of some output near the bottom)

>Are all your modules consistently compiled? This *might* be because you
>upgraded Apache but didn't recompile all modules.

Yes, as a matter of fact... I use portupgrade with FreeBSD, and I gave it the -fRr flags which forces the upgrade (recompile), even if the version is the most current, and also recompiles all other packages that 1) depend on Apache, and 2) Apache depends on.


>The other option is to start dropping modules from your build until
>the problem goes away.

What is odd about that suggestion... I thought of that, too.... I previously dropped the mod_security module because of some strange error log entries (although mod_security seemed to perform correctly). I commented it out of the httpd.conf file to see if that stopped the error entries. It did. But it also started causing the new/worse problem. Putting mod_security back into httpd.conf brought back the strange log errors, but at least it's not sucking up all the CPU (for now!).

Also, as was suggested (SORRY this is so long):

server# gdb /usr/local/sbin/httpd -c /usr/local/httpd.core
GNU gdb 5.2.1 (FreeBSD)
Copyright 2002 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-unknown-freebsd"...(no debugging symbols found)...
Core was generated by `httpd'.
Program terminated with signal 4, Illegal instruction.
Reading symbols from /lib/libz.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libz.so.2
Reading symbols from /usr/local/lib/libssl.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libssl.so.3
Reading symbols from /usr/local/lib/libcrypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libcrypto.so.3
Reading symbols from /usr/local/lib/apache2/libaprutil-0.so.9...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/apache2/libaprutil-0.so.9
Reading symbols from /usr/local/lib/libexpat.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libexpat.so.5
Reading symbols from /usr/local/lib/libiconv.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libiconv.so.3
Reading symbols from /usr/local/lib/apache2/libapr-0.so.9...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/apache2/libapr-0.so.9
Reading symbols from /lib/libm.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.2
Reading symbols from /lib/libcrypt.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.2
Reading symbols from /lib/libc.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.5
Reading symbols from /usr/local/libexec/apache2/mod_access.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_access.so
Reading symbols from /usr/local/libexec/apache2/mod_auth.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_auth.so
Reading symbols from /usr/local/libexec/apache2/mod_auth_anon.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_auth_anon.so
Reading symbols from /usr/local/libexec/apache2/mod_auth_dbm.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_auth_dbm.so
Reading symbols from /usr/local/libexec/apache2/mod_charset_lite.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_charset_lite.so
Reading symbols from /usr/local/libexec/apache2/mod_include.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_include.so
Reading symbols from /usr/local/libexec/apache2/mod_deflate.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_deflate.so
Reading symbols from /usr/local/libexec/apache2/mod_log_config.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_log_config.so
Reading symbols from /usr/local/libexec/apache2/mod_logio.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_logio.so
Reading symbols from /usr/local/libexec/apache2/mod_env.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_env.so
Reading symbols from /usr/local/libexec/apache2/mod_mime_magic.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_mime_magic.so
Reading symbols from /usr/local/libexec/apache2/mod_cern_meta.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_cern_meta.so
Reading symbols from /usr/local/libexec/apache2/mod_expires.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_expires.so
Reading symbols from /usr/local/libexec/apache2/mod_headers.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_headers.so
Reading symbols from /usr/local/libexec/apache2/mod_usertrack.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_usertrack.so
Reading symbols from /usr/local/libexec/apache2/mod_unique_id.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_unique_id.so
Reading symbols from /usr/local/libexec/apache2/mod_setenvif.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_setenvif.so
Reading symbols from /usr/local/libexec/apache2/mod_mime.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_mime.so
Reading symbols from /usr/local/libexec/apache2/mod_status.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_status.so
Reading symbols from /usr/local/libexec/apache2/mod_autoindex.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_autoindex.so
Reading symbols from /usr/local/libexec/apache2/mod_asis.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_asis.so
Reading symbols from /usr/local/libexec/apache2/mod_info.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_info.so
Reading symbols from /usr/local/libexec/apache2/mod_cgi.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_cgi.so
Reading symbols from /usr/local/libexec/apache2/mod_vhost_alias.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_vhost_alias.so
Reading symbols from /usr/local/libexec/apache2/mod_negotiation.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_negotiation.so
Reading symbols from /usr/local/libexec/apache2/mod_dir.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_dir.so
Reading symbols from /usr/local/libexec/apache2/mod_imap.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_imap.so
Reading symbols from /usr/local/libexec/apache2/mod_actions.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_actions.so
Reading symbols from /usr/local/libexec/apache2/mod_speling.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_speling.so
Reading symbols from /usr/local/libexec/apache2/mod_userdir.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_userdir.so
Reading symbols from /usr/local/libexec/apache2/mod_alias.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_alias.so
Reading symbols from /usr/local/libexec/apache2/mod_rewrite.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_rewrite.so
Reading symbols from /usr/local/libexec/apache2/mod_security.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/mod_security.so
Reading symbols from /usr/local/libexec/apache2/libphp4.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache2/libphp4.so
---Type <return> to continue, or q <return> to quit---
Reading symbols from /usr/local/lib/libmcal.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libmcal.so
Reading symbols from /usr/local/lib/libc-client4.so.8...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libc-client4.so.8
Reading symbols from /usr/local/lib/libzzip.so.10...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libzzip.so.10
Reading symbols from /usr/local/lib/mysql/libmysqlclient.so.12...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/mysql/libmysqlclient.so.12
Reading symbols from /usr/local/lib/libming.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libming.so.3
Reading symbols from /usr/local/lib/libmhash.so.2...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libmhash.so.2
Reading symbols from /usr/local/lib/libmcrypt.so.8...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libmcrypt.so.8
Reading symbols from /usr/local/lib/libltdl.so.4...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libltdl.so.4
Reading symbols from /usr/lib/libpam.so.2...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libpam.so.2
Reading symbols from /usr/local/lib/libgmp.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libgmp.so.6
Reading symbols from /usr/local/lib/libintl.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libintl.so.6
Reading symbols from /usr/local/lib/libt1.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libt1.so.5
Reading symbols from /usr/local/lib/libfreetype.so.9...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libfreetype.so.9
Reading symbols from /usr/X11R6/lib/libX11.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/X11R6/lib/libX11.so.6
Reading symbols from /usr/X11R6/lib/libXpm.so.4...(no debugging symbols found)...done.
Loaded symbols for /usr/X11R6/lib/libXpm.so.4
Reading symbols from /usr/local/lib/libpng.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libpng.so.5
Reading symbols from /usr/local/lib/libjpeg.so.9...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libjpeg.so.9
Reading symbols from /usr/local/lib/libexslt.so.8...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libexslt.so.8
Reading symbols from /usr/local/lib/libxml2.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libxml2.so.5
Reading symbols from /usr/local/lib/libxslt.so.2...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libxslt.so.2
Reading symbols from /usr/local/lib/libcurl.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libcurl.so.3
Reading symbols from /usr/local/lib/libcrack.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libcrack.so
Reading symbols from /usr/lib/libbz2.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libbz2.so.1
Reading symbols from /usr/local/lib/libudmsearch.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/local/lib/libudmsearch.so.1
Reading symbols from /usr/lib/libssl.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libssl.so.3
Reading symbols from /lib/libcrypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypto.so.3
Reading symbols from /usr/X11R6/lib/libXext.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/X11R6/lib/libXext.so.6
Reading symbols from /usr/lib/libc_r.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libc_r.so.5
Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done.
Loaded symbols for /libexec/ld-elf.so.1
#0  0x28f5f712 in event_to_wire () from /usr/X11R6/lib/libXext.so.6
(gdb) where
#0  0x28f5f712 in event_to_wire () from /usr/X11R6/lib/libXext.so.6
#1  0x0808176e in unixd_pre_config ()
#2  0x080649fe in prefork_pre_config ()
#3  0x08065197 in ap_run_pre_config ()
#4  0x0806b0b0 in main ()
#5  0x0805cef2 in _start ()

libXext is the problem?

Not sure if it's any of these:

server# pkg_version -v | grep lib
XFree86-libraries-4.3.0_7           =   up-to-date with port
cracklib-2.7_2                      =   up-to-date with port
libfpx-1.2.0.9                      =   up-to-date with port
libgmp-4.1.3                        =   up-to-date with port
libiconv-1.9.2                      =   up-to-date with port
libltdl-1.5.6                       =   up-to-date with port
libmcal-0.7_1                       =   up-to-date with port
libmcrypt-2.5.7_1                   =   up-to-date with port
libtool-1.3.5_2                     =   up-to-date with port
libtool-1.5.6_1                     =   up-to-date with port
libungif-4.1.3                      =   up-to-date with port
libwmf-0.2.8.3                      =   up-to-date with port
libxml2-2.6.11_1                    =   up-to-date with port
libxslt-1.1.8_1                     =   up-to-date with port
p5-libwww-5.79_1                    =   up-to-date with port
t1lib-5.0.1,1                       =   up-to-date with port
zziplib-0.10.82                     =   up-to-date with port

server# pkg_info -Rr apache-2.0.50
Information for apache-2.0.50:

Depends on:
Dependency: perl-5.8.4
Dependency: openssl-0.9.7d
Dependency: libiconv-1.9.2
Dependency: expat-1.95.7
Required by:
mnogosearch-3.1.21_1
mod_security-1.8.2
pear-Archive_Tar-1.2
pear-Console_Getopt-1.2
pear-PEAR-1.3.1
pear-XML_RPC-1.1.0
php4-4.3.8
phpMyAdmin-2.5.7.1

Thanks tons for all the suggestions / pointers,
Chris


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re[6]: [users@httpd] uh oh...

Posted by Webmaster <we...@filarescue.org>.
*This message was transferred with a trial version of CommuniGate(tm) Pro*




>Personally, I wouldn't be surprised if there was some deaper problem
>in your system.


Well, I backed down to 1.3 and everything is back to normal. I didn't have to change versions anything else, so that was nice. I'm not sure what went wrong, but version 2 just never really ran quite right (either that strange mutex error, or the hanging). It would be nice to know what was causing that, but it's probably way beyond my ability to figure out. And the problem with bouncing around with versions is the downtime. Not much of it, and it's not a very mission critical server, but people do miss the sites when they are offline.

Thanks for everyone's help and ideas,
Chris


---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: Re[4]: [users@httpd] uh oh...

Posted by Joshua Slive <js...@gmail.com>.
On Fri, 16 Jul 2004 13:05:26 -0500, Webmaster <we...@filarescue.org> wrote:
> I see this in the httpd error log, usually within about an hour from when httpd starts sucking up all the CPU:
> 
> [Fri Jul 16 10:29:14 2004] [info] (32)Broken pipe: core_output_filter: writing data to the network

That is not really an error, but simply "info".  It means that a
client disconnected before all the data was written (stop button
pressed or some such thing).

> 
> Based on the unixd_pre_config having to do with suexec, should I do away with suexec completely, and see if that helps?

That would just be a shot in the dark.  I would try first to look at
some other core dumps.  The one you posted was the problem you had
restarting apache.  It doesn't say anything about the problem that
caused running processes to die.

Personally, I wouldn't be surprised if there was some deaper problem
in your system.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re[4]: [users@httpd] uh oh...

Posted by Webmaster <we...@filarescue.org>.
*This message was transferred with a trial version of CommuniGate(tm) Pro*

>> (gdb) where
>> #0  0x28f5f712 in event_to_wire () from /usr/X11R6/lib/libXext.so.6
>> #1  0x0808176e in unixd_pre_config ()
>> #2  0x080649fe in prefork_pre_config ()
>> #3  0x08065197 in ap_run_pre_config ()
>> #4  0x0806b0b0 in main ()
>> #5  0x0805cef2 in _start ()
>> 
>> libXext is the problem?
>
>I have no idea.  That's pretty odd.  The only thing that
>unixd_pre_config does is stat the suexec binary to see if it exists
>and is suid.  Why that would result in a call to libXext, I don't
>know.  I also have no idea what event_to_wire is.


I've noticed a pattern, for what it's worth.....

I see this in the httpd error log, usually within about an hour from when httpd starts sucking up all the CPU:

[Fri Jul 16 10:29:14 2004] [info] (32)Broken pipe: core_output_filter: writing data to the network

Based on the unixd_pre_config having to do with suexec, should I do away with suexec completely, and see if that helps?

Chris



---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org


Re: Re[2]: [users@httpd] uh oh...

Posted by Joshua Slive <js...@gmail.com>.
On Fri, 16 Jul 2004 09:57:44 -0500, Webmaster <we...@filarescue.org> wrote:

> (gdb) where
> #0  0x28f5f712 in event_to_wire () from /usr/X11R6/lib/libXext.so.6
> #1  0x0808176e in unixd_pre_config ()
> #2  0x080649fe in prefork_pre_config ()
> #3  0x08065197 in ap_run_pre_config ()
> #4  0x0806b0b0 in main ()
> #5  0x0805cef2 in _start ()
> 
> libXext is the problem?

I have no idea.  That's pretty odd.  The only thing that
unixd_pre_config does is stat the suexec binary to see if it exists
and is suid.  Why that would result in a call to libXext, I don't
know.  I also have no idea what event_to_wire is.

Joshua.

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
   "   from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org