You are viewing a plain text version of this content. The canonical link for it is here.
Posted to bugs@httpd.apache.org by bu...@apache.org on 2002/07/11 16:41:27 UTC

DO NOT REPLY [Bug 10698] New: - Error - jk_tcp_socket_recvfull failed in mod_jk

DO NOT REPLY TO THIS EMAIL, BUT PLEASE POST YOUR BUG 
RELATED COMMENTS THROUGH THE WEB INTERFACE AVAILABLE AT
<http://nagoya.apache.org/bugzilla/show_bug.cgi?id=10698>.
ANY REPLY MADE TO THIS MESSAGE WILL NOT BE COLLECTED AND 
INSERTED IN THE BUG DATABASE.

http://nagoya.apache.org/bugzilla/show_bug.cgi?id=10698

Error - jk_tcp_socket_recvfull failed in mod_jk

           Summary: Error - jk_tcp_socket_recvfull failed in mod_jk
           Product: Apache httpd-1.3
           Version: 1.3.26
          Platform: PC
        OS/Version: Linux
            Status: NEW
          Severity: Major
          Priority: Other
         Component: Other mods
        AssignedTo: bugs@httpd.apache.org
        ReportedBy: ssasa@iskon.hr


Hi,

we have a system with two Apache web servers (1.3.26) on Debian Linux
(Intel) and one Tomcat 4.0.4 final on Solaris 8 (Sparc). The system is
experiencing heavy loads. Daily, Tomcat serves 200 000 - 300 000 requests.
We have two frontends because of lot of static content. Tomcat runs
on j2se1_4_0_01. We have set maxProcessors in Tomcat Ajp13 connector
to 800.

>From time to time on our Apaches jk.log we see these messages:

[Thu Jul 11 16:18:30 2002]  [jk_ajp_common.c (652)]:
ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed
[Thu Jul 11 16:18:30 2002]  [jk_ajp_common.c (1013)]: Error reading reply
[Thu Jul 11 16:18:30 2002]  [jk_ajp_common.c (1150)]: In jk_endpoint_t::service,
ajp_get_reply failed in send loop 0
[Thu Jul 11 16:18:44 2002]  [jk_ajp_common.c (652)]:
ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed
[Thu Jul 11 16:18:44 2002]  [jk_ajp_common.c (1013)]: Error reading reply
[Thu Jul 11 16:18:44 2002]  [jk_ajp_common.c (1150)]: In jk_endpoint_t::service,
ajp_get_reply failed in send loop 0
[Thu Jul 11 16:19:08 2002]  [jk_ajp_common.c (652)]:
ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed
[Thu Jul 11 16:19:08 2002]  [jk_ajp_common.c (1013)]: Error reading reply
[Thu Jul 11 16:19:08 2002]  [jk_ajp_common.c (1150)]: In jk_endpoint_t::service,
ajp_get_reply failed in send loop 0

Sometimes we see also these errors:

[Thu Jul 11 16:19:16 2002]  [jk_ajp_common.c (933)]: Error ajp_process_callback
- write failed
[Thu Jul 11 16:19:51 2002]  [jk_ajp_common.c (933)]: Error ajp_process_callback
- write failed

These errors as a result do not show web pages.

Restart of web servers helps a bit, but when we leave the Apaches to run
more hours we run out of Tomcat worker threads (the limit is 800).
In the thread dump we can see that almost all of 800 Threads have this
stack trace:

"Ajp13Processor[8090][24]" daemon prio=5 tid=0x327778 nid=0x29 runnable
[da481000..da4819c0]
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.read(SocketInputStream.java:116)
        at org.apache.ajp.Ajp13.readN(Ajp13.java:429)
        at org.apache.ajp.Ajp13.receive(Ajp13.java:469)
        at org.apache.ajp.Ajp13.receiveNextRequest(Ajp13.java:274)
        at org.apache.ajp.tomcat4.Ajp13Processor.process(Ajp13Processor.java:371)
        at org.apache.ajp.tomcat4.Ajp13Processor.run(Ajp13Processor.java:495)
        at java.lang.Thread.run(Thread.java:536)

They are all (almost :) waiting for mod_jk to send something, and mod_jk
doesn't send anything. These pointed us that the problem might be in mod_jk.

There is another problem that we didn't succeed to correlate to the first
one, and this is shown in catalina.out log:

BAD packet 18516
In: : [B@9b86ea 4/21588
48 54 54 50 02 02 00 08 48 54 54 50 2f 31 2e 31  | HTTP....HTTP.1.1
00 00 0f 2f 73 65 72 76 6c 65 74 2f 61 6e 6b 65  | ....servlet.anke
74 61 00 00 0f 32 31 33 2e 31 39 31 2e 31 34 33  | ta...213.191.143
2e 31 33 39 00 ff ff 00 0c 77 77 77 2e 69 73 6b  | .139.....www.isk
6f 6e 2e 68 72 00 00 50 00 00 08 a0 01 00 38 69  | on.hr..P...?..8i
6d 61 67 65 2f 67 69 66 2c 20 69 6d 61 67 65 2f  | mage.gif..image.
78 2d 78 62 69 74 6d 61 70 2c 20 69 6d 61 67 65  | x.xbitmap..image
2f 6a 70 65 67 2c 20 69 6d 61 67 65 2f 70 6a 70  | .jpeg..image.pjp
65 67 2c 20 2a 2f 2a 00 a0 03 00 0d 67 7a 69 70  | eg......?...gzip
2c 20 64 65 66 6c 61 74 65 00 a0 04 00 05 65 6e  | ..deflate.?...en
2d 75 73 00 a0 06 00 0a 4b 65 65 70 2d 41 6c 69  | .us.?...Keep.Ali
76 65 00 a0 0b 00 0c 77 77 77 2e 69 73 6b 6f 6e  | ve.?...www.iskon
2e 68 72 00 a0 0d 00 13 68 74 74 70 3a 2f 2f 77  | .hr.?...http...w
77 77 2e 69 73 6b 6f 6e 2e 68 72 00 a0 0e 00 2e  | ww.iskon.hr.?...
4d 6f 7a 69 6c 6c 61 2f 34 2e 30 20 28 63 6f 6d  | Mozilla.4.0..com
70 61 74 69 62 6c 65 3b 20 4d 53 49 45 20 36 2e  | patible..MSIE.6.
30 3b 20 57 69 6e 64 6f 77 73 20 39 38 29 00 a0  | 0..Windows.98..?
08 00 01 30 00 05 00 4a 71 75 65 73 74 69 6f 6e  | ...0...Jquestion
69 64 3d 32 30 30 32 30 37 31 30 30 32 34 39 30  | id.2002071002490
31 33 26 6f 70 74 69 6f 6e 69 64 3d 32 30 30 32  | 13.optionid.2002
30 37 31 30 30 32 35 33 30 31 34 26 73 75 62 6d  | 07100253014.subm
69 74 2e 78 3d 32 35 26 73 75 62 6d 69 74 2e 79  | it.x.25.submit.y
3d 38 00 ff 00 00 00 00 00 00 00 00 00 00 00 00  | .8..............
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  | ................
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  | ................

Does anyone have an idea what to investigate further ?
(or how to solve this problems)

Thanks,

Sasa Skevin
ssasa@iskon.hr

---------------------------------------------------------------------
To unsubscribe, e-mail: bugs-unsubscribe@httpd.apache.org
For additional commands, e-mail: bugs-help@httpd.apache.org