You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tomcat.apache.org by Mauricio Nuñez <ma...@chile.com> on 2005/07/27 20:13:47 UTC

APR AJP Connector loosing data

Hi developers!

Well, I was testing the experimental APR AJP connector, with 2 web pages
at my site. Using Tomcat 5.5.10

Both pages are loosing 16368 bytes. 

I'm attaching the pages. Using  kompare under linux , you can check
clearly where is the diff.

Thanks

Mauricio Nuñez
mauricio@chile.com





Re: APR AJP Connector loosing data

Posted by Mauricio Nuñez <ma...@chile.com>.
> > 
> > What kind of data may be relevant for you ?
> 
> That it's working is pretty good already, but you should mention your 
> OS. I built the AJP APR implementation using lots of cut & paste of the 
> existing AJP code, and for the most part, just to "have it", as I don't 
> expect major benefits (except in one special case where the amount of 
> request processors on the front end is huge compared to the amount of 
> request processors that can realistically be used on the back end - 
> often it's the other way around, so there's no problem).

CentOS release 4.1 (Final)

Linux 2.6.9-11.ELsmp 

httpd-2.0.52-12.1.ent.centos4

java version "1.5.0_03"

Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_03-b07)
Java HotSpot(TM) Client VM (build 1.5.0_03-b07, mixed mode, sharing)

mod_jk/1.2.10

Jakarta-Tomcat 5.5.10 + APR Fixes.


Thanks

Mauricio 

> 
> Rémy
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Remy Maucherat <re...@apache.org>.
Mauricio Nuñez wrote:
> El jue, 28-07-2005 a las 14:25 +0200, Remy Maucherat escribió:
> 
> OK. But may be more easy, It's not very "out of the box" .

Since the out of the box version has a bug, the "out of the box" 
experience is going to suck, there's nothing I can do about it.

>>I noticed that after trying random stuff. While it's good to send 
>>details, it's less useful to send them after the bug has been fixed.
> 
> OK. The test case is for the list archive, not only for you. The smart
> people search the archives before send a bug. 

Ok.

> I'm testing your change, all is working again. 
> 65 ajp workers on machine 1, 95 ajp workers on machine 2. 
> 
> The heap usage grow smoothly. 
> My sample is about 20 min. 
> 
> What kind of data may be relevant for you ?

That it's working is pretty good already, but you should mention your 
OS. I built the AJP APR implementation using lots of cut & paste of the 
existing AJP code, and for the most part, just to "have it", as I don't 
expect major benefits (except in one special case where the amount of 
request processors on the front end is huge compared to the amount of 
request processors that can realistically be used on the back end - 
often it's the other way around, so there's no problem).

Rémy

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Mauricio Nuñez <ma...@chile.com>.
El jue, 28-07-2005 a las 14:25 +0200, Remy Maucherat escribió:
> Mauricio Nuñez wrote:
> > 
> > Thanks. 
> > 
> > I'm begining to recompile the CVS connector to try. Now I'm fighting
> > with  "the jakarta jar hell" :-) . 
> 
> There's no hell involved ... There's one source file involved (actually, 
> only one line). What you need to do is javac that one class (which only 
> depends only on JARs which are in the Tomcat bundle in server/lib: 
> tomcat-apr, tomcat-util, tomcat-coyote, tomcat-ajp). Even getting the 
> full thing is easy as long as you know Ant (ant download; ant).
> 

OK. But may be more easy, It's not very "out of the box" .

My steps :

downloadind  jakarta-tomcat-5.5.10-src.tar.gz, 
untarring it , 
creating build.properties from samples, 
ant download , 
s/telia.dl.sourceforge.net/easynews.dl.sourceforge.net 
ant download ,
changing build.properties 
ant -projecthelp
for( various dirs ) ant compile
etc

...

> I noticed that after trying random stuff. While it's good to send 
> details, it's less useful to send them after the bug has been fixed.
> 

OK. The test case is for the list archive, not only for you. The smart
people search the archives before send a bug. 

I'm testing your change, all is working again. 
65 ajp workers on machine 1, 95 ajp workers on machine 2. 

The heap usage grow smoothly. 
My sample is about 20 min. 

What kind of data may be relevant for you ?

Thanks 

Mauricio


> Rémy
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Remy Maucherat <re...@apache.org>.
Mauricio Nuñez wrote:
> El jue, 28-07-2005 a las 01:09 +0200, Remy Maucherat escribió:
> 
>>Mauricio Nuñez wrote:
>>
>>>Apparently , my report was useful! :-)
>>
>>The issue turned out to be really basic. Any other problems besides that ?
>>
>>Rémy
>>
> 
> 
> Thanks. 
> 
> I'm begining to recompile the CVS connector to try. Now I'm fighting
> with  "the jakarta jar hell" :-) . 

There's no hell involved ... There's one source file involved (actually, 
only one line). What you need to do is javac that one class (which only 
depends only on JARs which are in the Tomcat bundle in server/lib: 
tomcat-apr, tomcat-util, tomcat-coyote, tomcat-ajp). Even getting the 
full thing is easy as long as you know Ant (ant download; ant).

> Now I'm testing the NIO connector. 
> After the compilation, I'will send you my results. 
> 
>  
> Well, for the log, the test case about the APR AJP loosing data is to
> configure apache2 + mod_jk + Tomcat woth Apr AJP13 socket, and try any
> page with size > 8192. Tested with Linux Centos 4, Sun JDK 1.5.0_03.

I noticed that after trying random stuff. While it's good to send 
details, it's less useful to send them after the bug has been fixed.

Rémy

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Mauricio Nuñez <ma...@chile.com>.
El jue, 28-07-2005 a las 01:09 +0200, Remy Maucherat escribió:
> Mauricio Nuñez wrote:
> > Apparently , my report was useful! :-)
> 
> The issue turned out to be really basic. Any other problems besides that ?
> 
> Rémy
> 

Thanks. 

I'm begining to recompile the CVS connector to try. Now I'm fighting
with  "the jakarta jar hell" :-) . 

Now I'm testing the NIO connector. 
After the compilation, I'will send you my results. 

 
Well, for the log, the test case about the APR AJP loosing data is to
configure apache2 + mod_jk + Tomcat woth Apr AJP13 socket, and try any
page with size > 8192. Tested with Linux Centos 4, Sun JDK 1.5.0_03.

wget http://tomcat3.chile.com/tomcat-docs/changelog.html

Petición HTTP enviada, esperando respuesta... 200 OK
Longitud: 128,310 [text/html]

68% [========================>            ] 87,390        --.--K/s

06:35:10 (1.95 MB/s) - Connection closed at byte 87,390. Reintentando.

--06:35:11--  http://tomcat3.chile.com/tomcat-docs/changelog.html 
  (intento: 2) => `changelog.html'
Conectando con tomcat3.chile.com[10.0.0.43]:80... conectado.
Petición HTTP enviada, esperando respuesta... 206 Partial Content
Longitud: 128,310 (40,920 para acabar) [text/html]

87% [+++++++++++++++++++++++++======>     ] 111,942       --.--K/s

06:35:26 (549.77 KB/s) - Connection closed at byte 111,942. Reintentando.

--06:35:28--  http://tomcat3.chile.com/tomcat-docs/changelog.html
  (intento: 3) => `changelog.html'
Conectando con tomcat3.chile.com[10.0.0.43]:80... conectado.
Petición HTTP enviada, esperando respuesta... 206 Partial Content
Longitud: 128,310 (16,368 para acabar) [text/html]

93% [++++++++++++++++++++++++++++++++=>   ] 120,126       --.--K/s

06:35:43 (415.22 KB/s) - Connection closed at byte 120,126. Reintentando.

--06:35:46--  http://tomcat3.chile.com/tomcat-docs/changelog.html
  (intento: 4) => `changelog.html'
Conectando con tomcat3.chile.com[10.0.0.43]:80... conectado.
Petición HTTP enviada, esperando respuesta... 206 Partial Content
Longitud: 128,310 (8,184 para acabar) [text/html]

100%[++++++++++++++++++++++++++++++++++==>] 128,310       --.--K/s

06:35:46 (510.23 KB/s) - `changelog.html' saved [128,310/128,310]




> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Remy Maucherat <re...@apache.org>.
Mauricio Nuñez wrote:
> Apparently , my report was useful! :-)

The issue turned out to be really basic. Any other problems besides that ?

Rémy

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Mauricio Nuñez <ma...@chile.com>.
El mié, 27-07-2005 a las 21:01 +0200, Remy Maucherat escribió:
> Mauricio Nuñez wrote:
> > Well, the files are equals  for the first 8112 - 8185 bytes, aprox . 
> > 
> > May be 8192 (2 ^ 13), but the lines pre y post data loss are too
> > similarly  :-) 
> 
> I was being sarcastic ;) Your report is not a test case I can use, so I 
> can't do much.
> 

Apparently , my report was useful! :-)

" - After flushing, it's a good idea to write the data."

> Rémy

Thanks!

Mauricio Nuñez

mauricio@chile.com

> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Remy Maucherat <re...@apache.org>.
Mauricio Nuñez wrote:
> Well, the files are equals  for the first 8112 - 8185 bytes, aprox . 
> 
> May be 8192 (2 ^ 13), but the lines pre y post data loss are too
> similarly  :-) 

I was being sarcastic ;) Your report is not a test case I can use, so I 
can't do much.

Rémy

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Mauricio Nuñez <ma...@chile.com>.
El mié, 27-07-2005 a las 20:28 +0200, Remy Maucherat escribió:
> Mauricio Nuñez wrote:
> > Hi developers!
> > 
> > Well, I was testing the experimental APR AJP connector, with 2 web pages
> > at my site. Using Tomcat 5.5.10
> > 
> > Both pages are loosing 16368 bytes. 
> 
> Bad luck. Hopefully it's just irrelevant data ;)

Well, loosing a  single <tr> or a <td> may be a nightmare :-)

> 
> > I'm attaching the pages. Using  kompare under linux , you can check
> > clearly where is the diff.
> 
> And that will help me a lot, thanks.
> 
> Rémy

Well, the files are equals  for the first 8112 - 8185 bytes, aprox . 

May be 8192 (2 ^ 13), but the lines pre y post data loss are too
similarly  :-) 


 
Thanks

Mauricio


> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org


Re: APR AJP Connector loosing data

Posted by Remy Maucherat <re...@apache.org>.
Mauricio Nuñez wrote:
> Hi developers!
> 
> Well, I was testing the experimental APR AJP connector, with 2 web pages
> at my site. Using Tomcat 5.5.10
> 
> Both pages are loosing 16368 bytes. 

Bad luck. Hopefully it's just irrelevant data ;)

> I'm attaching the pages. Using  kompare under linux , you can check
> clearly where is the diff.

And that will help me a lot, thanks.

Rémy

---------------------------------------------------------------------
To unsubscribe, e-mail: tomcat-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: tomcat-dev-help@jakarta.apache.org