You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@servicemix.apache.org by "Hough van Wyk (JIRA)" <ji...@apache.org> on 2010/06/10 11:53:51 UTC
[jira] Created: (SMXCOMP-758) Http Provider runs out of connections
Http Provider runs out of connections
-------------------------------------
Key: SMXCOMP-758
URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
Project: ServiceMix Components
Issue Type: Bug
Components: servicemix-http
Affects Versions: servicemix-http-2010.01
Environment: Servicemix 3.3.2
Reporter: Hough van Wyk
Priority: Blocker
I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Hough van Wyk (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=61136#action_61136 ]
Hough van Wyk commented on SMXCOMP-758:
---------------------------------------
I am out of the office at the moment but will check my mail periodically
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Assignee: Jean-Baptiste Onofré
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jean-Baptiste Onofré reassigned SMXCOMP-758:
--------------------------------------------
Assignee: Jean-Baptiste Onofré
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Assignee: Jean-Baptiste Onofré
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Ioannis Canellos (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=61108#action_61108 ]
Ioannis Canellos commented on SMXCOMP-758:
------------------------------------------
Jean-Baptiste Onofré, indeed servicemix-http 2009.01 uses Jetty 6.1.14 whereas servicemix-http 2010.01 uses Jetty 6.1.22.
In one of the projects I have been working on I used 2009.01 built using Jetty 6.1.22 (to avoid some bugs that were resolved after 6.1.15). I experienced a similar behavior.
I exposed Jetty's connection pool via jmx and I saw that there in some occasions*, a lot of connections were marked as idle (and eventually run out of connections, the max connection number was reached and all connections were marked as idle, but none of the idle connections was used).
This issue is solved for me if build servicemix-http 2009.01 using jetty 6.1.15.
*: By some occasions I mean keeping a steady low traffic and periodically switching to no traffic.
Also note that since version 2008.01 of servicemix-http the only version of jetty I found to be production ready was 6.1.15 (I've tried combining servicemix-http with various jetty versions).
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Assignee: Jean-Baptiste Onofré
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Chris Custine (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60074#action_60074 ]
Chris Custine commented on SMXCOMP-758:
---------------------------------------
Are you getting any exceptions in your logs either while running the tests or if you leave it for a while you get exceptions later? I'm looking for evidence of timeouts from connections which could be a regression of some previous issues.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60090#action_60090 ]
Jean-Baptiste Onofré commented on SMXCOMP-758:
----------------------------------------------
Regarding the Jetty release notes, I spotted:
* 300178 HttpClients opens too many connections that are immediately closed
* JETTY-1174 Memory leak in ChannelImpl/ContinuationClient
I don't think that it's related to our issue but I'm gonna make a test to be sure.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Assignee: Jean-Baptiste Onofré
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=61938#action_61938 ]
Jean-Baptiste Onofré commented on SMXCOMP-758:
----------------------------------------------
I make a test project (injecting stress tests using soapUI) on github.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Assignee: Jean-Baptiste Onofré
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60075#action_60075 ]
Jean-Baptiste Onofré commented on SMXCOMP-758:
----------------------------------------------
I'm gonna check if there is some issue related in Jetty (and maybe upgrade the Jetty version).
Anyway, I raised a task to upgrade to Jetty 7.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60087#action_60087 ]
Jean-Baptiste Onofré commented on SMXCOMP-758:
----------------------------------------------
servicemix-http 2009.01 uses Jetty 6.1.14 whereas servicemix-http 2010.01 uses Jetty 6.1.22.
I'm gonna check in the Jetty bugtracker if I found something around this.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Ioannis Canellos (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60073#action_60073 ]
Ioannis Canellos commented on SMXCOMP-758:
------------------------------------------
Unfortunately, I've managed to reproduce that behavior using version 2009.01 of servicemix-http, built with jetty 6.1.22 (which is the version used by 2010.01). So it makes me believe that this is more like a jetty issue.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (SMXCOMP-758) Http Provider runs out of
connections
Posted by "Jean-Baptiste Onofré (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/activemq/browse/SMXCOMP-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=60088#action_60088 ]
Jean-Baptiste Onofré commented on SMXCOMP-758:
----------------------------------------------
Jetty 6.1.24 has been released. I'm gonna check the RELEASE NOTES and eventually update the SMX resources to use this jetty release.
> Http Provider runs out of connections
> -------------------------------------
>
> Key: SMXCOMP-758
> URL: https://issues.apache.org/activemq/browse/SMXCOMP-758
> Project: ServiceMix Components
> Issue Type: Bug
> Components: servicemix-http
> Affects Versions: servicemix-http-2010.01
> Environment: Servicemix 3.3.2
> Reporter: Hough van Wyk
> Priority: Blocker
>
> I upgraded from servicemix-http-2009.01 to servicemix-http-2010.01. While running some stress testing (about 7 messages/s) after about 7000 exchanges none of my exchanges for http provider go through. I debugged and found that in HttpDestination I had a maxConnetions of 32 connections and 32 connection objects in _connections. No new connections are made. There is no way to recover from this problem and I have to restart service mix to release the connections.
> If I revert back to 2009.01 all is working perfectly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.