You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@camel.apache.org by "Daniel Kulp (Created) (JIRA)" <ji...@apache.org> on 2011/10/16 14:26:11 UTC
[jira] [Created] (CAMEL-4548) camel-cxf should support streaming
camel-cxf should support streaming
----------------------------------
Key: CAMEL-4548
URL: https://issues.apache.org/jira/browse/CAMEL-4548
Project: Camel
Issue Type: Improvement
Affects Versions: 2.8.1
Reporter: Daniel Kulp
Assignee: Daniel Kulp
Fix For: 2.8.2
camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Daniel Kulp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128928#comment-13128928 ]
Daniel Kulp commented on CAMEL-4548:
------------------------------------
Just a quick note about perfomance results. On my machine using a direct to(...).from(...) route (nothing fancy at all, just a straight proxy of the service), I get:
{code}
1K messages:
1200 clients streaming: 4800 req/sec (10M/sec throughput)
1200 clients dom: 3900 req/sec (8M/sec)
100K messages:
150 clients streaming: 295 (61M/sec)
150 clients dom: 104 (21M/sec)
{code}
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Claus Ibsen (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128392#comment-13128392 ]
Claus Ibsen commented on CAMEL-4548:
------------------------------------
I am not fond of doing these massive refactorings in a patch release. Could we keep this on trunk.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Willem Jiang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128866#comment-13128866 ]
Willem Jiang commented on CAMEL-4548:
-------------------------------------
Hi Dan,
As Camel 2.8 is not using the Stream by default and the patch is using the stream by default, it is import for user to know this change.
If he want he could do some configuration to get the old feature back.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Daniel Kulp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128879#comment-13128879 ]
Daniel Kulp commented on CAMEL-4548:
------------------------------------
Added docs to:
https://cwiki.apache.org/confluence/display/CAMEL/CXF
Basically, added the option to the options list and also created a whole section at the bottom about the streaming support which we can expand on.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (CAMEL-4548) camel-cxf should support streaming
Posted by "Daniel Kulp (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Kulp resolved CAMEL-4548.
--------------------------------
Resolution: Fixed
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Daniel Kulp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128462#comment-13128462 ]
Daniel Kulp commented on CAMEL-4548:
------------------------------------
Please do review it. The more eyes the better. I'm going to be running a bunch more tests with it tomorrow.
There are admittedly 2 "hacks" (removing some interceptors and stuff in the "HybridDataBinding") in there to workaround issues in CXF that I'm also going to fix there. Hopefully in the future, we can remove those hacks.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Claus Ibsen (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128401#comment-13128401 ]
Claus Ibsen commented on CAMEL-4548:
------------------------------------
Dan,
We have a discussion on PMC about ruls of engagement for back porting.
Until we reach a consensus there, then refrain from causing a risk of instability on a patch release.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Christian Müller (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128441#comment-13128441 ]
Christian Müller commented on CAMEL-4548:
-----------------------------------------
In my opinion, an *I need this* is not sufficient enough to do this change.
Let's discuss the rules to get a consensus.
And if this is a really important issue and we align to fix it also in our maintenance braches, we should be careful and make sure we do not break any existing code. I'm sure you did your best, but 4 eyes can see more than 2 eyes and 6 eyes see more than 4 eyes and ... That's the reason why a [DISCUSS] on the dev@ list before is a good thing IMO.
Without Claus comment, I would miss this commit...
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CAMEL-4548) camel-cxf should support streaming
Posted by "Daniel Kulp (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CAMEL-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128396#comment-13128396 ]
Daniel Kulp commented on CAMEL-4548:
------------------------------------
Nope. I need this on 2.8.x to solve OOM issues.
> camel-cxf should support streaming
> ----------------------------------
>
> Key: CAMEL-4548
> URL: https://issues.apache.org/jira/browse/CAMEL-4548
> Project: Camel
> Issue Type: Improvement
> Affects Versions: 2.8.1
> Reporter: Daniel Kulp
> Assignee: Daniel Kulp
> Fix For: 2.8.2
>
>
> camel-cxf current DOM parses everything and stores things internally as DOM Elements. This prevents proper streaming and also cause massive performance and memory issues, especially with large messages.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira