You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cocoon.apache.org by "David Crossley (JIRA)" <ji...@apache.org> on 2006/03/01 08:38:39 UTC

[jira] Updated: (COCOON-1295) ParallelContentAggregator, multithreaded aggregating

     [ http://issues.apache.org/jira/browse/COCOON-1295?page=all ]

David Crossley updated COCOON-1295:
-----------------------------------

    Bugzilla Id:   (was: 31646)
     Other Info: [Patch available]
    Description: 
I didn't wanted to send a patch for that. The code is poorly documented nor 
tested under many circumtances, old license, etc. etc. It was just a 
workaround for a problem we had.

But we use it in production environment with about 350.000 pages a day. So, 
for my usecase it's stable. And if you suggest to send it as a patch, I do. 
Perheaps somebody finishes my work and we'll have it in the next version of 
cocoon.

In addition to my ParallelContentAggregator class I have a version called 
TonyContentAggregator. I can't remember if Tony did this, it was inspired by 
Tony or whatelse. I also attached thisone as patch.

So, see attachements for the javacode.

regards
Christoph


----- Original Message ----- 
From: "Ralph Goers" <Ra...@dslextreme.com>
To: <us...@cocoon.apache.org>
Sent: Monday, October 11, 2004 4:37 PM
Subject: Re: aggregate takes too much time


> Why not submit this as a patch?  Then we can all see it.
> 
> Christoph Gaffga wrote:
> 
> >we also had a problem with slow aggregates. We solved it by changing the
> >Aggregator so it works in a multithraded mode.
> >
> >I don't know if it increases the perfomcance in your case because you are
> >only aggregating simple xml files from the filesystem. But in our case (the
> >aggragated parts are not static) it increases perfomance dramaticly.
> >
> >If you interested in it, I can send you our javacode for the
> >ParallelContentAggregator.
> >
> >regards
> >Christoph
> >  
> >
> 
>

  was:
I didn't wanted to send a patch for that. The code is poorly documented nor 
tested under many circumtances, old license, etc. etc. It was just a 
workaround for a problem we had.

But we use it in production environment with about 350.000 pages a day. So, 
for my usecase it's stable. And if you suggest to send it as a patch, I do. 
Perheaps somebody finishes my work and we'll have it in the next version of 
cocoon.

In addition to my ParallelContentAggregator class I have a version called 
TonyContentAggregator. I can't remember if Tony did this, it was inspired by 
Tony or whatelse. I also attached thisone as patch.

So, see attachements for the javacode.

regards
Christoph


----- Original Message ----- 
From: "Ralph Goers" <Ra...@dslextreme.com>
To: <us...@cocoon.apache.org>
Sent: Monday, October 11, 2004 4:37 PM
Subject: Re: aggregate takes too much time


> Why not submit this as a patch?  Then we can all see it.
> 
> Christoph Gaffga wrote:
> 
> >we also had a problem with slow aggregates. We solved it by changing the
> >Aggregator so it works in a multithraded mode.
> >
> >I don't know if it increases the perfomcance in your case because you are
> >only aggregating simple xml files from the filesystem. But in our case (the
> >aggragated parts are not static) it increases perfomance dramaticly.
> >
> >If you interested in it, I can send you our javacode for the
> >ParallelContentAggregator.
> >
> >regards
> >Christoph
> >  
> >
> 
>


> ParallelContentAggregator, multithreaded aggregating
> ----------------------------------------------------
>
>          Key: COCOON-1295
>          URL: http://issues.apache.org/jira/browse/COCOON-1295
>      Project: Cocoon
>         Type: Improvement
>   Components: - Components: Sitemap
>     Versions: 2.1.5
>  Environment: Operating System: other
> Platform: All
>     Reporter: Christoph Gaffga
>     Assignee: Cocoon Developers Team
>     Priority: Minor
>  Attachments: ParallelContentAggregator.patch, TonyContentAggregator.patch
>
> I didn't wanted to send a patch for that. The code is poorly documented nor 
> tested under many circumtances, old license, etc. etc. It was just a 
> workaround for a problem we had.
> But we use it in production environment with about 350.000 pages a day. So, 
> for my usecase it's stable. And if you suggest to send it as a patch, I do. 
> Perheaps somebody finishes my work and we'll have it in the next version of 
> cocoon.
> In addition to my ParallelContentAggregator class I have a version called 
> TonyContentAggregator. I can't remember if Tony did this, it was inspired by 
> Tony or whatelse. I also attached thisone as patch.
> So, see attachements for the javacode.
> regards
> Christoph
> ----- Original Message ----- 
> From: "Ralph Goers" <Ra...@dslextreme.com>
> To: <us...@cocoon.apache.org>
> Sent: Monday, October 11, 2004 4:37 PM
> Subject: Re: aggregate takes too much time
> > Why not submit this as a patch?  Then we can all see it.
> > 
> > Christoph Gaffga wrote:
> > 
> > >we also had a problem with slow aggregates. We solved it by changing the
> > >Aggregator so it works in a multithraded mode.
> > >
> > >I don't know if it increases the perfomcance in your case because you are
> > >only aggregating simple xml files from the filesystem. But in our case (the
> > >aggragated parts are not static) it increases perfomance dramaticly.
> > >
> > >If you interested in it, I can send you our javacode for the
> > >ParallelContentAggregator.
> > >
> > >regards
> > >Christoph
> > >  
> > >
> > 
> >

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira