web site generation speed issue

[Vincent Massol <vm...@octo.com>]

Hi Chris,

I'm not 100% sure but it seems that the introduction of DTDs has slowed
the web site generation by a factor 2 or 3 at least. "ant clean dist"
now takes 2 minutes and 17 seconds on my machine (I think it was taking
something like 30-40 seconds before).

Do you have any idea how we could speed it up? 

Thanks
-Vincent


--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>

RE: web site generation speed issue

[Vincent Massol <vm...@pivolis.com>]

Hi Chris,

> -----Original Message-----
> From: Christopher Lenz [mailto:cmlenz@gmx.de]
> Sent: 27 April 2003 13:53
> To: Cactus Developers List
> Subject: Re: web site generation speed issue
> 
> Hi Vincent,
> 
> it seems that this performance problem is caused by the version of
Xalan
> included in JDK 1.4.1. I'm generally using 1.3.1 with the most recent
> Xerces/Xalan releases, and it runs through very fast.
> 

It is indeed much much faster:

JDK 1.4.1: 2mn 19s
JDK 1.3.1 and latest xalan/xerces: 24s

Thanks for the tip
-Vincent

> BTW, I've seen an (invalid) bug report against Ant in this regard, but
> can't remember where it was.
> 
> Vincent Massol wrote:
> > Hi Chris,
> >
> > I'm not 100% sure but it seems that the introduction of DTDs has
slowed
> > the web site generation by a factor 2 or 3 at least. "ant clean
dist"
> > now takes 2 minutes and 17 seconds on my machine (I think it was
taking
> > something like 30-40 seconds before).
> >
> > Do you have any idea how we could speed it up?
> >
> > Thanks
> > -Vincent
> 
> --
> Christopher Lenz
> /=/ cmlenz at gmx.de
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: cactus-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: cactus-dev-help@jakarta.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: cactus-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: cactus-dev-help@jakarta.apache.org

Re: web site generation speed issue

[Christopher Lenz <cm...@gmx.de>]

Hi Vincent,

it seems that this performance problem is caused by the version of Xalan 
included in JDK 1.4.1. I'm generally using 1.3.1 with the most recent 
Xerces/Xalan releases, and it runs through very fast.

BTW, I've seen an (invalid) bug report against Ant in this regard, but 
can't remember where it was.

Vincent Massol wrote:
> Hi Chris,
> 
> I'm not 100% sure but it seems that the introduction of DTDs has slowed
> the web site generation by a factor 2 or 3 at least. "ant clean dist"
> now takes 2 minutes and 17 seconds on my machine (I think it was taking
> something like 30-40 seconds before).
> 
> Do you have any idea how we could speed it up? 
> 
> Thanks
> -Vincent

-- 
Christopher Lenz
/=/ cmlenz at gmx.de


---------------------------------------------------------------------
To unsubscribe, e-mail: cactus-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: cactus-dev-help@jakarta.apache.org

RE: web site generation speed issue

[Vincent Massol <vm...@octo.com>]

> -----Original Message-----
> From: Christopher Lenz [mailto:cmlenz@gmx.de]
> Sent: 28 January 2003 19:45
> To: Cactus Developers List
> Subject: Re: web site generation speed issue
> 
> Vincent Massol wrote:
> > Hi Chris,
> >
> > I'm not 100% sure but it seems that the introduction of DTDs has
slowed
> > the web site generation by a factor 2 or 3 at least. "ant clean
dist"
> > now takes 2 minutes and 17 seconds on my machine (I think it was
taking
> > something like 30-40 seconds before).
> >
> > Do you have any idea how we could speed it up?
> 
> Hmm, there could probably be an <uptodate> check to perform the
> <xmlvalidate>-task conditionally based on a prior transform...
however,
> if it's the <style>-task that now takes longer, there's not much we
can
> do except to remove the DTDs (AFAIK).
> 

yep, I was referring specifically to the XSL transformation. I think we
can increase the performance by a lot simply by modifying the XSL code.
However, I've tried several times but couldn't find a working solution
(due probably to my poor knowledge of XSL).

Yes, removing the DTD will help. However, that's quite nice, so I would
prefer if we could first improve the XSL code itself. For example, the
"get-base-directory" template is called in lots of places whereas this
is something static that could probably be computed only once (but I
haven't found how to do it unfortunately). I'm sure there is other stuff
like this that could help.

> Actually, there have been many changes to the documentation build, as
> you know. We're compiling Java code, running the <checksitemap> task,
> and the stylesheets have become more complex (the document() calls
would
> have the most significant impact on performance).

Yeah, but they all run very fast except when applying the XSL to each
XML. It takes about 3 seconds for each file on my machine. This is what
I find horribly long.

> 
> I currently don't have time to look into this, but if it's the
addition
> of the DTD and validation, I'd be against removing it again. The
benefit
> validation brings, in combination with the other checks we now have in
> place, is better quality control over the docs, and the ability to see
> the scope of changes. I.e. if all documents comply to their respective
> DTDs, they are also guaranteed to work with the XSLT stylesheets, etc.

I completely agree. I think that you're right and speed doesn't really
matter, especially for the documentation project. I guess, the reason of
my post was simply that I have been running the documentation build all
day... :-)

> 
> BTW, if we bring PDF generation into the game, the numbers you posted
> will look quite unrealistically low ;-)

hehe ;-)

-Vincent



--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>

Re: web site generation speed issue

[Christopher Lenz <cm...@gmx.de>]

Vincent Massol wrote:
> Hi Chris,
> 
> I'm not 100% sure but it seems that the introduction of DTDs has slowed
> the web site generation by a factor 2 or 3 at least. "ant clean dist"
> now takes 2 minutes and 17 seconds on my machine (I think it was taking
> something like 30-40 seconds before).
> 
> Do you have any idea how we could speed it up? 

Hmm, there could probably be an <uptodate> check to perform the 
<xmlvalidate>-task conditionally based on a prior transform... however, 
if it's the <style>-task that now takes longer, there's not much we can 
do except to remove the DTDs (AFAIK).

Actually, there have been many changes to the documentation build, as 
you know. We're compiling Java code, running the <checksitemap> task, 
and the stylesheets have become more complex (the document() calls would 
have the most significant impact on performance).

I currently don't have time to look into this, but if it's the addition 
of the DTD and validation, I'd be against removing it again. The benefit 
validation brings, in combination with the other checks we now have in 
place, is better quality control over the docs, and the ability to see 
the scope of changes. I.e. if all documents comply to their respective 
DTDs, they are also guaranteed to work with the XSLT stylesheets, etc.

BTW, if we bring PDF generation into the game, the numbers you posted 
will look quite unrealistically low ;-)

-- 
Christopher Lenz
/=/ cmlenz at gmx.de


--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>