You are viewing a plain text version of this content. The canonical link for it is here.
Posted to fop-users@xmlgraphics.apache.org by Richard Forrester <rc...@us.ibm.com> on 2008/10/16 13:55:33 UTC
Memory issues
Hello,
I have FOP 0.94 and I am running into some issues with Memory. I have
a rather large XML file.. 2.5 MB. when I try to create a PDF from this
file my memory usage spikes up to 700 MB when it starts converting.
However it seems to stay there between 600 and 700 MB almost like it's
frozen. I've waited 5 to10 minutes to see if it would finish, but never
seems to. Is there something I can do to fix this memory usage issue
and make it more manageable?
Thank You!
Richard C. Forrester IV
IBM Global Sales Manual
Technical Lead/Analyst/Developer
Email : rcfiv@us.ibm.com
Phone : (303) 596-5572 or (303) 924-6066
T/L : 8-263-6066
Fax: (303) 924-7616
Fax T/L : 8-263-7616
Re: Memory issues
Posted by "kindaian@gmail.com" <ki...@gmail.com>.
Jean-François El Fouly wrote:
> Yes, it's so much easier right now than it has been :-)
>
Well, at the time frame i had for the project, simply split the document
to smaller chunks was the fastest way to accomplish chapter PDF's...
But it was done with 0.94.... i think...
I may end up redo some testing pages just to check this out currently
;)
(currently I'm more of a listener of the list, and keeping a svn tree
updated locally just in case I need FOP again)
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
Re: Memory issues
Posted by Jean-François El Fouly <je...@elfouly.fr>.
Luis Ferro a écrit :
> Interesting...
>
> And does those sequences share page-citations between them from and
> to? (like a global index)
Yes, definitely.
Global TOC, section TOC, chapter TOC, global index, list of revisions,
bookmarks...
(fo:page-sequence at the chapter level, but the chapter TOC in front is
an fo:page-sequence in its own right).
It works because they are in the same source document.
>
> Thanx for the tip... My workaround the memory limitations was to split
> the work in several individual documents, completely separated from
> each others, and managing a "starting page" reference to keep things
> continuous.
We've been through this too at a certain point in the project, it has
been a nightmare, as we just couldn't produce all the above artefacts we
needed.
>
> It also worked... but at the cost of an harder build process. You
> solution would improve the build ten-fold!
>
> ;)
Yes, it's so much easier right now than it has been :-)
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
Re: Memory issues
Posted by Luis Ferro <ki...@gmail.com>.
Interesting...
And does those sequences share page-citations between them from and to?
(like a global index)
Thanx for the tip... My workaround the memory limitations was to split the
work in several individual documents, completely separated from each others,
and managing a "starting page" reference to keep things continuous.
It also worked... but at the cost of an harder build process. You solution
would improve the build ten-fold!
;)
On Thu, Oct 16, 2008 at 2:24 PM, Richard Forrester <rc...@us.ibm.com> wrote:
> Jean-François,
>
> Thanks.. I'll give that a shot!!!
>
>
> Thank You!
>
> Richard C. Forrester IV
> IBM Global Sales Manual
> Technical Lead/Analyst/Developer
> Email : rcfiv@us.ibm.com
> Phone : (303) 596-5572 or (303) 924-6066
> T/L : 8-263-6066
> Fax: (303) 924-7616
> Fax T/L : 8-263-7616
>
> [image: Inactive hide details for Jean-François El Fouly ---10/16/2008
> 06:24:04 AM---Richard Forrester a écrit :]
> Jean-François El Fouly ---10/16/2008 06:24:04 AM---Richard Forrester a
> écrit :
>
>
> From:
>
> Jean-François El Fouly <je...@elfouly.fr>
> To:
>
> fop-users@xmlgraphics.apache.org
> Date:
> 10/16/2008 06:24 AM
> Subject:
> Re: Memory issues
> ------------------------------
>
>
>
> Richard Forrester a écrit :
> >
> > Hello,
> >
> > I have FOP 0.94 and I am running into some issues with Memory. I have
> > a rather large XML file.. 2.5 MB. when I try to create a PDF from this
> > file my memory usage spikes up to 700 MB when it starts converting.
> > However it seems to stay there between 600 and 700 MB almost like it's
> > frozen. I've waited 5 to10 minutes to see if it would finish, but
> > never seems to. Is there something I can do to fix this memory usage
> > issue and make it more manageable?
> >
> > Thank You!
> >
> Not willing to play "Mine is bigger than yours" ;-)
> but the document I'm working on is 3.5 Mb source, 7.5 Mb FO and has 1200
> rather large PNG screenshots inside. The whole thing fits easily with a
> full AS and a rather large management web app in 1 Gb. And all the
> memory we need is released at the end.
> So my best guess is: you should try to make your document more
> manageable for FOP by breaking it in severa fo:page-sequence (chapters,
> sections, whatever makes sense in your business). Between
> page-sequences, many resources are released.
> Anyhow, it helped us make it (we had such problems in the beginning).
>
> Jean-François El Fouly
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
> For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
>
>
>
>
Re: Memory issues
Posted by Richard Forrester <rc...@us.ibm.com>.
Jean-François,
Thanks.. I'll give that a shot!!!
Thank You!
Richard C. Forrester IV
IBM Global Sales Manual
Technical Lead/Analyst/Developer
Email : rcfiv@us.ibm.com
Phone : (303) 596-5572 or (303) 924-6066
T/L : 8-263-6066
Fax: (303) 924-7616
Fax T/L : 8-263-7616
|------------>
| From: |
|------------>
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|Jean-François El Fouly <je...@elfouly.fr> |
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| To: |
|------------>
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|fop-users@xmlgraphics.apache.org |
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| Date: |
|------------>
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|10/16/2008 06:24 AM |
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|------------>
| Subject: |
|------------>
>--------------------------------------------------------------------------------------------------------------------------------------------------|
|Re: Memory issues |
>--------------------------------------------------------------------------------------------------------------------------------------------------|
Richard Forrester a écrit :
>
> Hello,
>
> I have FOP 0.94 and I am running into some issues with Memory. I have
> a rather large XML file.. 2.5 MB. when I try to create a PDF from this
> file my memory usage spikes up to 700 MB when it starts converting.
> However it seems to stay there between 600 and 700 MB almost like it's
> frozen. I've waited 5 to10 minutes to see if it would finish, but
> never seems to. Is there something I can do to fix this memory usage
> issue and make it more manageable?
>
> Thank You!
>
Not willing to play "Mine is bigger than yours" ;-)
but the document I'm working on is 3.5 Mb source, 7.5 Mb FO and has 1200
rather large PNG screenshots inside. The whole thing fits easily with a
full AS and a rather large management web app in 1 Gb. And all the
memory we need is released at the end.
So my best guess is: you should try to make your document more
manageable for FOP by breaking it in severa fo:page-sequence (chapters,
sections, whatever makes sense in your business). Between
page-sequences, many resources are released.
Anyhow, it helped us make it (we had such problems in the beginning).
Jean-François El Fouly
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
Re: Memory issues
Posted by Lo...@log-net.com.
Just to "one up" you. :)
We have several docs that are > 20M source. If we run them as a single
page sequence, they run out of mem. If we break them up into multiple
page sequences, they _usually_ work.
So, as Jean-François suggests, using multiple page-sequences is a good
start.
-Lou
Jean-François El Fouly <je...@elfouly.fr>
10/16/2008 08:23 AM
Please respond to
fop-users@xmlgraphics.apache.org
To
fop-users@xmlgraphics.apache.org
cc
Subject
Re: Memory issues
Richard Forrester a écrit :
>
> Hello,
>
> I have FOP 0.94 and I am running into some issues with Memory. I have
> a rather large XML file.. 2.5 MB. when I try to create a PDF from this
> file my memory usage spikes up to 700 MB when it starts converting.
> However it seems to stay there between 600 and 700 MB almost like it's
> frozen. I've waited 5 to10 minutes to see if it would finish, but
> never seems to. Is there something I can do to fix this memory usage
> issue and make it more manageable?
>
> Thank You!
>
Not willing to play "Mine is bigger than yours" ;-)
but the document I'm working on is 3.5 Mb source, 7.5 Mb FO and has 1200
rather large PNG screenshots inside. The whole thing fits easily with a
full AS and a rather large management web app in 1 Gb. And all the
memory we need is released at the end.
So my best guess is: you should try to make your document more
manageable for FOP by breaking it in severa fo:page-sequence (chapters,
sections, whatever makes sense in your business). Between
page-sequences, many resources are released.
Anyhow, it helped us make it (we had such problems in the beginning).
Jean-François El Fouly
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
Re: Memory issues
Posted by Jean-François El Fouly <je...@elfouly.fr>.
Richard Forrester a écrit :
>
> Hello,
>
> I have FOP 0.94 and I am running into some issues with Memory. I have
> a rather large XML file.. 2.5 MB. when I try to create a PDF from this
> file my memory usage spikes up to 700 MB when it starts converting.
> However it seems to stay there between 600 and 700 MB almost like it's
> frozen. I've waited 5 to10 minutes to see if it would finish, but
> never seems to. Is there something I can do to fix this memory usage
> issue and make it more manageable?
>
> Thank You!
>
Not willing to play "Mine is bigger than yours" ;-)
but the document I'm working on is 3.5 Mb source, 7.5 Mb FO and has 1200
rather large PNG screenshots inside. The whole thing fits easily with a
full AS and a rather large management web app in 1 Gb. And all the
memory we need is released at the end.
So my best guess is: you should try to make your document more
manageable for FOP by breaking it in severa fo:page-sequence (chapters,
sections, whatever makes sense in your business). Between
page-sequences, many resources are released.
Anyhow, it helped us make it (we had such problems in the beginning).
Jean-François El Fouly
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org
Re: Memory issues
Posted by "kindaian@gmail.com" <ki...@gmail.com>.
You need patience... It will end up.
For start, split the build in two steps... from xml to fo, and the from
fo to pdf...
That will allow for a break in the process alliviating it a bit.
Then you need patience, because the fo will take it's time to process.
In my case, i had smaller fo, but with bigger footprints... (and i had
some of the files to take 20 or 30 minuts to process).
Also there are stuff that takes a toll in performance. References
mainly, from page to page.
WTB lightweight reference keeping between pages...
;)
Richard Forrester wrote:
>
> Hello,
>
> I have FOP 0.94 and I am running into some issues with Memory. I have
> a rather large XML file.. 2.5 MB. when I try to create a PDF from this
> file my memory usage spikes up to 700 MB when it starts converting.
> However it seems to stay there between 600 and 700 MB almost like it's
> frozen. I've waited 5 to10 minutes to see if it would finish, but
> never seems to. Is there something I can do to fix this memory usage
> issue and make it more manageable?
>
> Thank You!
>
> Richard C. Forrester IV
> IBM Global Sales Manual
> Technical Lead/Analyst/Developer
> Email : rcfiv@us.ibm.com
> Phone : (303) 596-5572 or (303) 924-6066
> T/L : 8-263-6066
> Fax: (303) 924-7616
> Fax T/L : 8-263-7616
>
---------------------------------------------------------------------
To unsubscribe, e-mail: fop-users-unsubscribe@xmlgraphics.apache.org
For additional commands, e-mail: fop-users-help@xmlgraphics.apache.org