You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@poi.apache.org by bu...@apache.org on 2009/02/26 23:48:16 UTC
DO NOT REPLY [Bug 46774] New: Extreme memory usage in XSSF workbook
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
Summary: Extreme memory usage in XSSF workbook
Product: POI
Version: 3.5-dev
Platform: Macintosh
OS/Version: Mac OS X 10.4
Status: NEW
Severity: normal
Priority: P2
Component: XSSF
AssignedTo: dev@poi.apache.org
ReportedBy: rob@kinesissurvey.com
Using HSSF, a simple test of 10000 rows by 255 columns runs fine with "-Xms128m
-Xmx394m" and is fast.
Using XSSF, the same exact test fails before even getting to 1000 rows, and is
extremely slow. After bumping the memory to "-Xms512m -Xmx2048m", it fails
somewhere between 3000 and 4000 rows.
Please see the attached sample code, which is based on your Timesheet Demo.
Thank you,
Rob
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
DO NOT REPLY [Bug 46774] Extreme memory usage in XSSF workbook
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
--- Comment #1 from Rob W <ro...@kinesissurvey.com> 2009-02-26 14:50:35 PST ---
This may not be a Macintosh-only problem. I am hoping to test on another
platform shortly.
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
DO NOT REPLY [Bug 46774] Extreme memory usage in XSSF workbook
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
Rob W <ro...@kinesissurvey.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Platform|Macintosh |All
OS/Version|Mac OS X 10.4 |All
--- Comment #2 from Rob W <ro...@kinesissurvey.com> 2009-02-26 15:04:13 PST ---
Just tested with the same result under Windows Vista, so this does not appear
to be a platform-specific issue.
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
DO NOT REPLY [Bug 46774] Extreme memory usage in XSSF workbook
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
--- Comment #3 from Rob W <ro...@kinesissurvey.com> 2009-02-26 15:08:56 PST ---
Created an attachment (id=23317)
--> (https://issues.apache.org/bugzilla/attachment.cgi?id=23317)
Sample code that illustrates the bug
I am resubmitting my original attachment (unchanged), as it isn't appearing in
the bug. If there is a delay and I've submitted it twice, I apologize.
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
DO NOT REPLY [Bug 46774] Extreme memory usage in XSSF workbook
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
--- Comment #5 from Yegor Kozlov <ye...@dinom.ru> 2009-02-27 06:29:32 PST ---
There was a discussion about it some time ago. See
http://markmail.org/thread/vqut6wy3ashguz6x
A possible workaround is to stream your data directly in XML. See an example
demonstrating my idea:
http://svn.apache.org/repos/asf/poi/trunk/src/examples/src/org/apache/poi/xssf/usermodel/examples/BigGridDemo.java
Yegor
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
DO NOT REPLY [Bug 46774] Extreme memory usage in XSSF workbook
Posted by bu...@apache.org.
https://issues.apache.org/bugzilla/show_bug.cgi?id=46774
Nick Burch <ni...@torchbox.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution| |WONTFIX
--- Comment #4 from Nick Burch <ni...@torchbox.com> 2009-02-27 04:45:54 PST ---
XSSF is xml based, so processing the files will always take more memory than
using HSSF. Also, in the interests of developer time, we use XML Beans, which
allows faster development at the expense of more memory used.
If this is proving to be a problem for you, do please do some profiling to
identify the heavy memory use areas, and contribute back patches to reduce the
memory use!
--
Configure bugmail: https://issues.apache.org/bugzilla/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org