You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@poi.apache.org by bu...@apache.org on 2016/01/23 13:31:55 UTC
[Bug 58915] New: memory eaters
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
Bug ID: 58915
Summary: memory eaters
Product: POI
Version: 3.13-FINAL
Hardware: PC
Status: NEW
Severity: normal
Priority: P2
Component: SXSSF
Assignee: dev@poi.apache.org
Reporter: givemejob@ya.ru
Created attachment 33480
--> https://bz.apache.org/bugzilla/attachment.cgi?id=33480&action=edit
memory eaters
We did stress test:
- Tomcat 7 Xmx100m
- JVM 7
- on request we start 10 threads and each thread writes large xlsx file with
10 rows sliding window (SXSSF) to the file
Library we use:
- jxls 2.8
- jxls-poi 1.0.7
- Apache POI 3.13 (poi, poi-ooxml, poi-ooxml-schemas)
- xmlbeans 2.6.0
It was assumed that window should reduce memory consumption to volume memory
needed for window.
For large xlsx files we can see what objects Xobj$ElementXobj, Xobj$AttrXobj,
STRefImpl, CTMergeCellImpl eat memory.
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
givemejob@ya.ru changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|RESOLVED |REOPENED
Resolution|INVALID |---
--- Comment #4 from givemejob@ya.ru ---
POI SXSSF uses SXSSFSheet for excel sheet representation.
SXSSFSheet is wraper for XSSFSheet with 'overrided' createRow method. (support
for row flush capability)
Other methods of SXSSFSheet delegates call to XSSFSheet.
Therefore all information about workbook are stored in memory except rows (cell
value and etc)
For example SXSSFSheet.addMergedRegion add CellRangeAddress object in memory
when CellRangeAddress count not constant value. On big data this produce chart
like "1hour monitoring".
Сall of SXSSFWorkbook.write method marshal java objects (except rows) to
ByteArrays (see MemoryPackagePartOutputStream) therefore it produce memory
consumption jump at the end of SXSSFWorkbook.write call.
If reasoning is correct then in my opinion this is should be pointed into
"Quick Guide".
I did not find the information until not investigate it.
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
Dominik Stadler <do...@gmx.at> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|REOPENED |NEW
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
--- Comment #1 from givemejob@ya.ru ---
Created attachment 33481
--> https://bz.apache.org/bugzilla/attachment.cgi?id=33481&action=edit
10min monitoring
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
Dominik Stadler <do...@gmx.at> changed:
What |Removed |Added
----------------------------------------------------------------------------
Resolution|--- |FIXED
Status|NEW |RESOLVED
--- Comment #5 from Dominik Stadler <do...@gmx.at> ---
Adjusted javadoc in r1737024 and the page at
https://poi.apache.org/spreadsheet/how-to.html#sxssf via r1737025.
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
--- Comment #2 from givemejob@ya.ru ---
Created attachment 33482
--> https://bz.apache.org/bugzilla/attachment.cgi?id=33482&action=edit
1hour monitoring
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
--- Comment #6 from Dominik Stadler <do...@gmx.at> ---
Correct revision for the webpage is r1737028.
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org
[Bug 58915] memory eaters
Posted by bu...@apache.org.
https://bz.apache.org/bugzilla/show_bug.cgi?id=58915
givemejob@ya.ru changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution|--- |INVALID
OS| |All
Severity|normal |trivial
--- Comment #3 from givemejob@ya.ru ---
Looks like bug of jxls 2.2.8
Wrong version of jxls in the first comment. (2.8 -> 2.2.8)
--
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@poi.apache.org
For additional commands, e-mail: dev-help@poi.apache.org