You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Zhenglin Sun (JIRA)" <ji...@apache.org> on 2012/06/14 04:23:42 UTC

[jira] [Created] (LUCENE-4144) OOM when call optimize

Zhenglin Sun created LUCENE-4144:
------------------------------------

             Summary: OOM when call optimize
                 Key: LUCENE-4144
                 URL: https://issues.apache.org/jira/browse/LUCENE-4144
             Project: Lucene - Java
          Issue Type: New Feature
          Components: core/index
    Affects Versions: 2.1
            Reporter: Zhenglin Sun
             Fix For: 2.1


The index file is about 6G, when i update the index, it can work good, but i hit a OOM when call the method optimize 
Caused by: java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 969048, Num elements: 242258
        at org.apache.lucene.index.TermInfosReader.ensureIndexIsRead(TermInfosReader.java:90)
        at org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:133)
        at org.apache.lucene.index.SegmentTermDocs.seek(SegmentTermDocs.java:51)
        at org.apache.lucene.index.IndexReader.termDocs(IndexReader.java:482)
        at org.apache.lucene.index.IndexReader.deleteDocuments(IndexReader.java:573)
        at org.apache.lucene.index.IndexWriter.applyDeletes(IndexWriter.java:1776)
        at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:1670)
        at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1521)
        at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1351)
        at org.apache.lucene.index.IndexWriter.maybeFlushRamSegments(IndexWriter.java:1344)
        at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:763)
        at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:743)


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (LUCENE-4144) OOM when call optimize

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-4144.
----------------------------------------

    Resolution: Not A Problem

Please raise this on the java-user@lucene.apache.org list instead.

Also, we've made good reductions in RAM usage since 2.1, so it could be simply upgrading to the latest (3.6) resolves this.
                
> OOM when call optimize
> ----------------------
>
>                 Key: LUCENE-4144
>                 URL: https://issues.apache.org/jira/browse/LUCENE-4144
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: core/index
>    Affects Versions: 2.1
>            Reporter: Zhenglin Sun
>             Fix For: 2.1
>
>
> The index file is about 6G, when i update the index, it can work good, but i hit a OOM when call the method optimize 
> Caused by: java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 969048, Num elements: 242258
>         at org.apache.lucene.index.TermInfosReader.ensureIndexIsRead(TermInfosReader.java:90)
>         at org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:133)
>         at org.apache.lucene.index.SegmentTermDocs.seek(SegmentTermDocs.java:51)
>         at org.apache.lucene.index.IndexReader.termDocs(IndexReader.java:482)
>         at org.apache.lucene.index.IndexReader.deleteDocuments(IndexReader.java:573)
>         at org.apache.lucene.index.IndexWriter.applyDeletes(IndexWriter.java:1776)
>         at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:1670)
>         at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1521)
>         at org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1351)
>         at org.apache.lucene.index.IndexWriter.maybeFlushRamSegments(IndexWriter.java:1344)
>         at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:763)
>         at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:743)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org