[jira] [Created] (ASTERIXDB-2083) An inverted index-search generates OOM Exception.

["Taewoo Kim (JIRA)" <ji...@apache.org>]

Taewoo Kim created ASTERIXDB-2083:
-------------------------------------

             Summary: An inverted index-search generates OOM Exception.
                 Key: ASTERIXDB-2083
                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-2083
             Project: Apache AsterixDB
          Issue Type: Bug
            Reporter: Taewoo Kim
            Assignee: Taewoo Kim


An inverted index search can generate OOM Exception if the index size is large. This can apply to any inverted-index search related functions such as *ftcontains* and *contains*.

An example exception message is as follows. We can see that this happens during an inverted-index search. 

{code}
Aug 15, 2017 6:58:06 AM org.apache.hyracks.api.lifecycle.LifeCycleComponentManager uncaughtException
SEVERE: Uncaught Exception from thread Executor-9:1
java.lang.OutOfMemoryError: Java heap space

Aug 15, 2017 6:58:06 AM org.apache.hyracks.api.lifecycle.LifeCycleComponentManager stopAll
INFO: Attempting to stop org.apache.hyracks.api.lifecycle.LifeCycleComponentManager@69a3d1d
Aug 15, 2017 6:58:06 AM org.apache.hyracks.api.lifecycle.LifeCycleComponentManager stopAll
SEVERE: Stopping instance
Aug 15, 2017 6:58:06 AM org.apache.hyracks.control.common.work.WorkQueue$WorkerThread run
INFO: Executing: AbortTasks
Aug 15, 2017 6:58:06 AM org.apache.hyracks.control.nc.Task run
WARNING: Task TAID:TID:ANID:ODID:4:0:0:0 failed with exception
org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.OutOfMemoryError: Java heap space
        at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:45)
        at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:220)
        at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:86)
        at org.apache.hyracks.control.nc.Task.run(Task.java:286)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at org.apache.hyracks.storage.am.btree.impls.BTree.createOpContext(BTree.java:753)
        at org.apache.hyracks.storage.am.btree.impls.BTree.access$100(BTree.java:67)
        at org.apache.hyracks.storage.am.btree.impls.BTree$BTreeAccessor.<init>(BTree.java:844)
        at org.apache.hyracks.storage.am.btree.impls.BTree.createAccessor(BTree.java:820)
        at org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndexOpContext.<init>(OnDiskInvertedIndexOpContext.java:42)
        at org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndex$OnDiskInvertedIndexAccessor.<init>(OnDiskInvertedIndex.java:422)
        at org.apache.hyracks.storage.am.lsm.invertedindex.ondisk.OnDiskInvertedIndex.createAccessor(OnDiskInvertedIndex.java:491)
        at org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndex.search(LSMInvertedIndex.java:275)
        at org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness.search(LSMHarness.java:445)
        at org.apache.hyracks.storage.am.lsm.invertedindex.impls.LSMInvertedIndexAccessor.search(LSMInvertedIndexAccessor.java:77)
        at org.apache.hyracks.storage.am.common.dataflow.IndexSearchOperatorNodePushable.nextFrame(IndexSearchOperatorNodePushable.java:193)
        at org.apache.hyracks.dataflow.common.comm.io.AbstractFrameAppender.write(AbstractFrameAppender.java:92)
        at org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushAndReset(AbstractOneInputOneOutputOneFramePushRuntime.java:66)
        at org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.flushIfNotFailed(AbstractOneInputOneOutputOneFramePushRuntime.java:72)
        at org.apache.hyracks.algebricks.runtime.operators.base.AbstractOneInputOneOutputOneFramePushRuntime.close(AbstractOneInputOneOutputOneFramePushRuntime.java:55)
        at org.apache.hyracks.algebricks.runtime.operators.std.AssignRuntimeFactory$1.close(AssignRuntimeFactory.java:119)
        at org.apache.hyracks.algebricks.runtime.operators.std.EmptyTupleSourceRuntimeFactory$1.close(EmptyTupleSourceRuntimeFactory.java:65)
        at org.apache.hyracks.algebricks.runtime.operators.meta.AlgebricksMetaOperatorDescriptor$1.initialize(AlgebricksMetaOperatorDescriptor.java:104)
        at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$57/871672554.run(Unknown Source)
        at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$1(SuperActivityOperatorNodePushable.java:204)
        at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$59/686827126.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 3 more
{code}





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)