[jira] [Created] (ASTERIXDB-1831) failure handling in disk buffer cache

["Yingyi Bu (JIRA)" <ji...@apache.org>]

Yingyi Bu created ASTERIXDB-1831:
------------------------------------

             Summary: failure handling in disk buffer cache
                 Key: ASTERIXDB-1831
                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1831
             Project: Apache AsterixDB
          Issue Type: Bug
          Components: Storage
            Reporter: Yingyi Bu
            Assignee: Michael Blow


I run into the following buffer cache issues when I cancel read-only queries at random time points:

{noformat}
org.apache.hyracks.api.exceptions.HyracksDataException: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot remove index while it is open. (Dataset reference count = 1, Operation tracker number of active operations = 0)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
at org.apache.hyracks.control.nc.Task.run(Task.java:273)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot remove index while it is open. (Dataset reference count = 1, Operation tracker number of active operations = 0)
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
... 5 more
Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Cannot remove index while it is open. (Dataset reference count = 1, Operation tracker number of active operations = 0)
at org.apache.asterix.common.context.DatasetLifecycleManager.unregister(DatasetLifecycleManager.java:137)
at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:138)
at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$91/1916067972.runAction(Unknown Source)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$92/1133269343.call(Unknown Source)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
{noformat}


{noformat}
Caused by: java.lang.IllegalStateException: Page 12998:0 is pinned and file is being closed. Pincount is: 1 Page is confiscated: false
at org.apache.hyracks.storage.common.buffercache.BufferCache.invalidateIfFileIdMatch(BufferCache.java:893)
at org.apache.hyracks.storage.common.buffercache.BufferCache.sweepAndFlush(BufferCache.java:867)
at org.apache.hyracks.storage.common.buffercache.BufferCache.deleteFile(BufferCache.java:947)
at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.destroy(AbstractTreeIndex.java:181)
at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTree.destroy(LSMBTree.java:243)
at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:146)
at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$91/908738823.runAction(Unknown Source)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable$$Lambda$92/131510899.call(Unknown Source)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)