You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "Taewoo Kim (JIRA)" <ji...@apache.org> on 2017/03/17 20:12:41 UTC
[jira] [Comment Edited] (ASTERIXDB-1841) Dropping a large inverted
index generates an exception
[ https://issues.apache.org/jira/browse/ASTERIXDB-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930630#comment-15930630 ]
Taewoo Kim edited comment on ASTERIXDB-1841 at 3/17/17 8:12 PM:
----------------------------------------------------------------
Edit: My guess is that if the index size is huge, its instance might not be activated when the Asterix instance starts. I maybe wrong. When destroying an index, if an index instance is in memory, it just goes ahead and unregister that instance and delete files. But, if an index instance is not in memory, the code tries to create an index instance first. That's where it fails.
was (Author: wangsaeu):
My guess is that if the index size is huge, its instance might not be activated when the Asterix instance starts. I maybe wrong.
> Dropping a large inverted index generates an exception
> ------------------------------------------------------
>
> Key: ASTERIXDB-1841
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-1841
> Project: Apache AsterixDB
> Issue Type: Bug
> Reporter: Taewoo Kim
> Assignee: Abdullah Alamoudi
>
> There are four NCs and each NC has 6GB of allocated memory.
> The size of the dataset itself is about 60GB. The index size is about 37GB.
> When I just tried to delete this index by using the following AQL, an exception occurred.
> {code}
> use dataverse exp;
> drop index AmazonReviewNoDup. AmazonReviewNoDup_reviewText_kw_idx;
> {code}
> {code}
> org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor [ClassCastException]
> {code}
> Detailed Exception from the log:
> {code}
> org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
> at org.apache.hyracks.control.nc.Task.run(Task.java:273)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
> ... 5 more
> Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
> at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
> at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84)
> at org.apache.hyracks.control.nc.Task.run(Task.java:273)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222)
> ... 5 more
> Caused by: java.lang.ClassCastException: org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorDescriptor cannot be cast to org.apache.hyracks.storage.am.lsm.invertedindex.api.IInvertedIndexOperatorDescriptor
> at org.apache.hyracks.storage.am.lsm.invertedindex.dataflow.PartitionedLSMInvertedIndexDataflowHelper.createIndexInstance(PartitionedLSMInvertedIndexDataflowHelper.java:79)
> at org.apache.hyracks.storage.am.common.dataflow.IndexDataflowHelper.destroy(IndexDataflowHelper.java:140)
> at org.apache.hyracks.storage.am.common.dataflow.IndexDropOperatorNodePushable.initialize(IndexDropOperatorNodePushable.java:53)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
> at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)