[GitHub] keith-turner opened a new issue #774: Scan failed because block was evicted from cache.

[GitBox <gi...@apache.org>]

keith-turner opened a new issue #774: Scan failed because block was evicted from cache.
URL: https://github.com/apache/accumulo/issues/774
 
 
   While running the Fluo stress test on a 5 node cluster against 2.0.0-alpha-1 I saw a scan fail for the following reason.
   
   ```
   2018-11-20 20:23:12,273 [thrift.ProcessFunction] ERROR: Internal error processing startScan
   java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Block was evicted
           at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueScan(TabletServer.java:687)
           at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.startScan(TabletServer.java:627)
           at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
           at java.lang.reflect.Method.invoke(Method.java:498)
           at org.apache.accumulo.core.trace.wrappers.RpcServerInvocationHandler.invoke(RpcServerInvocationHandler.java:46)
           at com.sun.proxy.$Proxy24.startScan(Unknown Source)
           at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2667)
           at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2646)
           at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
           at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
           at org.apache.accumulo.server.rpc.TimedProcessor.process(TimedProcessor.java:65)
           at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:518)
           at org.apache.accumulo.server.rpc.CustomNonBlockingServer$CustomFrameBuffer.invoke(CustomNonBlockingServer.java:112)
           at org.apache.thrift.server.Invocation.run(Invocation.java:18)
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
           at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35)
           at java.lang.Thread.run(Thread.java:748)
   Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Block was evicted
           at org.apache.accumulo.tserver.scan.ScanTask.get(ScanTask.java:129)
           at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueScan(TabletServer.java:669)
           ... 18 more
   Caused by: java.lang.IllegalStateException: Block was evicted
           at org.apache.accumulo.core.file.blockfile.cache.lru.CachedBlock.recordSize(CachedBlock.java:142)
           at org.apache.accumulo.core.file.blockfile.cache.lru.LruBlockCache$LruCacheEntry.indexWeightChanged(LruBlockCache.java:189)
           at org.apache.accumulo.core.file.blockfile.impl.CachableBlockFile$CachedBlockRead.indexWeightChanged(CachableBlockFile.java:496)
           at org.apache.accumulo.core.file.rfile.BlockIndex.getIndex(BlockIndex.java:47)
           at org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader._seek(RFile.java:1031)
           at org.apache.accumulo.core.file.rfile.RFile$LocalityGroupReader.seek(RFile.java:895)
           at org.apache.accumulo.core.iterators.system.LocalityGroupIterator.seek(LocalityGroupIterator.java:281)
           at org.apache.accumulo.core.file.rfile.RFile$Reader.seek(RFile.java:1432)
           at org.apache.accumulo.server.problems.ProblemReportingIterator.seek(ProblemReportingIterator.java:103)
           at org.apache.accumulo.core.iterators.system.MultiIterator.seek(MultiIterator.java:104)
           at org.apache.accumulo.core.iterators.system.StatsIterator.seek(StatsIterator.java:63)
           at org.apache.accumulo.core.iterators.ServerWrappingIterator.seek(ServerWrappingIterator.java:81)
           at org.apache.accumulo.core.iterators.ServerSkippingIterator.seek(ServerSkippingIterator.java:52)
           at org.apache.accumulo.core.iterators.system.ColumnFamilySkippingIterator.seek(ColumnFamilySkippingIterator.java:127)
           at org.apache.accumulo.core.iterators.ServerFilter.seek(ServerFilter.java:56)
           at org.apache.accumulo.core.iterators.SynchronizedServerFilter.seek(SynchronizedServerFilter.java:56)
           at org.apache.fluo.accumulo.iterators.TimestampSkippingIterator.seek(TimestampSkippingIterator.java:111)
           at org.apache.fluo.accumulo.iterators.TimestampSkippingIterator.seek(TimestampSkippingIterator.java:120)
           at org.apache.fluo.accumulo.iterators.SnapshotIterator.seek(SnapshotIterator.java:259)
           at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.readNext(SourceSwitchingIterator.java:161)
           at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:232)
           at org.apache.accumulo.tserver.tablet.Tablet.nextBatch(Tablet.java:813)
           at org.apache.accumulo.tserver.tablet.Scanner.read(Scanner.java:100)
           at org.apache.accumulo.tserver.scan.NextBatchTask.run(NextBatchTask.java:72)
           at org.apache.accumulo.tserver.session.ScanSession$ScanMeasurer.run(ScanSession.java:54)
           at org.apache.htrace.wrappers.TraceRunnable.run(TraceRunnable.java:57)
           ... 4 more
   
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services