You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by GitBox <gi...@apache.org> on 2021/09/29 17:55:18 UTC
[GitHub] [accumulo-testing] DomGarguilo opened a new issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
DomGarguilo opened a new issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161
YieldingScanExecutorPT fails to complete with the following output:
<details open>
<summary>Shell output</summary>
```
at org.apache.accumulo.testing.performance.util.TestExecutor.lambda$stream$0(TestExecutor.java:52)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1655)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.base/java.util.stream.LongPipeline.collect(LongPipeline.java:491)
at java.base/java.util.stream.LongPipeline.summaryStatistics(LongPipeline.java:468)
at org.apache.accumulo.testing.performance.tests.YieldingScanExecutorPT.runShortScans(YieldingScanExecutorPT.java:215)
at org.apache.accumulo.testing.performance.tests.YieldingScanExecutorPT.runTest(YieldingScanExecutorPT.java:114)
at org.apache.accumulo.testing.performance.impl.PerfTestRunner.main(PerfTestRunner.java:51)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.accumulo.core.clientImpl.AccumuloServerException: Error on server thor:9997
at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
at org.apache.accumulo.testing.performance.util.TestExecutor.lambda$stream$0(TestExecutor.java:50)
... 11 more
Caused by: java.lang.RuntimeException: org.apache.accumulo.core.clientImpl.AccumuloServerException: Error on server thor:9997
at org.apache.accumulo.core.clientImpl.ScannerIterator.getNextBatch(ScannerIterator.java:185)
at org.apache.accumulo.core.clientImpl.ScannerIterator.hasNext(ScannerIterator.java:110)
at com.google.common.collect.Iterators.size(Iterators.java:163)
at com.google.common.collect.Iterables.size(Iterables.java:126)
at org.apache.accumulo.testing.performance.tests.YieldingScanExecutorPT.scan(YieldingScanExecutorPT.java:170)
at org.apache.accumulo.testing.performance.tests.YieldingScanExecutorPT.lambda$runShortScans$1(YieldingScanExecutorPT.java:212)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.apache.accumulo.core.clientImpl.AccumuloServerException: Error on server thor:9997
at org.apache.accumulo.core.clientImpl.ThriftScanner.scan(ThriftScanner.java:324)
at org.apache.accumulo.core.clientImpl.ScannerIterator.readBatch(ScannerIterator.java:156)
at org.apache.accumulo.core.clientImpl.ScannerIterator.getNextBatch(ScannerIterator.java:174)
... 9 more
Caused by: org.apache.thrift.TApplicationException: Internal error processing startScan
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.recv_startScan(TabletClientService.java:249)
at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.startScan(TabletClientService.java:221)
at org.apache.accumulo.core.clientImpl.ThriftScanner.scan(ThriftScanner.java:453)
at org.apache.accumulo.core.clientImpl.ThriftScanner.scan(ThriftScanner.java:317)
```
</details>
<details open>
<summary>Server logs</summary>
```
java.lang.NullPointerException at
org.apache.accumulo.server.conf.TableConfiguration.createScanDispatcher(TableConfiguration.java:215) at
org.apache.accumulo.server.conf.TableConfiguration.lambda$new$1(TableConfiguration.java:82) at
org.apache.accumulo.core.conf.AccumuloConfiguration$DeriverImpl.derive(AccumuloConfiguration.java:482) at
org.apache.accumulo.server.conf.TableConfiguration.getScanDispatcher(TableConfiguration.java:270) at
org.apache.accumulo.tserver.ThriftClientHandler.getScanDispatcher(ThriftClientHandler.java:272) at
org.apache.accumulo.tserver.ThriftClientHandler.continueScan(ThriftClientHandler.java:378) at
org.apache.accumulo.tserver.ThriftClientHandler.startScan(ThriftClientHandler.java:342) at
jdk.internal.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at
java.base/java.lang.reflect.Method.invoke(Method.java:566) at
org.apache.accumulo.core.trace.TraceUtil.lambda$wrapService$6(TraceUtil.java:235) at
com.sun.proxy.$Proxy38.startScan(Unknown Source) at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2944) at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2923) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at
org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at
org.apache.accumulo.server.rpc.TimedProcessor.process(TimedProcessor.java:63) at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:524) at
org.apache.accumulo.server.rpc.CustomNonBlockingServer$CustomFrameBuffer.invoke(CustomNonBlockingServer.java:114) at org.apache.thrift.server.Invocation.run(Invocation.java:18) at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at
java.base/java.lang.Thread.run(Thread.java:829)
java.lang.ClassNotFoundException: org.apache.accumulo.testing.performance.tests.TimedScanDispatcher at
java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:471) at
java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589) at
org.apache.accumulo.start.classloader.AccumuloClassLoader$1.loadClass(AccumuloClassLoader.java:213) at
java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522) at
org.apache.accumulo.core.classloader.ClassLoaderUtil.loadClass(ClassLoaderUtil.java:85) at
org.apache.accumulo.core.conf.ConfigurationTypeHelper.getClassInstance(ConfigurationTypeHelper.java:203) at
org.apache.accumulo.core.conf.ConfigurationTypeHelper.getClassInstance(ConfigurationTypeHelper.java:176) at
org.apache.accumulo.core.conf.Property.createTableInstanceFromPropertyName(Property.java:1747) at
org.apache.accumulo.server.conf.TableConfiguration.createScanDispatcher(TableConfiguration.java:209) at
org.apache.accumulo.server.conf.TableConfiguration.lambda$new$1(TableConfiguration.java:82) at
org.apache.accumulo.core.conf.AccumuloConfiguration$DeriverImpl.derive(AccumuloConfiguration.java:482) at
org.apache.accumulo.server.conf.TableConfiguration.getScanDispatcher(TableConfiguration.java:270) at
org.apache.accumulo.tserver.ThriftClientHandler.getScanDispatcher(ThriftClientHandler.java:272) at
org.apache.accumulo.tserver.ThriftClientHandler.continueScan(ThriftClientHandler.java:378) at
org.apache.accumulo.tserver.ThriftClientHandler.startScan(ThriftClientHandler.java:342) at
jdk.internal.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at
java.base/java.lang.reflect.Method.invoke(Method.java:566) at
org.apache.accumulo.core.trace.TraceUtil.lambda$wrapService$6(TraceUtil.java:235) at
com.sun.proxy.$Proxy38.startScan(Unknown Source) at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2944) at
org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$startScan.getResult(TabletClientService.java:2923) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at
org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at
org.apache.accumulo.server.rpc.TimedProcessor.process(TimedProcessor.java:63) at
org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:524) at
org.apache.accumulo.server.rpc.CustomNonBlockingServer$CustomFrameBuffer.invoke(CustomNonBlockingServer.java:114) at org.apache.thrift.server.Invocation.run(Invocation.java:18) at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at
java.base/java.lang.Thread.run(Thread.java:829)
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] ctubbsii commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978049495
> > Did you create the shaded jar from accumulo-testing and put that on your class path?
>
> The performance script makes sure that is taken care of.
Given the ClassNotFoundException, it does not appear that part is working correctly. This could be due to a change in how we set the default class path. I know we made some changes there for 2.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978155086
@ctubbsii You were correct. I made changes similar to what was done in #6 and now the PT is working
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978074255
> I know we made some changes there for 2.1
I am still running into the same exception on 2.0 and using accumulo-testing branch 2.0.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978050188
> Given the ClassNotFoundException, it does not appear that part is working correctly. This could be due to a change in how we set the default class path. I know we made some changes there for 2.1
Yeah, your previous comment got me looking into it. That is what I am doing now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-977246236
> Does the fix @Manno15 did for Uno, fix this as well?
No, this issue is unrelated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-941207743
I also ran into this exception while testing:
<details>
<pre>
021-10-12T13:11:17,902 [hdfs.DataStreamer] WARN : Exception for BP-526297122-127.0.0.1-1634056707837:blk_1073741832_1008
java.io.EOFException: Unexpected EOF while trying to read response from server
at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:521) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1088) ~[hadoop-client-api-3.3.0.jar:?]
2021-10-12T13:11:17,952 [hdfs.DFSClient] ERROR: Failed to close file: /accumulo/wal/groot+9997/96639099-bf3f-4b08-9b52-6895177584ba with inode: 16408
java.io.EOFException: End of File Exception between local host is: "groot/127.0.0.1"; destination host is: "groot":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:837) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:791) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1566) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.call(Client.java:1508) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.call(Client.java:1405) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:234) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:119) ~[hadoop-client-api-3.3.0.jar:?]
at com.sun.proxy.$Proxy33.complete(Unknown Source) ~[?:?]
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.complete(ClientNamenodeProtocolTranslatorPB.java:570) ~[hadoop-client-api-3.3.0.jar:?]
at jdk.internal.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) ~[hadoop-client-api-3.3.0.jar:?]
at com.sun.proxy.$Proxy34.complete(Unknown Source) ~[?:?]
at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:957) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:914) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:897) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:852) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSClient.closeAllFilesBeingWritten(DFSClient.java:633) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSClient.closeOutputStreams(DFSClient.java:670) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1497) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:3546) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:3563) ~[hadoop-client-api-3.3.0.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:397) ~[?:?]
at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1881) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1191) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1087) ~[hadoop-client-api-3.3.0.jar:?]
2021-10-12T13:11:17,953 [hdfs.DFSClient] ERROR: Failed to close file: /accumulo/wal/groot+9997/b1288f03-b5e1-47fb-a4eb-5623e5b161b1 with inode: 16409
java.io.IOException: All datanodes [DatanodeInfoWithStorage[127.0.0.1:9866,DS-8435dc9c-94f0-4d60-b362-817ae5f2c38d,DISK]] are bad. Aborting...
at org.apache.hadoop.hdfs.DataStreamer.handleBadDatanode(DataStreamer.java:1561) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1495) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1481) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.processDatanodeOrExternalError(DataStreamer.java:1256) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:667) ~[hadoop-client-api-3.3.0.jar:?]
</pre>
</details
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-941207743
I also ran into this exception while testing:
<details>
<pre>
021-10-12T13:11:17,902 [hdfs.DataStreamer] WARN : Exception for BP-526297122-127.0.0.1-1634056707837:blk_1073741832_1008
java.io.EOFException: Unexpected EOF while trying to read response from server
at org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:521) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1088) ~[hadoop-client-api-3.3.0.jar:?]
2021-10-12T13:11:17,952 [hdfs.DFSClient] ERROR: Failed to close file: /accumulo/wal/groot+9997/96639099-bf3f-4b08-9b52-6895177584ba with inode: 16408
java.io.EOFException: End of File Exception between local host is: "groot/127.0.0.1"; destination host is: "groot":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
at java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:837) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:791) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1566) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.call(Client.java:1508) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client.call(Client.java:1405) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:234) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.ProtobufRpcEngine2$Invoker.invoke(ProtobufRpcEngine2.java:119) ~[hadoop-client-api-3.3.0.jar:?]
at com.sun.proxy.$Proxy33.complete(Unknown Source) ~[?:?]
at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.complete(ClientNamenodeProtocolTranslatorPB.java:570) ~[hadoop-client-api-3.3.0.jar:?]
at jdk.internal.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) ~[?:?]
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) ~[hadoop-client-api-3.3.0.jar:?]
at com.sun.proxy.$Proxy34.complete(Unknown Source) ~[?:?]
at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:957) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:914) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:897) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:852) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSClient.closeAllFilesBeingWritten(DFSClient.java:633) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DFSClient.closeOutputStreams(DFSClient.java:670) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1497) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:3546) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:3563) ~[hadoop-client-api-3.3.0.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:397) ~[?:?]
at org.apache.hadoop.ipc.Client$IpcStreams.readResponse(Client.java:1881) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1191) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1087) ~[hadoop-client-api-3.3.0.jar:?]
2021-10-12T13:11:17,953 [hdfs.DFSClient] ERROR: Failed to close file: /accumulo/wal/groot+9997/b1288f03-b5e1-47fb-a4eb-5623e5b161b1 with inode: 16409
java.io.IOException: All datanodes [DatanodeInfoWithStorage[127.0.0.1:9866,DS-8435dc9c-94f0-4d60-b362-817ae5f2c38d,DISK]] are bad. Aborting...
at org.apache.hadoop.hdfs.DataStreamer.handleBadDatanode(DataStreamer.java:1561) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.setupPipelineInternal(DataStreamer.java:1495) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.setupPipelineForAppendOrRecovery(DataStreamer.java:1481) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.processDatanodeOrExternalError(DataStreamer.java:1256) ~[hadoop-client-api-3.3.0.jar:?]
at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:667) ~[hadoop-client-api-3.3.0.jar:?]
</pre>
</details
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] ctubbsii commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
ctubbsii commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978017794
Did you create the shaded jar from accumulo-testing and put that on your class path?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] Manno15 commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
Manno15 commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-978032856
> Did you create the shaded jar from accumulo-testing and put that on your class path?
The performance script makes sure that is taken care of.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [accumulo-testing] milleruntime commented on issue #161: YieldingScanExecutorPT fails to run. Throws AccumuloServerException
Posted by GitBox <gi...@apache.org>.
milleruntime commented on issue #161:
URL: https://github.com/apache/accumulo-testing/issues/161#issuecomment-977171744
Does the [fix](https://github.com/apache/fluo-uno/pull/276) @Manno15 did for Uno, fix this as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@accumulo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org