You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ratis.apache.org by "George Huang (Jira)" <ji...@apache.org> on 2022/04/05 15:22:00 UTC

[jira] [Comment Edited] (RATIS-1563) java.lang.NullPointerException: org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$read$5(ContainerStateMachine.java:670) at a non-exist container

    [ https://issues.apache.org/jira/browse/RATIS-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517510#comment-17517510 ] 

George Huang edited comment on RATIS-1563 at 4/5/22 3:21 PM:
-------------------------------------------------------------

|5:50:33.482 PM|ERROR|ContainerStateMachine|gid group-FE6D99EE6E97 : ReadStateMachine failed. cmd ReadChunk logIndex 1 msg : ContainerID 2701 does not exist Container Result: CONTAINER_NOT_FOUND|
|5:50:33.482 PM|ERROR|XceiverServerRatis|pipeline Action CLOSE on pipeline PipelineID=2eaa26bb-91b2-4eb7-a5b8-fe6d99ee6e97.Reason : ContainerID 2701 does not exist|
|5:50:33.482 PM|ERROR|RaftLog|a23a1a62-0308-480f-bdbd-8bfa6dca8c14@group-FE6D99EE6E97-SegmentedRaftLog: Failed readStateMachineData for (t:4, i:1), STATEMACHINELOGENTRY, cmdType: WriteChunk traceID: "" containerID: 2701 datanodeUuid: "a23a1a62-0308-480f-bdbd-8bfa6dca8c14" pipelineID: "2eaa26bb-91b2-4eb7-a5b8-fe6d99ee6e97" writeChunk \{ blockID { containerID: 2701 localID: 109611004723553870 blockCommitSequenceId: 0 }chunkData { chunkName: "109611004723553870_chunk_1" offset: 0 len: 4194304 checksumData{ type: CRC32 bytesPerChecksum: 1048576 checksums: "\373t\177\344" checksums: "\361\016\225\025" checksums: "\003\250bW" checksums: "$\371\277l" }
} } encodedToken: "VAoHc3lzdGVzdBIlY29uSUQ6IDI3MDEgbG9jSUQ6IDEwOTYxMTAwNDcyMzU1Mzg3MBj3-Jrn_i8iETEyNzE3MzkyMjQyNzcyODUyKAEoAjCAgICAAY4BAGPV8H10k0YEYpbjcLbND30kGW85am3_gbQ6Z04lwwr-01tTqLGmoEztR_WC78GbPyzLlqPW2UyBn3w0jcqKTptZEDU2U4OU3euMnFHUHq8u9VFNto_bUym-OzT_4A6AIGIDyHR6S18C-OilVW_Rz5n9z4EHKjAj11FKAxN9qAN_JVRnAvdQtabhUNi2BvLXLUSDk2wlm8uCStjfujMngK7iM_rxq-pQvAGKCSxHwZ9kZkz1tiVJ6350-8zLHF_HNKCgEch_VZ1g3hFHbIfwvAvMMVHU2dTH_gpZcqxzAS_h2J5O3JEGUZ_KJqE4viCgawnMPIeay7EjRzfNk1lLLe8QSEREU19CTE9DS19UT0tFTiVjb25JRDogMjcwMSBsb2NJRDogMTA5NjExMDA0NzIzNTUzODcw", container path=nonexistent
*java.util.concurrent.ExecutionException: java.lang.NullPointerException*
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928)
at org.apache.ratis.server.raftlog.RaftLogBase$EntryWithDataImpl.getEntry(RaftLogBase.java:393)
at org.apache.ratis.util.DataQueue.pollList(DataQueue.java:134)
at org.apache.ratis.server.leader.LogAppenderBase.newAppendEntriesRequest(LogAppenderBase.java:150)
at org.apache.ratis.grpc.server.GrpcLogAppender.appendLog(GrpcLogAppender.java:211)
at org.apache.ratis.grpc.server.GrpcLogAppender.run(GrpcLogAppender.java:145)
at org.apache.ratis.server.leader.LogAppenderDaemon.run(LogAppenderDaemon.java:77)
at java.lang.Thread.run(Thread.java:748)
*Caused by: java.lang.NullPointerException*
at org.apache.ratis.proto.RaftProtos$StateMachineEntryProto$Builder.setStateMachineData(RaftProtos.java:6366)
at org.apache.ratis.server.raftlog.LogProtoUtils.addStateMachineData(LogProtoUtils.java:143)
at org.apache.ratis.server.raftlog.RaftLogBase$EntryWithDataImpl.lambda$getEntry$0(RaftLogBase.java:392)
at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$read$5(ContainerStateMachine.java:670)
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more|


was (Author: ghuangups):
|5:50:33.482 PM|ERROR|ContainerStateMachine|gid group-FE6D99EE6E97 : ReadStateMachine failed. cmd ReadChunk logIndex 1 msg : ContainerID 2701 does not exist Container Result: CONTAINER_NOT_FOUND|
|5:50:33.482 PM|ERROR|XceiverServerRatis|pipeline Action CLOSE on pipeline PipelineID=2eaa26bb-91b2-4eb7-a5b8-fe6d99ee6e97.Reason : ContainerID 2701 does not exist|
|5:50:33.482 PM|ERROR|RaftLog|a23a1a62-0308-480f-bdbd-8bfa6dca8c14@group-FE6D99EE6E97-SegmentedRaftLog: Failed readStateMachineData for (t:4, i:1), STATEMACHINELOGENTRY, cmdType: WriteChunk traceID: "" containerID: 2701 datanodeUuid: "a23a1a62-0308-480f-bdbd-8bfa6dca8c14" pipelineID: "2eaa26bb-91b2-4eb7-a5b8-fe6d99ee6e97" writeChunk \{ blockID { containerID: 2701 localID: 109611004723553870 blockCommitSequenceId: 0 } chunkData \{ chunkName: "109611004723553870_chunk_1" offset: 0 len: 4194304 checksumData { type: CRC32 bytesPerChecksum: 1048576 checksums: "\373t\177\344" checksums: "\361\016\225\025" checksums: "\003\250bW" checksums: "$\371\277l" } } } encodedToken: "VAoHc3lzdGVzdBIlY29uSUQ6IDI3MDEgbG9jSUQ6IDEwOTYxMTAwNDcyMzU1Mzg3MBj3-Jrn_i8iETEyNzE3MzkyMjQyNzcyODUyKAEoAjCAgICAAY4BAGPV8H10k0YEYpbjcLbND30kGW85am3_gbQ6Z04lwwr-01tTqLGmoEztR_WC78GbPyzLlqPW2UyBn3w0jcqKTptZEDU2U4OU3euMnFHUHq8u9VFNto_bUym-OzT_4A6AIGIDyHR6S18C-OilVW_Rz5n9z4EHKjAj11FKAxN9qAN_JVRnAvdQtabhUNi2BvLXLUSDk2wlm8uCStjfujMngK7iM_rxq-pQvAGKCSxHwZ9kZkz1tiVJ6350-8zLHF_HNKCgEch_VZ1g3hFHbIfwvAvMMVHU2dTH_gpZcqxzAS_h2J5O3JEGUZ_KJqE4viCgawnMPIeay7EjRzfNk1lLLe8QSEREU19CTE9DS19UT0tFTiVjb25JRDogMjcwMSBsb2NJRDogMTA5NjExMDA0NzIzNTUzODcw", container path=nonexistent
java.util.concurrent.ExecutionException: java.lang.NullPointerException
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1928)
	at org.apache.ratis.server.raftlog.RaftLogBase$EntryWithDataImpl.getEntry(RaftLogBase.java:393)
	at org.apache.ratis.util.DataQueue.pollList(DataQueue.java:134)
	at org.apache.ratis.server.leader.LogAppenderBase.newAppendEntriesRequest(LogAppenderBase.java:150)
	at org.apache.ratis.grpc.server.GrpcLogAppender.appendLog(GrpcLogAppender.java:211)
	at org.apache.ratis.grpc.server.GrpcLogAppender.run(GrpcLogAppender.java:145)
	at org.apache.ratis.server.leader.LogAppenderDaemon.run(LogAppenderDaemon.java:77)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
	at org.apache.ratis.proto.RaftProtos$StateMachineEntryProto$Builder.setStateMachineData(RaftProtos.java:6366)
	at org.apache.ratis.server.raftlog.LogProtoUtils.addStateMachineData(LogProtoUtils.java:143)
	at org.apache.ratis.server.raftlog.RaftLogBase$EntryWithDataImpl.lambda$getEntry$0(RaftLogBase.java:392)
	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$read$5(ContainerStateMachine.java:670)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more|

> java.lang.NullPointerException: org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$read$5(ContainerStateMachine.java:670) at a non-exist container
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: RATIS-1563
>                 URL: https://issues.apache.org/jira/browse/RATIS-1563
>             Project: Ratis
>          Issue Type: Bug
>            Reporter: George Huang
>            Priority: Major
>
> |5:50:33.482 PM|INFO|HddsDispatcher|Operation: ReadChunk , Trace ID:  , Message: ContainerID 2701 does not exist , Result: CONTAINER_NOT_FOUND , StorageContainerException Occurred.
> org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException: ContainerID 2701 does not exist
> 	at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatchRequest(HddsDispatcher.java:278)
> 	at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.lambda$dispatch$0(HddsDispatcher.java:169)
> 	at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:87)
> 	at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatch(HddsDispatcher.java:168)
> 	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.dispatchCommand(ContainerStateMachine.java:400)
> 	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.readStateMachineData(ContainerStateMachine.java:586)
> 	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$read$5(ContainerStateMachine.java:666)
> 	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)|



--
This message was sent by Atlassian Jira
(v8.20.1#820001)