You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Ethan Rose (Jira)" <ji...@apache.org> on 2023/10/23 19:18:00 UTC
[jira] [Commented] (HDDS-9099) WriteChunk error: Chunk offset does not match block file length.
[ https://issues.apache.org/jira/browse/HDDS-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778794#comment-17778794 ]
Ethan Rose commented on HDDS-9099:
----------------------------------
[~szetszwo] suspected this issue was caused by multiple clients writing with the same output stream. A workaround was merged in HDDS-9243 to catch this on the client side. We can leave this open since we don't know if that was the actual root cause, but I'm decreasing the priority since we have a workaround.
> WriteChunk error: Chunk offset does not match block file length.
> ----------------------------------------------------------------
>
> Key: HDDS-9099
> URL: https://issues.apache.org/jira/browse/HDDS-9099
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Duong
> Priority: Critical
>
> We're experiencing situations indicating a chunk (4mb) is missing and the next coming WriteChunk fails because the chunk offset doesn't match the block file size.
> {code:java}
> org.apache.hadoop.hdds.scm.container.common.helpers.StorageContainerException: Chunk offset 25165824 does not match length 20971520 of blockFile 109611004734427078.block
> at org.apache.hadoop.ozone.container.keyvalue.helpers.ChunkUtils.validateChunkSize(ChunkUtils.java:417)
> at org.apache.hadoop.ozone.container.keyvalue.impl.FilePerBlockStrategy.writeChunk(FilePerBlockStrategy.java:160)
> at org.apache.hadoop.ozone.container.keyvalue.impl.ChunkManagerDispatcher.writeChunk(ChunkManagerDispatcher.java:75)
> at org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.handleWriteChunk(KeyValueHandler.java:831)
> at org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.dispatchRequest(KeyValueHandler.java:272)
> at org.apache.hadoop.ozone.container.keyvalue.KeyValueHandler.handle(KeyValueHandler.java:231)
> at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatchRequest(HddsDispatcher.java:320)
> at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.lambda$dispatch$0(HddsDispatcher.java:171)
> at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:87)
> at org.apache.hadoop.ozone.container.common.impl.HddsDispatcher.dispatch(HddsDispatcher.java:170)
> at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.dispatchCommand(ContainerStateMachine.java:439)
> at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.runCommand(ContainerStateMachine.java:449)
> at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.lambda$handleWriteChunk$2(ContainerStateMachine.java:495)
> at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org