You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sadanand Shenoy (Jira)" <ji...@apache.org> on 2021/12/22 07:28:00 UTC
[jira] [Commented] (HDDS-5731) Ozone key put call doesn’t succeed and gets stuck while using streaming code path
[ https://issues.apache.org/jira/browse/HDDS-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17463619#comment-17463619 ]
Sadanand Shenoy commented on HDDS-5731:
---------------------------------------
This looks like a port issue , In the Logs can find that the datastream port isn’t picked up .
{code:java}
8:46:30.950 PMINFORaftServer$Divisione4dfa21e-0aef-4fea-9201-fd95742539ce@group-4FD82C663F40: set configuration 3: [e4dfa21e-0aef-4fea-9201-fd95742539ce|rpc:ip:9856|admin:ip:9857|client:ip:9858|dataStream:|priority:0, 3241260b-8a31-4a43-832c-72a64df52c55|rpc:ip:9856|admin:ip:9857|client:ip:9858|dataStream:|priority:1, b53e95f3-e56f-4300-8824-c2a6aec3e44a|rpc:ip:9856|admin:ip:9857|client:ip:9858|dataStream:|priority:0], old=null {code}
> Ozone key put call doesn’t succeed and gets stuck while using streaming code path
> ---------------------------------------------------------------------------------
>
> Key: HDDS-5731
> URL: https://issues.apache.org/jira/browse/HDDS-5731
> Project: Apache Ozone
> Issue Type: Bug
> Reporter: Sadanand Shenoy
> Assignee: Tsz-wo Sze
> Priority: Major
> Attachments: datanode-jstack.txt, ozone-client-jstack.txt
>
>
> On executing ozone sh key put for a keysize > 4mb , the key put gets stuck forever without any exception reported on DN.
> On the stderr ,this is found
> {code:java}
> org.apache.ratis.thirdparty.io.grpc.netty.NettyServerTransport notifyTerminated
> INFO: Transport failed
> org.apache.ratis.thirdparty.io.netty.handler.codec.http2.Http2Exception: HTTP/2 client preface string missing or corrupt. Hex dump for received bytes: 00000000000000b0000000170a150a10bafb674a520448a7
> at org.apache.ratis.thirdparty.io.netty.handler.codec.http2.Http2Exception.connectionError(Http2Exception.java:108)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.http2.Http2ConnectionHandler$PrefaceDecoder.readClientPrefaceString(Http2ConnectionHandler.java:306)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.http2.Http2ConnectionHandler$PrefaceDecoder.decode(Http2ConnectionHandler.java:239)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.http2.Http2ConnectionHandler.decode(Http2ConnectionHandler.java:438)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:508)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:447)
> at org.apache.ratis.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:276)
> at org.apache.ratis.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
> at org.apache.ratis.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
> at org.apache.ratis.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
> at org.apache.ratis.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
> at org.apache.ratis.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
> at org.apache.ratis.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
> at org.apache.ratis.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
> at org.apache.ratis.thirdparty.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:795)
> at org.apache.ratis.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:480)
> at org.apache.ratis.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378)
> at org.apache.ratis.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
> at org.apache.ratis.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> at org.apache.ratis.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> cc : [~szetszwo] [~shashikant]
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org