You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "cen yuhai (JIRA)" <ji...@apache.org> on 2016/04/30 08:26:12 UTC
[jira] [Comment Edited] (SPARK-14559) Netty RPC didn't check
channel is active before sending message
[ https://issues.apache.org/jira/browse/SPARK-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265140#comment-15265140 ]
cen yuhai edited comment on SPARK-14559 at 4/30/16 6:25 AM:
------------------------------------------------------------
Yes, we should check the client is active. Because just client in NettyRpcEnv and Outbox do not check. In other cases, The client is created by calling TransportClientFactory.createClient which will check whether the client is active.
was (Author: cenyuhai):
Yes, it should. Because just client in NettyRpcEnv and Outbox do not check. In other cases, The client is created by calling TransportClientFactory.createClient which will check whether the client is active.
> Netty RPC didn't check channel is active before sending message
> ---------------------------------------------------------------
>
> Key: SPARK-14559
> URL: https://issues.apache.org/jira/browse/SPARK-14559
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.6.0, 1.6.1
> Environment: spark1.6.1 hadoop2.2.0 jdk1.8.0_65
> Reporter: cen yuhai
>
> I have a long-running service. After running for serveral hours, It throwed these exceptions. I found that before sending rpc request by calling sendRpc method in TransportClient, there is no check that whether the channel is still open or active ?
> java.nio.channels.ClosedChannelException
> 4865 16/04/12 11:24:00 ERROR TransportClient: Failed to send RPC 5635696155204230556 to bigdata-arch-hdp407.bh.diditaxi.com/10.234.23.107:55197: java.nio.
> channels.ClosedChannelException
> 4866 java.nio.channels.ClosedChannelException
> 4867 16/04/12 11:24:00 ERROR TransportClient: Failed to send RPC 7319486003318455703 to bigdata-arch-hdp1235.bh.diditaxi.com/10.168.145.239:36439: java.nio.
> channels.ClosedChannelException
> 4868 java.nio.channels.ClosedChannelException
> 4869 16/04/12 11:24:00 ERROR TransportClient: Failed to send RPC 9041854451893215954 to bigdata-arch-hdp1398.bh.diditaxi.com/10.248.117.216:26801: java.nio.
> channels.ClosedChannelException
> 4870 java.nio.channels.ClosedChannelException
> 4871 16/04/12 11:24:00 ERROR TransportClient: Failed to send RPC 6046473497871624501 to bigdata-arch-hdp948.bh.diditaxi.com/10.118.114.81:41903: java.nio.
> channels.ClosedChannelException
> 4872 java.nio.channels.ClosedChannelException
> 4873 16/04/12 11:24:00 ERROR TransportClient: Failed to send RPC 9085605650438705047 to bigdata-arch-hdp1126.bh.diditaxi.com/10.168.146.78:27023: java.nio.
> channels.ClosedChannelException
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org