[jira] [Resolved] (SPARK-31233) TimeoutException contains null remoteAddr

["Dongjoon Hyun (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun resolved SPARK-31233.
-----------------------------------
    Fix Version/s: 3.1.0
       Resolution: Fixed

Issue resolved by pull request 28002
[https://github.com/apache/spark/pull/28002]

> TimeoutException contains null remoteAddr
> -----------------------------------------
>
>                 Key: SPARK-31233
>                 URL: https://issues.apache.org/jira/browse/SPARK-31233
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.0
>            Reporter: Yi Huang
>            Assignee: Yi Huang
>            Priority: Minor
>             Fix For: 3.1.0
>
>
> Application log: 
> {code:java}
> Failed to process batch org.apache.spark.rpc.RpcTimeoutException: Futures timed out after [800 seconds]. This timeout is controlled by spark.network.timeout:
> org.apache.spark.rpc.RpcTimeout.org
> $apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
> {code}
> Driver log:
> {code:java}
> [block-manager-ask-thread-pool-149] WARN org.apache.spark.storage.BlockManagerMaster - Failed to remove RDD 25344 - Cannot receive any reply from null in 800 seconds. This timeout is controlled by spark.network.timeout org.apache.spark.rpc.RpcTimeoutException: Cannot receive any reply from null in 800 seconds. This timeout is controlled by spark.network.timeout{code}
> The log message does not provide RpcAddress of the destination RpcEndpoint. It is due to 
> {noformat}
> * The `rpcAddress` may be null, in which case the endpoint is registered via a client-only
> * connection and can only be reached via the client that sent the endpoint reference.{noformat}
>  Solution:
> using rpcAdress from client of the NettyRpcEndpoingRef once such endpoint resides in client mode.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org