You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Takeshi Yamamuro (Jira)" <ji...@apache.org> on 2020/11/21 00:17:00 UTC
[jira] [Commented] (SPARK-33506) t 130038ERROR ContextCleaner:91 -
Error cleaning broadcast
[ https://issues.apache.org/jira/browse/SPARK-33506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236534#comment-17236534 ]
Takeshi Yamamuro commented on SPARK-33506:
------------------------------------------
I think the description is not enough to reproduce the issue above. Please describe it more.
> t 130038ERROR ContextCleaner:91 - Error cleaning broadcast
> ----------------------------------------------------------
>
> Key: SPARK-33506
> URL: https://issues.apache.org/jira/browse/SPARK-33506
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.3
> Reporter: amit sharma
> Priority: Major
>
> I am using spark 2.3.3 with 16 workers with 30 cores each. I facing similar exception. This issue is occurring once a while and spark streaming process do not handle any request after this. We need to restart the streaming process.
>
> Error cleaning broadcast 130038ERROR ContextCleaner:91 - Error cleaning broadcast 130038
> org.apache.spark.rpc.RpcTimeoutException: Futures timed out after [240 seconds]. This timeout is controlled by spark.network.timeout
> at org.apache.spark.rpc.RpcTimeout.org$apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
> at org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:62)
> at org.apache.spark.rpc.RpcTimeout$$anonfun$addMessageIfTimeout$1.applyOrElse(RpcTimeout.scala:58)
> at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:36)
> at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:76)
> at org.apache.spark.rpc.RpcEndpointRef.askSync(RpcEndpointRef.scala:92)
> at org.apache.spark.rpc.RpcEndpointRef.askSync(RpcEndpointRef.scala:76)
> at org.apache.spark.storage.BlockManagerMaster.removeBroadcast(BlockManagerMaster.scala:148)
> at org.apache.spark.broadcast.TorrentBroadcast$.unpersist(TorrentBroadcast.scala:321)
> at org.apache.spark.broadcast.TorrentBroadcastFactory.unbroadcast(TorrentBroadcastFactory.scala:45)
> at org.apache.spark.broadcast.BroadcastManager.unbroadcast(BroadcastManager.scala:66)
> at org.apache.spark.ContextCleaner.doCleanupBroadcast(ContextCleaner.scala:238)
> at org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$anonfun$apply$mcV$sp$1.apply(ContextCleaner.scala:194)
> at org.apache.spark.ContextCleaner$$anonfun$org$apache$spark$ContextCleaner$$keepCleaning$1$$an
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org