You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Enrico Minack (Jira)" <ji...@apache.org> on 2026/02/09 10:32:00 UTC
[jira] [Updated] (SPARK-55447) Deleting blocks via BlockManagerMaster and blocking = false is still blocking
[ https://issues.apache.org/jira/browse/SPARK-55447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enrico Minack updated SPARK-55447:
----------------------------------
Description:
Calling {{BlockManagerMaster}} methods {{{}removeRdd{}}}, {{removeShuffle}} and {{removeBroadcast}} with {{blocking = false}} still blocks.
These methods call {{{}driverEndpoint.askSync{}}}, which (as the name implies}} waits for the future's result:
{code:java}
def askSync[T: ClassTag](message: Any): T = askSync(message, defaultAskTimeout)
def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
val future = ask[T](message, timeout)
timeout.awaitResult(future)
}
{code}
Further, the `spark.cleaner.referenceTracking.blocking.timeout` is eclipsed by {{RpcUtils.askRpcTimeout(conf)}}.
was:
Calling {{BlockManagerMaster}} methods {{{}removeRdd{}}}, {{removeShuffle}} and {{removeBroadcast}} with {{blocking = false}} still blocks.
These methods call {{{}driverEndpoint.askSync{}}}, which (as the name implies}} waits for the future's result:
{code:java}
def askSync[T: ClassTag](message: Any): T = askSync(message, defaultAskTimeout)
def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
val future = ask[T](message, timeout)
timeout.awaitResult(future)
}
{code}
Further, the `spark.cleaner.referenceTracking.blocking.timeout` is eclipsed by {{RpcUtils.askRpcTimeout(conf)}}.
> Deleting blocks via BlockManagerMaster and blocking = false is still blocking
> -----------------------------------------------------------------------------
>
> Key: SPARK-55447
> URL: https://issues.apache.org/jira/browse/SPARK-55447
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 4.2.0
> Reporter: Enrico Minack
> Priority: Major
>
> Calling {{BlockManagerMaster}} methods {{{}removeRdd{}}}, {{removeShuffle}} and {{removeBroadcast}} with {{blocking = false}} still blocks.
> These methods call {{{}driverEndpoint.askSync{}}}, which (as the name implies}} waits for the future's result:
> {code:java}
> def askSync[T: ClassTag](message: Any): T = askSync(message, defaultAskTimeout)
> def askSync[T: ClassTag](message: Any, timeout: RpcTimeout): T = {
> val future = ask[T](message, timeout)
> timeout.awaitResult(future)
> }
> {code}
> Further, the `spark.cleaner.referenceTracking.blocking.timeout` is eclipsed by {{RpcUtils.askRpcTimeout(conf)}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org