You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2014/11/04 09:40:34 UTC
[jira] [Resolved] (SPARK-3018) Release all ManagedBuffers upon task
completion/failure
[ https://issues.apache.org/jira/browse/SPARK-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin resolved SPARK-3018.
--------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
> Release all ManagedBuffers upon task completion/failure
> -------------------------------------------------------
>
> Key: SPARK-3018
> URL: https://issues.apache.org/jira/browse/SPARK-3018
> Project: Spark
> Issue Type: Sub-task
> Components: Shuffle, Spark Core
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Fix For: 1.2.0
>
>
> BlockFetcherIterator retains ManagedBuffers returned by BlockClient.fetchBlocks. Those buffers are released when the iterators are traversed fully. In the case of task failures or completion without exhausting the iterator, this could lead to memory leak.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org