You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/05/16 12:52:27 UTC

[jira] [Resolved] (SPARK-1601) CacheManager#getOrCompute() does not return an InterruptibleIterator

     [ https://issues.apache.org/jira/browse/SPARK-1601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Wendell resolved SPARK-1601.
------------------------------------

    Resolution: Fixed

This was fixed in:
https://github.com/apache/spark/pull/521

> CacheManager#getOrCompute() does not return an InterruptibleIterator
> --------------------------------------------------------------------
>
>                 Key: SPARK-1601
>                 URL: https://issues.apache.org/jira/browse/SPARK-1601
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.0.0, 0.9.1
>            Reporter: Aaron Davidson
>            Assignee: Reynold Xin
>             Fix For: 1.0.0
>
>
> When getOrCompute goes down the "compute" path for an RDD that should be stored in memory, it returns an iterator over an array, which is not interruptible. This mainly means that any consumers of that iterator, which may consume slowly, will not be interrupted in a timely manner.



--
This message was sent by Atlassian JIRA
(v6.2#6252)