You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Pietro Gentile <pi...@gmail.com> on 2016/02/22 15:43:21 UTC

Spark Cache Eviction

Hi all,

Is there a way to prevent eviction of the RDD from SparkContext ?
I would not use the cache with its default behavior (LRU). I would
unpersist manually RDD cached in memory/disk.


Thanks in advance,

Pietro.

Questa e-mail è stata inviata da un computer privo di virus protetto da
Avast.
www.avast.com <https://www.avast.com/sig-email>
<#DDB4FAA8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

Re: Spark Cache Eviction

Posted by Ted Yu <yu...@gmail.com>.

Please see

SPARK-1762 Add functionality to pin RDDs in cache

On Mon, Feb 22, 2016 at 6:43 AM, Pietro Gentile <
pietro.gentile89.developer@gmail.com> wrote:

> Hi all,
>
> Is there a way to prevent eviction of the RDD from SparkContext ?
> I would not use the cache with its default behavior (LRU). I would
> unpersist manually RDD cached in memory/disk.
>
>
> Thanks in advance,
>
> Pietro.
>
> Questa e-mail è stata inviata da un computer privo di virus protetto da
> Avast.
> www.avast.com <https://www.avast.com/sig-email>
> <#713227637_DDB4FAA8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
>