You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2018/06/04 17:13:00 UTC

[jira] [Commented] (SPARK-24461) Snapshot Cache

    [ https://issues.apache.org/jira/browse/SPARK-24461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16500539#comment-16500539 ] 

Xiao Li commented on SPARK-24461:
---------------------------------

cc [~maryannxue] 

> Snapshot Cache
> --------------
>
>                 Key: SPARK-24461
>                 URL: https://issues.apache.org/jira/browse/SPARK-24461
>             Project: Spark
>          Issue Type: New Feature
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Xiao Li
>            Priority: Major
>
> In some usage scenarios, data staleness is not critical. We can introduce a snapshot cache of the original data for achieving much better performance. Different from the current cache, it is resolved by names instead of by plan matching. Cache rebuild can be manually or by events. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org