You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Oleg Danilov (JIRA)" <ji...@apache.org> on 2017/06/16 13:37:00 UTC
[jira] [Updated] (SPARK-21121) Set up StorageLevel for CACHE TABLE
command
[ https://issues.apache.org/jira/browse/SPARK-21121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Oleg Danilov updated SPARK-21121:
---------------------------------
Description:
Currently, "CACHE TABLE" always uses the default MEMORY_AND_DISK storage level. We can add a possibility to specify it using variable, let say, spark.sql.inMemoryColumnarStorage.level. It will give user a chance to fit data into the memory with using MEMORY_AND_DISK_SER storage level.
Going to submit PR for this change.
was:
Currently, "CACHE TABLE" always uses the default MEMORY_AND_DISK storage level. We can add a possibility to specify it using variable, let say, spark.sql.inMemoryColumnarStorage.compressed. It will give user a chance to fit data into the memory with using MEMORY_AND_DISK_SER storage level.
Going to submit PR for this change.
> Set up StorageLevel for CACHE TABLE command
> -------------------------------------------
>
> Key: SPARK-21121
> URL: https://issues.apache.org/jira/browse/SPARK-21121
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 2.1.1
> Reporter: Oleg Danilov
> Priority: Minor
>
> Currently, "CACHE TABLE" always uses the default MEMORY_AND_DISK storage level. We can add a possibility to specify it using variable, let say, spark.sql.inMemoryColumnarStorage.level. It will give user a chance to fit data into the memory with using MEMORY_AND_DISK_SER storage level.
> Going to submit PR for this change.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org