You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shahid K I (JIRA)" <ji...@apache.org> on 2018/01/17 18:15:00 UTC
[jira] [Updated] (SPARK-23134) WebUI is showing the cache table
details even after cache idle timeout
[ https://issues.apache.org/jira/browse/SPARK-23134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shahid K I updated SPARK-23134:
-------------------------------
Environment:
Run Cache command with below configuration to cache the RDD blocks
````
spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
spark.dynamicAllocation.executorIdleTimeout=60s
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.minExecutors=0
spark.dynamicAllocation.maxExecutors=8
````
was:
Run Cache command with below configuration to cache the RDD blocks
spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
spark.dynamicAllocation.executorIdleTimeout=60s
spark.dynamicAllocation.enabled=true
spark.dynamicAllocation.minExecutors=0
spark.dynamicAllocation.maxExecutors=8
> WebUI is showing the cache table details even after cache idle timeout
> ----------------------------------------------------------------------
>
> Key: SPARK-23134
> URL: https://issues.apache.org/jira/browse/SPARK-23134
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.1.0, 2.2.0, 2.2.1
> Environment: Run Cache command with below configuration to cache the RDD blocks
> ````
> spark.dynamicAllocation.cachedExecutorIdleTimeout=120s
> spark.dynamicAllocation.executorIdleTimeout=60s
> spark.dynamicAllocation.enabled=true
> spark.dynamicAllocation.minExecutors=0
> spark.dynamicAllocation.maxExecutors=8
> ````
>
>
> Reporter: Shahid K I
> Priority: Major
>
> After cachedExecutorIdleTimeout, WebUI shows the cached partition details in storage tab. It should be the same scenario as in the case of uncache table.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org