You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Cheng Lian (JIRA)" <ji...@apache.org> on 2014/11/02 04:46:33 UTC
[jira] [Updated] (SPARK-4182) Caching tables containing boolean,
binary, array, struct and/or map columns doesn't work
[ https://issues.apache.org/jira/browse/SPARK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheng Lian updated SPARK-4182:
------------------------------
Description:
If a table contains a column whose type is binary, array, struct, map, and for some reason, boolean, in-memory columnar caching doesn't work because a {{NoopColumnStats}} is used to collect column statistics. {{NoopColumnStats}} returns an empty statistics row, and thus breaks {{InMemoryRelation}} statistics calculation.
{code}
{code}
was:If a table contains a column whose type is binary, array, struct, map, and for some reason, boolean, in-memory columnar caching doesn't work because a {{NoopColumnStats}} is used to collect column statistics. {{NoopColumnStats}} returns an empty statistics row, and thus breaks {{InMemoryRelation}} statistics calculation.
> Caching tables containing boolean, binary, array, struct and/or map columns doesn't work
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-4182
> URL: https://issues.apache.org/jira/browse/SPARK-4182
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.1.1
> Reporter: Cheng Lian
> Assignee: Cheng Lian
> Priority: Blocker
>
> If a table contains a column whose type is binary, array, struct, map, and for some reason, boolean, in-memory columnar caching doesn't work because a {{NoopColumnStats}} is used to collect column statistics. {{NoopColumnStats}} returns an empty statistics row, and thus breaks {{InMemoryRelation}} statistics calculation.
> {code}
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org