You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2017/02/03 10:58:52 UTC
[jira] [Resolved] (SPARK-19411) Remove the metadata used to mark
optional columns in merged Parquet schema for filter predicate pushdown
[ https://issues.apache.org/jira/browse/SPARK-19411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reynold Xin resolved SPARK-19411.
---------------------------------
Resolution: Fixed
Assignee: Liang-Chi Hsieh
Fix Version/s: 2.2.0
> Remove the metadata used to mark optional columns in merged Parquet schema for filter predicate pushdown
> --------------------------------------------------------------------------------------------------------
>
> Key: SPARK-19411
> URL: https://issues.apache.org/jira/browse/SPARK-19411
> Project: Spark
> Issue Type: Improvement
> Reporter: Liang-Chi Hsieh
> Assignee: Liang-Chi Hsieh
> Fix For: 2.2.0
>
>
> There is a metadata introduced before to mark the optional columns in merged Parquet schema for filter predicate pushdown. As we upgrade to Parquet 1.8.2 which includes the fix for the pushdown of optional columns, we don't need this metadata now.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org