You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2022/08/21 22:50:00 UTC
[jira] [Updated] (SPARK-40169) Fix the issue with Parquet column index and predicate pushdown in Data source V1
[ https://issues.apache.org/jira/browse/SPARK-40169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ivan Sadikov updated SPARK-40169:
---------------------------------
Description:
This is a follow for SPARK-39833. In [https://github.com/apache/spark/pull/37419,] we disabled column index for Parquet due to correctness issues that we found when filtering data on the partition column overlapping with data schema.
This ticket is for permanent and thorough fix for the issue and re-enablement of the column index. See more details in the PR linked above.
was:
This is a follow for SPARK-39833.
We disabled
> Fix the issue with Parquet column index and predicate pushdown in Data source V1
> --------------------------------------------------------------------------------
>
> Key: SPARK-40169
> URL: https://issues.apache.org/jira/browse/SPARK-40169
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.4.0, 3.3.1, 3.2.3
> Reporter: Ivan Sadikov
> Priority: Major
>
> This is a follow for SPARK-39833. In [https://github.com/apache/spark/pull/37419,] we disabled column index for Parquet due to correctness issues that we found when filtering data on the partition column overlapping with data schema.
>
> This ticket is for permanent and thorough fix for the issue and re-enablement of the column index. See more details in the PR linked above.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org