You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kent Yao (Jira)" <ji...@apache.org> on 2021/09/01 08:17:00 UTC
[jira] [Created] (SPARK-36634) Support access and read parquet file
by column index
Kent Yao created SPARK-36634:
--------------------------------
Summary: Support access and read parquet file by column index
Key: SPARK-36634
URL: https://issues.apache.org/jira/browse/SPARK-36634
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.3.0
Reporter: Kent Yao
Add a config spark.sql.parquet.columnIndexAccessÂ
When true, we access the parquet files by column index instead of catalyst schema mapping at the executor side. This is useful when the parquet file meta is inconsistent with those in Metastore
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org