You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2022/04/13 19:50:00 UTC

[jira] [Created] (SPARK-38891) Skipping allocating vector for repetition & definition levels when possible

Chao Sun created SPARK-38891:
--------------------------------

             Summary: Skipping allocating vector for repetition & definition levels when possible
                 Key: SPARK-38891
                 URL: https://issues.apache.org/jira/browse/SPARK-38891
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Chao Sun


Currently the vectorized Parquet reader will allocate vectors for repetition and definition levels in all cases. However in certain cases (e.g., when reading primitive types) this is not necessary and should be avoided.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org