You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2022/05/04 16:38:00 UTC

[jira] [Assigned] (SPARK-38891) Skipping allocating vector for repetition & definition levels when possible

     [ https://issues.apache.org/jira/browse/SPARK-38891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chao Sun reassigned SPARK-38891:
--------------------------------

    Assignee: Chao Sun

> Skipping allocating vector for repetition & definition levels when possible
> ---------------------------------------------------------------------------
>
>                 Key: SPARK-38891
>                 URL: https://issues.apache.org/jira/browse/SPARK-38891
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.3.0
>            Reporter: Chao Sun
>            Assignee: Chao Sun
>            Priority: Major
>
> Currently the vectorized Parquet reader will allocate vectors for repetition and definition levels in all cases. However in certain cases (e.g., when reading primitive types) this is not necessary and should be avoided.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org