You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Chao Sun (Jira)" <ji...@apache.org> on 2022/03/03 19:18:00 UTC

[jira] [Resolved] (SPARK-38179) Improve WritableColumnVector to better support null struct

     [ https://issues.apache.org/jira/browse/SPARK-38179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chao Sun resolved SPARK-38179.
------------------------------
    Resolution: Won't Fix

> Improve WritableColumnVector to better support null struct
> ----------------------------------------------------------
>
>                 Key: SPARK-38179
>                 URL: https://issues.apache.org/jira/browse/SPARK-38179
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.3.0
>            Reporter: Chao Sun
>            Priority: Minor
>
> Currently {{WritableColumnVector}} of struct type requires to allocate space in all child vectors for null elements. This is not very space efficient. In addition, this model doesn't work well with Parquet vectorized scan for struct (in SPARK-34863).



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org