You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2023/12/21 15:17:00 UTC

[jira] [Closed] (HUDI-7190) Spark33LegacyHoodieParquetFileFormat failed to read parquet when nested type vectorized read enable

     [ https://issues.apache.org/jira/browse/HUDI-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan closed HUDI-7190.
-------------------------------------
    Fix Version/s: 0.14.1
       Resolution: Fixed

> Spark33LegacyHoodieParquetFileFormat failed to read parquet when nested type vectorized read enable
> ---------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-7190
>                 URL: https://issues.apache.org/jira/browse/HUDI-7190
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Qijun Fu
>            Assignee: Qijun Fu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.14.1
>
>         Attachments: image-2023-12-07-15-41-29-452.png
>
>
> For Spark3.3+ version, we can do vectorized read for nested columns. However when 
> `spark.sql.parquet.enableNestedColumnVectorizedReader = true` and 
>   `set spark.sql.parquet.enableVectorizedReader = true` is set,  hudi will throw the following exception: 
>  !image-2023-12-07-15-41-29-452.png! 
> We need to fix it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)