[jira] [Updated] (HUDI-8585) Fix unsupported data types for SPARK record type w/ col stats

["sivabalan narayanan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-8585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan updated HUDI-8585:
--------------------------------------
    Parent Issue: HUDI-8727  (was: HUDI-8679)

> Fix unsupported data types for SPARK record type w/ col stats
> -------------------------------------------------------------
>
>                 Key: HUDI-8585
>                 URL: https://issues.apache.org/jira/browse/HUDI-8585
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: metadata
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Blocker
>             Fix For: 1.0.1
>
>
> When we tried enabling col stats by default, we realized that BYTES and FIXED data type is not supported in SPARK record type. 
>  
> Ref patch: 
> [https://github.com/apache/hudi/pull/12331] 
>  
> Ref test: 
> TestMORDataSource.testPrunedFiltered 
>  
> lets fix the user-exp by adding these as unsupported types upfront. rather than throwing random errors. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)