[jira] [Updated] (HUDI-5001) Sanitize avro column names for RowSource

["Vamshi Gudavarthi (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vamshi Gudavarthi updated HUDI-5001:
------------------------------------
    Description: This issue is within the scope of row sources. The actual issue is that if the names of the columns in the row sources contain invalid avro characters ref [here|https://avro.apache.org/docs/1.10.2/spec.html#names] then using configuration set we can sanitize the column names both in the schema and actual data and the data ingestion to hudi isn't failed. The schema provider is scoped out to filebasedschemaregistry as other schema registries might not allow to register invalid schema in the first place.

> Sanitize avro column names for RowSource
> ----------------------------------------
>
>                 Key: HUDI-5001
>                 URL: https://issues.apache.org/jira/browse/HUDI-5001
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Vamshi Gudavarthi
>            Assignee: Vamshi Gudavarthi
>            Priority: Major
>
> This issue is within the scope of row sources. The actual issue is that if the names of the columns in the row sources contain invalid avro characters ref [here|https://avro.apache.org/docs/1.10.2/spec.html#names] then using configuration set we can sanitize the column names both in the schema and actual data and the data ingestion to hudi isn't failed. The schema provider is scoped out to filebasedschemaregistry as other schema registries might not allow to register invalid schema in the first place.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)