You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Davis Zhang (Jira)" <ji...@apache.org> on 2024/06/26 14:43:00 UTC

[jira] [Assigned] (HUDI-5829) Optimize conversion from json to row format when sanitizing field names

     [ https://issues.apache.org/jira/browse/HUDI-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Davis Zhang reassigned HUDI-5829:
---------------------------------

    Assignee: Davis Zhang

> Optimize conversion from json to row format when sanitizing field names
> -----------------------------------------------------------------------
>
>                 Key: HUDI-5829
>                 URL: https://issues.apache.org/jira/browse/HUDI-5829
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Jonathan Vexler
>            Assignee: Davis Zhang
>            Priority: Minor
>
> With HUDI-4442, we have sanitization for row and json. However in SourceFormatAdapter.fetchNewDataInRowFormat to sanitize the json we leverage the sanitization that takes place when json is converted to avro, and then we convert the subsequent avro to row format. An optimization is to sanitize when converting directly from json to row format



--
This message was sent by Atlassian Jira
(v8.20.10#820010)