You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vamsi Karnika (Jira)" <ji...@apache.org> on 2024/09/16 08:05:00 UTC

[jira] [Assigned] (HUDI-5829) Optimize conversion from json to row format when sanitizing field names

     [ https://issues.apache.org/jira/browse/HUDI-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vamsi Karnika reassigned HUDI-5829:
-----------------------------------

    Assignee: Vamsi Karnika  (was: Davis Zhang)

> Optimize conversion from json to row format when sanitizing field names
> -----------------------------------------------------------------------
>
>                 Key: HUDI-5829
>                 URL: https://issues.apache.org/jira/browse/HUDI-5829
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Jonathan Vexler
>            Assignee: Vamsi Karnika
>            Priority: Minor
>              Labels: pull-request-available
>
> With HUDI-4442, we have sanitization for row and json. However in SourceFormatAdapter.fetchNewDataInRowFormat to sanitize the json we leverage the sanitization that takes place when json is converted to avro, and then we convert the subsequent avro to row format. An optimization is to sanitize when converting directly from json to row format



--
This message was sent by Atlassian Jira
(v8.20.10#820010)