You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Yann Byron (Jira)" <ji...@apache.org> on 2022/02/24 06:51:00 UTC

[jira] [Closed] (HUDI-2538) Persist configs to hoodie.properties on the first write

     [ https://issues.apache.org/jira/browse/HUDI-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yann Byron closed HUDI-2538.
----------------------------

> Persist configs to hoodie.properties on the first write
> -------------------------------------------------------
>
>                 Key: HUDI-2538
>                 URL: https://issues.apache.org/jira/browse/HUDI-2538
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: Yann Byron
>            Assignee: Yann Byron
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>
> Some configs, like `keygenerator.class`, `hive_style_partitioning`, `partitionpath.urlencode` should be persisted to hoodie.properties when write data in the first time. Otherwise, some inconsistent behavior will happen. And the other write operation do not need to provide these configs. If configs provided don't match the existing configs, raise exceptions. 
> And, this is also useful to solve some of the keyGenerator discrepancy issues between DataFrame writer and SQL.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)