You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Harsha Gudladona (Jira)" <ji...@apache.org> on 2022/02/14 22:25:00 UTC

[jira] [Updated] (HUDI-3426) Fix out of sync Clustering config properties

     [ https://issues.apache.org/jira/browse/HUDI-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsha Gudladona updated HUDI-3426:
-----------------------------------
    Affects Version/s: 0.10.1

> Fix out of sync Clustering config properties 
> ---------------------------------------------
>
>                 Key: HUDI-3426
>                 URL: https://issues.apache.org/jira/browse/HUDI-3426
>             Project: Apache Hudi
>          Issue Type: Bug
>    Affects Versions: 0.10.1
>            Reporter: Harsha Gudladona
>            Priority: Major
>
> Hoodie Clustering config describes the config property as [https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieClusteringConfig.java#L191|https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieClusteringConfig.java#L191].]. However, the HoodieSparkSqlWriter.scala looks at [https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala#L595] which differs by Key. 
>  
> The configs needs to be unified under single source file to prevent this mismatch.
> For now work around is to set both configs to true to enable async clustering.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)