[jira] [Closed] (HUDI-7685) Fix bug in partition TTL

["Danny Chen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Danny Chen closed HUDI-7685.
----------------------------
    Resolution: Fixed

Fixed via master branch: c20c01978b4c1e7daf1e89de535dce85bebc0d93

> Fix bug in partition TTL
> ------------------------
>
>                 Key: HUDI-7685
>                 URL: https://issues.apache.org/jira/browse/HUDI-7685
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: xi chaomin
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.0.0
>
>
> After cherry pick [https://github.com/apache/hudi/pull/9723] I find the delete partition action can‘t commit. Auto commit in HoodieSparkSqlWriter is disabled, while SparkDeletePartitionCommitActionExecutor calls commitOnAutoCommit to commit the instant.
>  
> DataSourceUtils -> createHoodieConfig
> {code:java}
> // code placeholder
> HoodieWriteConfig.Builder builder = HoodieWriteConfig.newBuilder()
>     .withPath(basePath).withAutoCommit(false).combineInput(combineInserts, true); {code}
>  
> SparkDeletePartitionCommitActionExecutor -> commitOnAutoCommit
> {code:java}
> // code placeholder
> protected void commitOnAutoCommit(HoodieWriteMetadata result) {
>   // validate commit action before committing result
>   runPrecommitValidators(result);
>   if (config.shouldAutoCommit()) {
>     LOG.info("Auto commit enabled: Committing " + instantTime);
>     autoCommit(result);
>   } else {
>     LOG.info("Auto commit disabled for " + instantTime);
>   }
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)