[jira] [Updated] (HUDI-7051) Incorrect replace operation in compaction strategy filter

["Ethan Guo (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ethan Guo updated HUDI-7051:
----------------------------
    Component/s: table-service

> Incorrect replace operation in compaction strategy filter
> ---------------------------------------------------------
>
>                 Key: HUDI-7051
>                 URL: https://issues.apache.org/jira/browse/HUDI-7051
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: compaction, table-service
>            Reporter: vmaster.cc
>            Priority: Major
>         Attachments: image-2023-11-08-16-01-46-166.png, image-2023-11-08-16-02-39-291.png
>
>
> There are some incorrect replace operation to sort all partition paths.
> {code:java}
> return allPartitionPaths.stream().map(partition -> partition.replace("/", "-"))
>     .sorted(Comparator.reverseOrder()).map(partitionPath -> partitionPath.replace("-", "/")) {code}
> the hive partition before replace is dllr_date=2023-10-10, then after will convert to dllr_date=2023/10/10, this is an incorrect partition.
>  # org.apache.hudi.table.action.compact.strategy.DayBasedCompactionStrategy
>  # org.apache.hudi.table.action.compact.strategy.BoundedPartitionAwareCompactionStrategy
>  # org.apache.hudi.table.action.compact.strategy.UnBoundedPartitionAwareCompactionStrategy
> !image-2023-11-08-16-02-39-291.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)