You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "satish (Jira)" <ji...@apache.org> on 2021/01/09 23:37:00 UTC
[jira] [Updated] (HUDI-1518) Remove replaced files logic from
archival
[ https://issues.apache.org/jira/browse/HUDI-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
satish updated HUDI-1518:
-------------------------
Description:
See https://github.com/apache/hudi/blob/79ec7b4894b997183a6e10fdc19d34f5ab4ea437/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTimelineArchiveLog.java#L324
Archival tries to delete replaced files in 'deleteReplacedFileGroups' method. We changed cleaner to delete replaced files. So this is no longer needed. We can instead validate that replaced files no longer exist on disk during archival.
was:
See https://github.com/apache/hudi/blob/79ec7b4894b997183a6e10fdc19d34f5ab4ea437/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTimelineArchiveLog.java#L324
Archival tries to delete replaced files in 'deleteReplacedFileGroups' method. We changed cleaner to delete replaced files. So this is no longer needed. Consider removing replaced file related logic in archival.
> Remove replaced files logic from archival
> -----------------------------------------
>
> Key: HUDI-1518
> URL: https://issues.apache.org/jira/browse/HUDI-1518
> Project: Apache Hudi
> Issue Type: Task
> Reporter: satish
> Priority: Trivial
> Fix For: 0.8.0
>
>
> See https://github.com/apache/hudi/blob/79ec7b4894b997183a6e10fdc19d34f5ab4ea437/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/HoodieTimelineArchiveLog.java#L324
> Archival tries to delete replaced files in 'deleteReplacedFileGroups' method. We changed cleaner to delete replaced files. So this is no longer needed. We can instead validate that replaced files no longer exist on disk during archival.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)