You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ajantha Bhat (Jira)" <ji...@apache.org> on 2021/03/17 03:01:00 UTC
[jira] [Updated] (CARBONDATA-4062) Should make clean files become
data trash manager
[ https://issues.apache.org/jira/browse/CARBONDATA-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ajantha Bhat updated CARBONDATA-4062:
-------------------------------------
Fix Version/s: (was: 2.2.0)
2.1.1
> Should make clean files become data trash manager
> -------------------------------------------------
>
> Key: CARBONDATA-4062
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4062
> Project: CarbonData
> Issue Type: Improvement
> Reporter: David Cai
> Priority: Major
> Fix For: 2.1.1
>
> Time Spent: 26h 10m
> Remaining Estimate: 0h
>
> To prevent accidental deletion of data, carbon will introduce data trash management. It will provide buffer time for accidental deletion of data to roll back the delete operation.
> Data trash management is a part of carbon data lifecycle management. Clean files as a data trash manager should contain the following two parts.
> part 1: manage metadata-indexed data trash.
> This data is at the original place of the table and indexed by metadata. carbon manages this data by metadata index and should avoid using listFile() interface.
> part 2: manage ".Trash" folder.
> Now ".Trash" folder is without metadata index, and the operation on it bases on timestamp and listFile() interface. In the future, carbon will index ".Trash" folder to improve data trash management.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)