You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "platinumhamburg (via GitHub)" <gi...@apache.org> on 2026/06/16 06:18:37 UTC

[I] Support orphan database files cleanup [fluss]

platinumhamburg opened a new issue, #3488:
URL: https://github.com/apache/fluss/issues/3488

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
   
   
   ### Description
   
   ## Background
   
   Table and partition directories include stable IDs in their remote paths, so the cleanup action can apply an ID-based guard:
   
   - the parsed ID is not in the active ID set
   - the parsed ID is no greater than the last-known max ID
   - metadata enumeration must be complete
   
   Database directories are different. Their remote paths only contain the database name and do not include a database ID. If a database is deleted and later recreated with the same name, the remote path is indistinguishable from the old one.
   
   ## Challenge
   
   Database-level orphan cleanup cannot be safely inferred from filesystem paths alone. Without an additional ownership signal, deleting a database directory may accidentally delete data that belongs to a newly recreated database with the same name.
   
   Possible prerequisites include one of the following:
   
   - database ID in remote paths
   - database deletion marker or tombstone
   - coordinator-side deleted database metadata
   - database-level lock, epoch, or ownership token
   
   ## Proposed Direction
   
   Treat database-level orphan cleanup as a long-term enhancement. Before implementing it, define a safe ownership model and conservative deletion rules. Until then, the cleanup action should prefer leaking orphan database files over risking accidental deletion.
   
   
   ### Willingness to contribute
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Support orphan database files cleanup [fluss]

Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong commented on issue #3488:
URL: https://github.com/apache/fluss/issues/3488#issuecomment-4852399705

   see more comment: https://github.com/apache/fluss/pull/3404#discussion_r3503891670


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org