You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "liming30 (via GitHub)" <gi...@apache.org> on 2023/09/05 14:11:20 UTC

[GitHub] [incubator-paimon] liming30 opened a new issue, #1947: [Feature] AppendOnlyWriter should delete compactAfter files when closed unexpectedly to reduce the number of orphan files.

liming30 opened a new issue, #1947:
URL: https://github.com/apache/incubator-paimon/issues/1947

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   At present, `AppendOnlyWriter` only delete the files written by the `writer` when it is closed unexpectedly, but does not delete the files generated by the `compactManager`, which will increase the number of orphan files. At the same time, when the `partition` expires, the `partition` and `bucket` directory cannot be deleted.
   
   ### Solution
   
   `AppendOnlyWriter` also cleans up files generated by `compactManager` when it is closed unexpectedly.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi closed issue #1947: [Feature] AppendOnlyWriter should delete compactAfter files when closed unexpectedly to reduce the number of orphan files.

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #1947: [Feature] AppendOnlyWriter should delete compactAfter files when closed unexpectedly to reduce the number of orphan files.
URL: https://github.com/apache/incubator-paimon/issues/1947


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org