You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/28 01:49:54 UTC

[GitHub] [hudi] danny0405 commented on issue #5395: [SUPPORT] Failed to archive commits, thow error 'Directory is not empty'

danny0405 commented on issue #5395:
URL: https://github.com/apache/hudi/issues/5395#issuecomment-1111652198

   > deleteAnyLeftOverMarkers
   
   I'm not quite sure, we actually clean the MARKER folder each time we commit an instant, and here we do it again when the instant was archived? (curious about the background here ?), and like what @codope saied, the call in [#L682-L684](https://github.com/apache/hudi/blob/762623a15cfeba6f3fe936c238d660685ae62b50/hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java#L682-L684) already delete recursively first.
   
   The instant commit and archiving both happens in JobManager in single thread, so there should not be parallelism problem.
   
   @todd5167 Did you write to the same table from two separate Flink jobs ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org