[GitHub] [hudi] danny0405 commented on issue #9796: [SUPPORT] cleaner blocked due to HoodieRollbackException and FileAlreadyExistsException

["danny0405 (via GitHub)" <gi...@apache.org>]

danny0405 commented on issue #9796:
URL: https://github.com/apache/hudi/issues/9796#issuecomment-1742315116

   The rollback for MOR table is kind of hacky, some delete log blocks are appended to the candidate files that we wanna to some retractions. Before the appending, the `HoodieLogFormatWriter` would check whether the file to write already exists, if it does, and it the DFS storage is not appendable (like s3), it rolls over and tries to create a new file to flush data, it the file does not exist, it flushes directly.
   
   My speculations here is maybe there are some local retries of the rollback tasks that generate duplicate write handles, was your job recovered automatically or you manually rollback the "rollback" commit first ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org