[I] Rollback of log compaction should use existing pending rollback instants [hudi]

["hudi-bot (via GitHub)" <gi...@apache.org>]

hudi-bot opened a new issue, #15422:
URL: https://github.com/apache/hudi/issues/15422

   rollbackInflightLogCompaction(inflightInstant, s -> Option.empty());
   
   *Comments*
   
   shouldn't we pass getPendingRollbackInstantFunc in the 2nd argument.
   the reason why we introduced the pending rollback is below.
   
   Lets say c5 commit partially failed.
   when we are looking to start a new commit, say C7, we deduct that c5 has failed and we trigger a rollback named RB_5.
   
   But lets say the process crashed mid-way for RB_5.
   Next time we restart the pipeline for say C8. again we deduct that c5 is partially failed and we want to rollback. but we don't want to create RB_9 for this,but re-use RB_5 again and get it to completion.
   
   So, rollbackPendingCompaction or rollbackPendingClustering should always try to re-use rollback instants if any.
   
    
   
    
   
    
   
   ## JIRA info
   
   - Link: https://issues.apache.org/jira/browse/HUDI-4829
   - Type: Bug
   - Epic: https://issues.apache.org/jira/browse/HUDI-3580


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org