[GitHub] [hudi] Gatsby-Lee commented on issue #6024: [SUPPORT] DELETE_PARTITION causes AWS Athena Query failure

[GitBox <gi...@apache.org>]

Gatsby-Lee commented on issue #6024:
URL: https://github.com/apache/hudi/issues/6024#issuecomment-1240177021

   Hi, let's close issue if I am the only one facing the issue.
   
   Let me write more details before I forget.
   
   A couple of months ago, I tried DELETE_PARTITION operation with 0.10.1 and 0.11.0
   I noticed that 0.11.0 and 0.10.1 have different behavior when HUDI runs DELETE_PARTITION operation on not existing partition.
   
   * 0.10.1 raised exception and failed. ( the serious issue was Hudi became unstable 
   * 0.11.0 was silence. ( VC told me that this is not the right behavior either. It should raise exception )
   
   I wasn't able to use 0.11.0 because it has a compatibility issue in AWS Glue. ( it was related to AWS Glue Catalog )
   I wasn't able to use 0.10.1 because it has a bug in ZookeeperLockProvider.
   
   I ended up using 0.10.1 + a patch that fixed the  ZookeeperLockProvider ( available on 0.11.1 )
   And, I added a logic that checks if the target partition exists ( cc @codope )
   
   I will test with 0.11.1 and reopen this ticket if I still notice the similar issue.
   
   Thank you
   Gatsby


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org