[GitHub] [iceberg] krisdas commented on issue #3843: Python library feature request: check_for_partition api

[GitBox <gi...@apache.org>]

krisdas commented on issue #3843:
URL: https://github.com/apache/iceberg/issues/3843#issuecomment-1006642314


   We encountered same problem and couldn't find a good solution. So we wrote some hacky code, which needs to be called by the client repeatedly after specific interval (essentially pull model). In the hacky code, we simply check, whether the asked partition exists or not, by running a query like "select count(*) where partition=input partition" and checking if the count is > 0.
   
   This hacky code was not written in python but just as a console scala app, which can be called easily from airflow using bash operator. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org