You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "jasgok (via GitHub)" <gi...@apache.org> on 2025/10/17 09:59:08 UTC

[I] [Bug] iceberg tag point to an expired paimon snapshot, all query fail [paimon]

jasgok opened a new issue, #6425:
URL: https://github.com/apache/paimon/issues/6425

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Paimon version
   
   1.2
   
   ### Compute Engine
   
   flink 1.20.1
   
   ### Minimal reproduce step
   
   paimon settings
   ```
   (
       'snapshot.time-retained' = '1h'
       ,'metadata.iceberg.storage' = 'hive-catalog'
       , 'metadata.iceberg.manifest-legacy-version'='true'
       , 'metadata.iceberg.hive-client-class' = 'com.amazonaws.glue.catalog.metastore.AWSCatalogMetastoreClient'
       , 'tag.automatic-creation' = 'process-time'
       , 'tag.creation-period' = 'daily'
       , 'tag.creation-delay' = '10 m'
       , 'tag.num-retained-max' = '30'  
       , 'tag.period-formatter' = 'without_dashes_and_spaces'
   )
   ```
   
   in my case, i expect to automatically  create paimon tag daily  and save for 30 days,
   and expire snapshots in 1hour to reduce the snapshot files.
   
   paimon saves snapshot info to folder /tag/*
   but iceberg's tag points to snapshot id and fail to query if the pointed snapshot is expired and deleted.
   
   
   
   ### What doesn't meet your expectations?
   
   is it possible iceberg's tag point to paimon's tag file instead of snapshot?
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] iceberg tag point to an expired paimon snapshot, all query fail [paimon]

Posted by "jasgok (via GitHub)" <gi...@apache.org>.
jasgok closed issue #6425: [Bug] iceberg tag point to an expired paimon snapshot, all query fail
URL: https://github.com/apache/paimon/issues/6425


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] iceberg tag point to an expired paimon snapshot, all query fail [paimon]

Posted by "jasgok (via GitHub)" <gi...@apache.org>.
jasgok commented on issue #6425:
URL: https://github.com/apache/paimon/issues/6425#issuecomment-3414750794

   found similar
   https://github.com/apache/paimon/issues/6107


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org