You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "nickdelnano (via GitHub)" <gi...@apache.org> on 2025/08/22 03:34:44 UTC
[I] [Bug] Iceberg tags may reference a snapshot which does not exist. All read queries fail. [paimon]
nickdelnano opened a new issue, #6120:
URL: https://github.com/apache/paimon/issues/6120
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Paimon version
https://github.com/apache/paimon/pull/5570 maps Paimon tags to Iceberg tags. I am deploying this feature and noticed a big problem with it: it can cause all queries on the Iceberg table to fail.
This can happen in common scenarios:
- Iceberg compatibility is enabled on a Paimon table that has tags already. Only the latest Paimon snapshot is created in Iceberg and Iceberg tags point to non-existent snapshots.
- An Iceberg commit fails. The next commit recreates metadata without base and only includes the latest Paimon snapshot. If the Paimon table has any tags this issue occurs.
### Compute Engine
Any reading Iceberg
### Minimal reproduce step
This can be reproduced by adding `getIcebergResult()` at this line of this unit test https://github.com/apache/paimon/blob/1ca148ee1482e03a55573ceea6280199a0acd273/paimon-core/src/test/java/org/apache/paimon/iceberg/IcebergCompatibilityTest.java#L1067
Exception:
```
java.lang.IllegalArgumentException: Snapshot for reference SnapshotRef{snapshotId=1, type=TAG, minSnapshotsToKeep=null, maxSnapshotAgeMs=null, maxRefAgeMs=9223372036854775807} does not exist in the existing snapshots list
at org.apache.iceberg.relocated.com.google.common.base.Preconditions.checkArgument(Preconditions.java:220)
at org.apache.iceberg.TableMetadata.validateRefs(TableMetadata.java:830)
at org.apache.iceberg.TableMetadata.<init>(TableMetadata.java:336)
at org.apache.iceberg.TableMetadataParser.fromJson(TableMetadataParser.java:546)
at org.apache.iceberg.TableMetadataParser.fromJson(TableMetadataParser.java:310)
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:280)
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:273)
at org.apache.iceberg.hadoop.HadoopTableOperations.updateVersionAndMetadata(HadoopTableOperations.java:100)
```
### What doesn't meet your expectations?
N/A
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] Iceberg: Tags may reference a snapshot which does not exist. All read queries fail. [paimon]
Posted by "nickdelnano (via GitHub)" <gi...@apache.org>.
nickdelnano closed issue #6120: [Bug] Iceberg: Tags may reference a snapshot which does not exist. All read queries fail.
URL: https://github.com/apache/paimon/issues/6120
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org