You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "junmuz (via GitHub)" <gi...@apache.org> on 2025/02/27 13:00:13 UTC
[I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
junmuz opened a new issue, #5176:
URL: https://github.com/apache/paimon/issues/5176
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Motivation
Currently, the Paimon tags are not exposed to the Iceberg metadata when data is written in Iceberg compatibility mode. This means querying any historical tags may not work with AWS Athena. I am using the `1.1` version Spark Jars. I have verified the following with Spark SQL as attached in the file. Right now it throws the error.
```
25/02/26 08:25:01 ERROR SparkSQLDriver: Failed in [select * from default.cities version as of 'test_tag']
org.apache.iceberg.exceptions.ValidationException: Cannot find matching snapshot ID or reference name for version test_tag
```
[paimon_tagging.txt](https://github.com/user-attachments/files/19009299/paimon_tagging.txt)
### Solution
The proposed solution at a high level would mean exposing the Paimon tags as they are created to Iceberg metadata. Also, we'd have to clean out the tags once they are deleted.
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
Posted by "nickdelnano (via GitHub)" <gi...@apache.org>.
nickdelnano commented on issue #5176:
URL: https://github.com/apache/paimon/issues/5176#issuecomment-2910267926
one more PR for this issue https://github.com/apache/paimon/pull/5666
otherwise it is complete
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
Posted by "wwj6591812 (via GitHub)" <gi...@apache.org>.
wwj6591812 commented on issue #5176:
URL: https://github.com/apache/paimon/issues/5176#issuecomment-2856749915
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on issue #5176:
URL: https://github.com/apache/paimon/issues/5176#issuecomment-2693397506
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
Posted by "junmuz (via GitHub)" <gi...@apache.org>.
junmuz closed issue #5176: [Feature] Exposing Paimon tags to Iceberg metadata
URL: https://github.com/apache/paimon/issues/5176
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature] Exposing Paimon tags to Iceberg metadata [paimon]
Posted by "nickdelnano (via GitHub)" <gi...@apache.org>.
nickdelnano commented on issue #5176:
URL: https://github.com/apache/paimon/issues/5176#issuecomment-3114938426
Please close this issue, it is complete
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org