You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "plusplusjiajia (via GitHub)" <gi...@apache.org> on 2026/08/28 18:02:28 UTC
[PR] [iceberg] Refuse nanosecond timestamps while Iceberg metadata is enabled [paimon]
plusplusjiajia opened a new pull request, #9455:
URL: https://github.com/apache/paimon/pull/9455
### Purpose
IcebergDataField emits timestamp_ns for timestamp columns of precision 7 and above, but Paimon writes those columns as Parquet INT96, which Iceberg reads as a microsecond zoned timestamp. The metadata and the data files therefore disagree, and nothing reports it — an Iceberg reader silently returns wrong values.
This refuses such a column while metadata.iceberg.storage is enabled, next to the existing geospatial rule in SchemaValidation, so it applies wherever a schema is validated: creating a table, altering one, and enabling Iceberg metadata on a table that already has such a column.
This is a behaviour change: a table with a nanosecond timestamp column mirrors today, producing metadata no Iceberg reader can use. Lower the precision to 6, or disable metadata.iceberg.storage
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [iceberg] Refuse nanosecond timestamps while Iceberg metadata is enabled [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #9455:
URL: https://github.com/apache/paimon/pull/9455
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [iceberg] Refuse nanosecond timestamps while Iceberg metadata is enabled [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #9455:
URL: https://github.com/apache/paimon/pull/9455#issuecomment-5462529420
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org