You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "xanderbailey (via GitHub)" <gi...@apache.org> on 2026/05/20 21:42:14 UTC
[I] Writing UTC timestamp to an iceberg table fails [iceberg-rust]
xanderbailey opened a new issue, #2478:
URL: https://github.com/apache/iceberg-rust/issues/2478
### Apache Iceberg Rust version
None
### Describe the bug
Writing UTC timestamp to an iceberg table fails in the arrow writer. [A discussion was had ](https://github.com/apache/arrow-rs/pull/9994) in arrow-rs if the logic should live there to slacken this and the suggestion was to handle this in application code similar to what datafusion does for this exact problem.
```
ArrowError(
"Incompatible type. Field 'timestamp' has type Timestamp(µs, \"+00:00\"), array has type Timestamp(µs, \"UTC\")",
),
```
### To Reproduce
_No response_
### Expected behavior
Don't fail, these two types are identical semantically
### Willingness to contribute
I can contribute a fix for this bug independently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Writing UTC timestamp to an iceberg table fails [iceberg-rust]
Posted by "blackmwk (via GitHub)" <gi...@apache.org>.
blackmwk commented on issue #2478:
URL: https://github.com/apache/iceberg-rust/issues/2478#issuecomment-4999580734
> Though I think it may be correct that down in the ParquetWriter we may not want to encode this logic, I do think it's pretty important that we fix this in the datafusion integration.
I prefer to do it in query engine. If we do it in datafusion integration, we need to check the schema for every batch in the physical executor. But it we do it in query engine, it only needs to do it in planning phase, and insert a conversion executor node when necessary.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Writing UTC timestamp to an iceberg table fails [iceberg-rust]
Posted by "xanderbailey (via GitHub)" <gi...@apache.org>.
xanderbailey commented on issue #2478:
URL: https://github.com/apache/iceberg-rust/issues/2478#issuecomment-4982456902
Though I think it may be correct that down in the ParquetWriter we may not want to encode this logic, I do think it's pretty important that we fix this in the datafusion integration.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Writing UTC timestamp to an iceberg table fails [iceberg-rust]
Posted by "blackmwk (via GitHub)" <gi...@apache.org>.
blackmwk commented on issue #2478:
URL: https://github.com/apache/iceberg-rust/issues/2478#issuecomment-4737283887
See this comment: https://github.com/apache/iceberg-rust/pull/2477#pullrequestreview-4521040608 I don't think we should do it in iceberg library.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org