You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/09/30 21:43:03 UTC
[I] Converting an Avro schema with a local-timestamp column panics [hudi-rs]
yihua opened a new issue, #812:
URL: https://github.com/apache/hudi-rs/issues/812
## Problem
`avro_to_arrow::schema` still has `todo!()` arms for the Avro logical types `local-timestamp-millis`, `local-timestamp-micros` and `local-timestamp-nanos`. Any table whose Avro schema declares such a column cannot have its schema converted: the conversion panics as soon as the column is reached, whether or not the query selects it.
This is not an unsupported-feature error the caller can handle. It is a panic, and when the conversion runs behind an FFI boundary (the C++ and Python bindings) the panic aborts the host process. Related: #636, which asks for `catch_unwind` at the FFI entry points; this issue is one of the panics that would be caught there, but it should not panic in the first place.
## Expected
The three logical types map to a timezone-less Arrow `Timestamp` of the matching unit. That is the type `arrow-avro` decodes the values to, and the type a parquet base file written with `isAdjustedToUTC=false` reads back as, so the Avro-derived table schema and the file schemas agree.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Converting an Avro schema with a local-timestamp column panics [hudi-rs]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua closed issue #812: Converting an Avro schema with a local-timestamp column panics
URL: https://github.com/apache/hudi-rs/issues/812
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Converting an Avro schema with a local-timestamp column panics [hudi-rs]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on issue #812:
URL: https://github.com/apache/hudi-rs/issues/812#issuecomment-5920241719
Fix: #813
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org