You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "CurtHagenlocher (via GitHub)" <gi...@apache.org> on 2024/10/31 15:07:22 UTC
[I] Support new Arrow types decimal32 and decimal64 [arrow-rs]
CurtHagenlocher opened a new issue, #6661:
URL: https://github.com/apache/arrow-rs/issues/6661
The Arrow specification was recently amended to support 32-bit and 64-bit decimal values. It would be good for the Rust implementation to support these.
I have made preliminary changes at [https://github.com/CurtHagenlocher/arrow-rs/tree/decimal3264](https://github.com/CurtHagenlocher/arrow-rs/tree/decimal3264). The gaps which remain are
1) Support for conversions between decimal32/decimal64 and other types.
2) Support for reading lower-precision decimal values from Parquet as decimal32 or decimal64. Parquet already supports storing 32-bit and 64-bit decimal values, but these are currently being expanded to at least 128-bits on read when they could be returned more efficiently. This support should probably be opt-in to avoid breaking client code which isn't yet aware of the new types.
I could submit a PR as-is; otherwise, will try to find the time in the next month to implement the gaps I've identified.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support new Arrow types decimal32 and decimal64 [arrow-rs]
Posted by "CurtHagenlocher (via GitHub)" <gi...@apache.org>.
CurtHagenlocher commented on issue #6661:
URL: https://github.com/apache/arrow-rs/issues/6661#issuecomment-2450133643
(I should note that my changes take the most straightforward approach of defining additional types. There may be significant advantages in the approach outlined by #2001, but it's also hard to imagine that this approach could be made backwards-compatible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support new Arrow types decimal32 and decimal64 [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #6661: Support new Arrow types decimal32 and decimal64
URL: https://github.com/apache/arrow-rs/issues/6661
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org