You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Andrew Lamb <an...@gmail.com> on 2025/05/08 19:52:59 UTC
[DISCUSS] Rust Variant Implementation Status
Hello,
I am pretty stoked to report progress on a Rust Variant implementation
(see epic here[0]).
1. We have added example binary data in parquet-testing[1] (Thanks Micah
for the review and merge)
2. Jiaying's prototype [2] is looking good and we are preparing to start
merging it in pieces
3. I have created a PR to add a parquet-variant crate to arrow-rs[3]
(looking for a review 🎣)
Once we have the parquet-variant crate merged, I expect a series of PRs
that incrementally adds support for different parts of the Variant
specification. Once this is done, we will move on to integrating it into
the parquet decoder.
Exciting times,
Andrew
[0]: https://github.com/apache/arrow-rs/issues/6736
[1]: https://github.com/apache/parquet-testing/pull/76
[2]: https://github.com/apache/arrow-rs/pull/7452
[3]: https://github.com/apache/arrow-rs/pull/7485
Re: [DISCUSS] Rust Variant Implementation Status
Posted by Russell Spitzer <ru...@gmail.com>.
Great news!
On Thu, May 8, 2025 at 3:53 PM Andrew Lamb <an...@gmail.com> wrote:
> Hello,
>
> I am pretty stoked to report progress on a Rust Variant implementation
> (see epic here[0]).
>
> 1. We have added example binary data in parquet-testing[1] (Thanks Micah
> for the review and merge)
> 2. Jiaying's prototype [2] is looking good and we are preparing to start
> merging it in pieces
> 3. I have created a PR to add a parquet-variant crate to arrow-rs[3]
> (looking for a review 🎣)
>
> Once we have the parquet-variant crate merged, I expect a series of PRs
> that incrementally adds support for different parts of the Variant
> specification. Once this is done, we will move on to integrating it into
> the parquet decoder.
>
> Exciting times,
> Andrew
>
> [0]: https://github.com/apache/arrow-rs/issues/6736
> [1]: https://github.com/apache/parquet-testing/pull/76
> [2]: https://github.com/apache/arrow-rs/pull/7452
> [3]: https://github.com/apache/arrow-rs/pull/7485
>