You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "mzabaluev (via GitHub)" <gi...@apache.org> on 2026/02/16 11:06:19 UTC
[PR] refactor: simplify dynamic state for Avro record projection [arrow-rs]
mzabaluev opened a new pull request, #9419:
URL: https://github.com/apache/arrow-rs/pull/9419
# Rationale for this change
The inner loop in `Projector::project_record` gives the optimizer somewhat complicated dynamic data to branch through.
The sparse arrays in `Projector` are redundantly coded: `None` in the index positions of `writer_to_reader` must match `Some` in `skip_decoders` and vice versa.
# What changes are included in this PR?
Refactor record projection state with a single array of directive-like enums corresponding to each writer schema field.
# Are these changes tested?
Added a benchmark for record projection (the benchmark code is partially shared with #9397).
Somewhat counterintuitively for me, it does not show improvement on a more complex case with a mix of projected fields, but does improve the simpler one-field projection cases.
Passes the existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: simplify dynamic state for Avro record projection [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb merged PR #9419:
URL: https://github.com/apache/arrow-rs/pull/9419
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: simplify dynamic state for Avro record projection [arrow-rs]
Posted by "mzabaluev (via GitHub)" <gi...@apache.org>.
mzabaluev commented on PR #9419:
URL: https://github.com/apache/arrow-rs/pull/9419#issuecomment-3980693636
@alamb I have resolved the conflicts now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] refactor: simplify dynamic state for Avro record projection [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #9419:
URL: https://github.com/apache/arrow-rs/pull/9419#issuecomment-4001055924
Thank you @mzabaluev and @jecsand838
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org