You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/07/22 14:16:26 UTC
[GitHub] [arrow-rs] tustvold opened a new issue, #2132: Use BitIndexIterator in Array Iterators
tustvold opened a new issue, #2132:
URL: https://github.com/apache/arrow-rs/issues/2132
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
The various array iterators such as `PrimitiveIter`, `GenericStringIter`, etc... check the validity map individually for each element. This is likely sub-optimal
**Describe the solution you'd like**
`BitIndexIterator` provides a way to iterate over null masks, that will outperform checking the mask for individual elements. We should use this instead.
**Describe alternatives you've considered**
We could not do this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #2132: Use BitIndexIterator in Array Iterators
Posted by GitBox <gi...@apache.org>.
tustvold commented on issue #2132:
URL: https://github.com/apache/arrow-rs/issues/2132#issuecomment-1239347607
My thinking on this has evolved, I don't think this ticket as written makes sense anymore - see https://github.com/apache/arrow-rs/pull/2666/files#diff-6d0f03a844e0d788b9513df1e957f24c501d2cdd4d3ed64203cb4f4f4db4ba89R29
TLDR I don't think it is possible to make `ArrayIter` performant
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #2132: Use BitIndexIterator in Array Iterators
Posted by GitBox <gi...@apache.org>.
tustvold closed issue #2132: Use BitIndexIterator in Array Iterators
URL: https://github.com/apache/arrow-rs/issues/2132
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] jhorstmann commented on issue #2132: Use BitIndexIterator in Array Iterators
Posted by GitBox <gi...@apache.org>.
jhorstmann commented on issue #2132:
URL: https://github.com/apache/arrow-rs/issues/2132#issuecomment-1192807526
Related to #1857. I haven't looked at BitIndexIterator in detail, so maybe this ticket is a better alternative.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org