You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/07/13 23:04:36 UTC
[GitHub] [arrow-rs] viirya opened a new issue, #2060: Improve performance of set_bits
viirya opened a new issue, #2060:
URL: https://github.com/apache/arrow-rs/issues/2060
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
When profiling a project using arrow-rs, found that `set_bits` is among one of heavy stack trace:
```
10 arrow::compute::kernels::filter::filter_array::h86b56436bac43c26
9 arrow::compute::kernels::filter::filter_dict::hb507a878026da337
8 arrow::compute::kernels::filter::filter_primitive::he8bd6ecc432914a3
6 arrow::compute::kernels::filter::filter_null_mask::h4636cf4ec7ac3797
6 arrow::compute::kernels::filter::filter_bits::hba752c56f552d45f
6 arrow::array::builder::boolean_buffer_builder::BooleanBufferBuilder::append_packed_range::hd58d43f1c7f97d22
4 arrow::util::bit_mask::set_bits::hdf6751951c8784f2
```
It's good if we can improve it.
**Describe the solution you'd like**
A clear and concise description of what you want to happen.
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
Add any other context or screenshots about the feature request here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #2060: Improve performance of set_bits
Posted by GitBox <gi...@apache.org>.
tustvold closed issue #2060: Improve performance of set_bits
URL: https://github.com/apache/arrow-rs/issues/2060
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #2060: Improve performance of set_bits
Posted by GitBox <gi...@apache.org>.
tustvold commented on issue #2060:
URL: https://github.com/apache/arrow-rs/issues/2060#issuecomment-1184628915
It might be possible to rework the algorithm to use UnalignedBitChunkIterator instead, which may perform better
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] viirya commented on issue #2060: Improve performance of set_bits
Posted by GitBox <gi...@apache.org>.
viirya commented on issue #2060:
URL: https://github.com/apache/arrow-rs/issues/2060#issuecomment-1184675973
Thanks @tustvold. I will take a look on `UnalignedBitChunkIterator` too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org