You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "vegarsti (via GitHub)" <gi...@apache.org> on 2025/10/25 07:12:52 UTC
[I] Improve performance of RunEndEncoded cast using the filter kernel [arrow-rs]
vegarsti opened a new issue, #8707:
URL: https://github.com/apache/arrow-rs/issues/8707
I think what @tustvold is getting at is that the `filter` kernel is (very) fast and thus using it rather than the `take` kernel is likely to be faster.
So I think the idea here is instead of building up `value_indexes` it would be to implement some way to turn the result of `Partition` into a boolean array and pass to the filter kernel
I think we can file this idea as a ticket and potentially do it as a follow on PR / performance optimization
```rust
let partitions = partition(&[Arc::clone(cast_array)])?;
// ....
let filter: BooleanArray = partitions.into_inner(); // not sure about this API
// call filter instead of take
let values_array = filter(&cast_array, &filter)?;
```
_Originally posted by @alamb in https://github.com/apache/arrow-rs/pull/8589#discussion_r2456121522_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve performance of RunEndEncoded cast [arrow-rs]
Posted by "vegarsti (via GitHub)" <gi...@apache.org>.
vegarsti commented on issue #8707:
URL: https://github.com/apache/arrow-rs/issues/8707#issuecomment-3457874622
One small attempt, suggested by @alamb, is https://github.com/apache/arrow-rs/pull/8726
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve performance of RunEndEncoded cast [arrow-rs]
Posted by "vegarsti (via GitHub)" <gi...@apache.org>.
vegarsti commented on issue #8707:
URL: https://github.com/apache/arrow-rs/issues/8707#issuecomment-4342776715
I do think so, yeah! At least the quote in the issue was implemented in the PR. Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve performance of RunEndEncoded cast [arrow-rs]
Posted by "vegarsti (via GitHub)" <gi...@apache.org>.
vegarsti closed issue #8707: Improve performance of RunEndEncoded cast
URL: https://github.com/apache/arrow-rs/issues/8707
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve performance of RunEndEncoded cast [arrow-rs]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on issue #8707:
URL: https://github.com/apache/arrow-rs/issues/8707#issuecomment-4339151890
@vegarsti is this closed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org