You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/01/17 04:24:21 UTC
[GitHub] [incubator-doris] zenoyang opened a new issue #7774: [Enhancement][Vectorized] Speed up column filtering via SIMD
zenoyang opened a new issue #7774:
URL: https://github.com/apache/incubator-doris/issues/7774
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Description
- In the current Column Filter, when it is judged that the mask is not all 1, the elements will be traversed in a non-SIMD way, so there will be no performance improvement here. The test below also verifies this (currently sse_for).
- code: https://github.com/apache/incubator-doris/blob/685f45229efb42b327a9351143115863a5fdcbed/be/src/vec/columns/columns_common.cpp#L202
- Add AVX2 accelerated filtering
I tested 6000000 elements to filter，The time consumption for each implementation is as follows:
```
origin cost: 35820 microseconds
sse cost: 29149 microseconds
sse_for cost: 31396 microseconds
avx2 cost: 26297 microseconds
```
test code: https://godbolt.org/z/Gf6hvcnej
### Solution
no
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] HappenLee closed issue #7774: [Enhancement][Vectorized] Speed up column filtering via SIMD
Posted by GitBox <gi...@apache.org>.
HappenLee closed issue #7774:
URL: https://github.com/apache/incubator-doris/issues/7774
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] HappenLee commented on issue #7774: [Enhancement][Vectorized] Speed up column filtering via SIMD
Posted by GitBox <gi...@apache.org>.
HappenLee commented on issue #7774:
URL: https://github.com/apache/incubator-doris/issues/7774#issuecomment-1014247052
nice job！
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org