You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/04/20 15:48:58 UTC
[GitHub] [pinot] richardstartin commented on pull request #8570: Startree streamlining
richardstartin commented on PR #8570:
URL: https://github.com/apache/pinot/pull/8570#issuecomment-1104090758
This yields up to 2x reduction in average query time for a sum over a 2D startree:
before:
```
Benchmark (_numRows) (_query) (_scenario) Mode Cnt Score Error Units
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.001) avgt 5 716065.843 ± 152704.805 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.001) avgt 5 913635041.333 ± 1942153323.171 B/op
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.5) avgt 5 543558.326 ± 600710.721 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.5) avgt 5 910242066.373 ± 1937638062.800 B/op
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.999) avgt 5 706489.120 ± 178988.130 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.999) avgt 5 908499340.533 ± 1936126801.021 B/op
```
after:
```
Benchmark (_numRows) (_query) (_scenario) Mode Cnt Score Error Units
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.001) avgt 5 434788.384 ± 67478.376 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.001) avgt 5 831883216.640 ± 1766190864.794 B/op
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.5) avgt 5 378584.087 ± 20401.492 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.5) avgt 5 828604188.533 ± 1761906482.829 B/op
BenchmarkQueries.query 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.999) avgt 5 370225.020 ± 19187.406 us/op
BenchmarkQueries.query:·gc.alloc.rate.norm 1500000 SELECT INT_COL,SORTED_COL,SUM(RAW_INT_COL) from MyTable group by INT_COL, SORTED_COL order by SORTED_COL, INT_COL ASC EXP(0.999) avgt 5 826189353.600 ± 1758966803.625 B/op
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org