[GitHub] [incubator-pinot] sunithabeeram edited a comment on issue #4087: Upgrade RoaringBitmap to 0.8.0

[GitBox <gi...@apache.org>]

sunithabeeram edited a comment on issue #4087: Upgrade RoaringBitmap to 0.8.0
URL: https://github.com/apache/incubator-pinot/pull/4087#issuecomment-482725417
 
 
   I didn't check the backward compatibility part (I am assuming we have generated indexes in atleast one of our tests), however, I was recently looking into the performance of a query against one of our tables; It had a huge IN clause and also had a couple of NOT IN clauses following this format:
   
   SELECT count(col) from table where col1 IN "<100+ values>" and col2 NOT IN "<2 values>" and col3 NOT IN "<10+values>" 
   
   (All columns in the filter clause had inverted-indexes).
   
   The base latency of this query was ~450ms. With only updating to roaringbitmap 0.8.0, I see that the latency drops to ~70ms. Thats pretty neat.
   
   The mileage across other queries might vary.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org