[GitHub] [pinot] richardstartin commented on issue #7642: numEntriesScannedInFilter > numDocsScanned in certain scenarios

[GitBox <gi...@apache.org>]

richardstartin commented on issue #7642:
URL: https://github.com/apache/pinot/issues/7642#issuecomment-952354200


   This will be because the query uses a range index on `time`. The range index splits the rows in each segment into (by default) 20 buckets each with a bitmap of row ids which have `time` within the bucket. The buckets which `a` and `b` are in need to be scanned, which is where `numEntriesScannedInFilter` comes from, but the buckets between these buckets don't. 
   
   A new kind of range index which doesn't need to perform scans, which leads to accelerated range queries, was added in #7454, if you are building from source you can try it by adding `"rangeIndexVersion": 2` to your `tableConfig` - otherwise it will be in the 0.9.0 release.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org