[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #5658: star-tree latency issue

[GitBox <gi...@apache.org>]

Jackie-Jiang commented on issue #5658:
URL: https://github.com/apache/incubator-pinot/issues/5658#issuecomment-654048897


   Both `numSegments` and `totalDocs` increased, meaning this is not the same data.
   Also, even though the `numDocsScanned ` is reduced from 800K to 280K, the bottleneck should be on the IO where each server needs to process ~150 segments. Changing `max_leaf_records` to 1 could significantly increase the size of the segment, which increases the data size to load, thus increase the latency.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org