[GitHub] [incubator-pinot] pradeepgv42 edited a comment on pull request #5661: Optimize selection order-by when not all selected expressions are ordered

[GitBox <gi...@apache.org>]

pradeepgv42 edited a comment on pull request #5661:
URL: https://github.com/apache/incubator-pinot/pull/5661#issuecomment-655838063


   select * from tablename order by timestampCol desc limit 10
   
   Much better than previously but still taking ~30sec. 
   For example, this query is still scanning over 20% of the total rows, is there a way to avoid that? 
   
       "numServersQueried": 2,
       "numServersResponded": 2,
       "numSegmentsQueried": 546,
       "numSegmentsProcessed": 538,
       "numSegmentsMatched": 538,
       "numConsumingSegmentsQueried": 8,
       "numDocsScanned": 891433991,
       "numEntriesScannedInFilter": 0,
       "numEntriesScannedPostFilter": 1783093942,
       "numGroupsLimitReached": false,
       "totalDocs": 891433991,
       "timeUsedMs": 26382,
       "segmentStatistics": [],
       "traceInfo": {},
       "minConsumingFreshnessTimeMs": 9223372036854775807


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org