You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/03/20 00:49:56 UTC
[GitHub] [incubator-druid] jon-wei edited a comment on issue #7133: 6088 -
Time Ordering On Scans
jon-wei edited a comment on issue #7133: 6088 - Time Ordering On Scans
URL: https://github.com/apache/incubator-druid/pull/7133#issuecomment-474640476
I don't think this needs to be something done in this PR, but it's worth mentioning that moving the "time chunking" behavior to the broker, and issuing several subqueries to the historical could be a possible later optimization:
This could help in situations like the following:
- I want an ascending time scan with limit X, across three days worth of data, with DAY granularity segments
- The first day of data has enough data to hit limit X
- I have three historicals: the first has data for the first day, and the second has data for the second 2 day, and the third has data only for third day
- With the current approach in this PR, historical 2 and 3 would also have to do work to answer this query (it would go and return up to limit X rows, even though none of them would be included in the final result set), when only historical 1 really needs to be queried
- If the broker split the query up into daily subqueries, this would cut down on the overall workload across historicals
This would require more change to the broker to be able to support this new type of query, so I think the current approach is fine for now.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org