You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2019/12/05 22:16:03 UTC
[GitHub] [incubator-pinot] bxji opened a new pull request #4894: [TE] [WIP]
Dimension Exploration Prefetch optimizations
bxji opened a new pull request #4894: [TE] [WIP] Dimension Exploration Prefetch optimizations
URL: https://github.com/apache/incubator-pinot/pull/4894
This PR aims to solve a couple problems:
- For dimension exploration jobs, prefetch based on the time granularity of the data. Currently we are pulling 90 days worth of data every time, which is a lot of data for minute-level granularity.
- Utilize earlyStop() to make sure that we don't bother pre-fetching data when we know the detection will fail anyways.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org