You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/11/11 00:14:26 UTC
[GitHub] [incubator-pinot] chenboat opened a new issue #6256: Make time boundary offset configurable
chenboat opened a new issue #6256:
URL: https://github.com/apache/incubator-pinot/issues/6256
Currently for Pinot hybrid tables, the timeboundary offset (used to decide the split of querying either offline table or realtime table) is hardcoded to be 1 day of daily offline tables. This hardcoded value may not work well in many environments. In particular, different companies have different batch data refreshment rate: some can be well under 1 day.
It is much better to leave this field to be a configurable parameter for Pinot broker or maybe on table config if needed)
https://github.com/apache/incubator-pinot/blob/0f4ee6814a5fa103f5b88d4df75b0968dc7ce641/pinot-broker/src/main/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryManager.java#L159
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] fx19880617 commented on issue #6256: Make time boundary offset configurable
Posted by GitBox <gi...@apache.org>.
fx19880617 commented on issue #6256:
URL: https://github.com/apache/incubator-pinot/issues/6256#issuecomment-728312744
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [incubator-pinot] sajjad-moradi commented on issue #6256: Make time boundary offset configurable
Posted by GitBox <gi...@apache.org>.
sajjad-moradi commented on issue #6256:
URL: https://github.com/apache/incubator-pinot/issues/6256#issuecomment-728427197
@chenboat There's a design doc for this: https://docs.google.com/document/d/1KykbUIstFI7F4IOOlUVnXWzpgKazwRAJdok0RT1ae64/
It's been proposed and agreed upon in the issue #5751, but it's not yet implemented.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org