[GitHub] [pinot] mcvsubbu commented on issue #8339: Add sanity check to the output of Realtime Provisioning Tool

[GitBox <gi...@apache.org>]

mcvsubbu commented on issue #8339:
URL: https://github.com/apache/pinot/issues/8339#issuecomment-1086285554


   The two are certainly at odds with each other. We _have_ to do one of the two.
   
   Now, we can discard the second rule (i.e. output segment sizes larger than 500M), but include an asterisk to say something.
   
   I suggest that the something be a pointer to a section in the documentation that says what happens if there are too many segments of small size, or a small number of large size segments. Basically, explain the balance. 
   
   It is not a hard line that we cannot have huge segments. If the total data is 5TB, having 2GB segments is perhaps the best option.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org