[GitHub] [incubator-pinot] laxmanchekka opened a new issue #6989: Realtime to Offline segment conversion: Provision for rolling offline segments based on segment size

[GitBox <gi...@apache.org>]

laxmanchekka opened a new issue #6989:
URL: https://github.com/apache/incubator-pinot/issues/6989


   REALTIME tables segment size can be controlled using `realtime.segment.flush.threshold.segment.size` (say "100M")
   We don't have any similar configuration for OFFLINE tables which can be used during Realtime to Offline table conversion.
   
   There is a configuration `maxNumRecordsPerSegment` with which we can indirectly achieve desired size. However, having a direct size based control will be really helpful and straight forward.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org

[GitHub] [incubator-pinot] laxmanchekka commented on issue #6989: Realtime to Offline segment conversion: Provision for rolling offline segments based on segment size

[GitBox <gi...@apache.org>]

laxmanchekka commented on issue #6989:
URL: https://github.com/apache/incubator-pinot/issues/6989#issuecomment-849169088


   @Jackie-Jiang @npawar 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org