[GitHub] [incubator-pinot] mcvsubbu commented on issue #3978: The segments are stored in memory

[GitBox <gi...@apache.org>]

mcvsubbu commented on issue #3978: The segments are stored in memory
URL: https://github.com/apache/incubator-pinot/issues/3978#issuecomment-473982286
 
 
   All segments of a table are divided among the tenant instances that host the table. If a server has a segment to serve, it will be loaded into memory.  You can use rest commands on the controller to see the idealstate of a table, and that will indicate to you the servers that host each segment. 
   
   It is up to you how you want to reduce cost.
   
   You can load the segments in "HEAP" mode, you just need to make sure that the maxDirectMemory argument to the jvm is sufficiently large so that the segments are loaded without OOM errors.
   
   You can load the segments in MMAP mode, in which case the segments are paged in from disk and Pinot lets the Operating System handle paging of segments in and out.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org