[GitHub] [incubator-pinot] ly923976094 commented on issue #3978: The segments are stored in memory

[GitBox <gi...@apache.org>]

ly923976094 commented on issue #3978: The segments are stored in memory
URL: https://github.com/apache/incubator-pinot/issues/3978#issuecomment-474678713
 
 
   > All segments of a table are divided among the tenant instances that host the table. If a server has a segment to serve, it will be loaded into memory. You can use rest commands on the controller to see the idealstate of a table, and that will indicate to you the servers that host each segment.
   > 
   > It is up to you how you want to reduce cost.
   > 
   > You can load the segments in "HEAP" mode, you just need to make sure that the maxDirectMemory argument to the jvm is sufficiently large so that the segments are loaded without OOM errors.
   > 
   > You can load the segments in MMAP mode, in which case the segments are paged in from disk and Pinot lets the Operating System handle paging of segments in and out.
   
   If the load model changes from HEAP to MMAP, will the segments loaded into memory be released and then read data from the disk?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org