You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2019/04/01 17:16:49 UTC
[GitHub] [incubator-pinot] mcvsubbu commented on issue #4036: Reduce heap
usage when building realtime segments
mcvsubbu commented on issue #4036: Reduce heap usage when building realtime segments
URL: https://github.com/apache/incubator-pinot/issues/4036#issuecomment-478666675
The prototype that I have is from before we moved to apache, so the changes are to com.linkedin classes. I am not actively working on this right now, but created the issue so that anyone interested can pick it up. We will get to it at some point.
That aside, I think the off-heap dictionary for realtime will not help reduce heap usage here. Most of the heap usage is in reading (from a row oriented format) and writing to a segment (column format), IIRC.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org