[GitHub] [incubator-uniffle] zuston commented on issue #133: [Umbrella] Netty replace Grpc on data transfer

["zuston (via GitHub)" <gi...@apache.org>]

zuston commented on issue #133:
URL: https://github.com/apache/incubator-uniffle/issues/133#issuecomment-1501322678

   I have some questions regarding the memory management of the shuffle server in the Netty implementation. Specifically, I'm curious about how we store shuffle data in memory. Do we use Netty's ByteBuf or a customized memory pool managed by Uniffle?
   
   Based on my reading of the design document, there are two memory sections allocated for network and shuffle data storage. Would it be accurate to describe them as shared buffers?
   
   I believe that introducing a customized memory pool could potentially address the above issues. Furthermore, this could also benefit the transfer of shuffle data using GRPC.
   
   cc @leixm @advancedxy @jerqi 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org