You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@bookkeeper.apache.org by GitBox <gi...@apache.org> on 2018/03/14 00:32:39 UTC

[GitHub] dlg99 commented on issue #347: Provide a zero-copy write protocol

dlg99 commented on issue #347: Provide a zero-copy write protocol
URL: https://github.com/apache/bookkeeper/issues/347#issuecomment-372865287
 
 
   UnsafeByteOperations helps with memory allocations (I prototyped this at Salesforce's internal fork and it did help).
   It does not help with zero copy. Netty added splice support https://github.com/netty/netty/pull/3665 and Java's NIO has transferTo/transferFrom that allow to bypass data copying to user space. As I remember, Kafka uses these.
   IIRC zero copy is impossible with protobuf as it needs to bring data to user space for parsing. https://github.com/google/protobuf/issues/1896
   
   Cap'n'proto or flatbuffers might work for this: https://capnproto.org/news/2014-06-17-capnproto-flatbuffers-sbe.html
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services