[GitHub] [pulsar] rdhabalia opened a new issue #5128: Bookie : provide option to skip adding entry to journal

[GitBox <gi...@apache.org>]

rdhabalia opened a new issue #5128: Bookie : provide option to skip adding entry to journal 
URL: https://github.com/apache/pulsar/issues/5128
 
 
   ### Motivation
   Right now, bookie serves WAL and provides durability by writing entry to journal before acking the message and it persist the entry to entry log file. bookie also provides below options to improve throughput
   - to persist entry with fsync disable 
   - writing entry to separate devices for journal and ledger. 
   
   So, persisting entry to journal before acking gives durability but sometimes it becomes bottleneck (mostly due to number of io ops) when user wants to achieve higher throughput in system.
   
   Few users have usecase to achieve high throughput with low publish latency, can compromise with durability and mostly reads from the cache. In that case, if we skip adding entry to journal and acks the message as soon as it's added to ledger cache then user can achieve comparatively very high writes in bookie. and it also helps in pulsar to reduce footprints of bookie while serving such usecases.
   
   So, we want to add option to skip adding entry to journal. We also want to make sure that bookie should be able to handle change in this configuration and should come back gracefully whenever this configuration has been changed.
   
   ### Changes
   Provide option `journalSkipEntryEnable` using which bookie can skip adding entry to journal while serving addEntry request.
   
   @merlimat 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services