You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/06/30 21:46:32 UTC
[GitHub] [pulsar] sijie opened a new issue #7404: [managed ledger] Load cursors lazily
sijie opened a new issue #7404:
URL: https://github.com/apache/pulsar/issues/7404
*Motivation*
Currently, we have to wait until all cursors to be recovered before completing opening a managed ledger. This results in very long recovery time for the managed ledger. Pulsar is a messaging/streaming system. Write availability is critical to a lot of core business applications. We need to make it always writable. Hence we should decouple loading cursors from loading managed ledger. This ensures producers can move forward immediately once the data ledgers are ready.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #7404: [managed ledger] Load cursors lazily
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #7404:
URL: https://github.com/apache/pulsar/issues/7404#issuecomment-674614563
@MarvinCai Thanks, assigned.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] MarvinCai commented on issue #7404: [managed ledger] Load cursors lazily
Posted by GitBox <gi...@apache.org>.
MarvinCai commented on issue #7404:
URL: https://github.com/apache/pulsar/issues/7404#issuecomment-674548049
@sijie I can take it up if no one is working on it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] MarvinCai commented on issue #7404: [managed ledger] Load cursors lazily
Posted by GitBox <gi...@apache.org>.
MarvinCai commented on issue #7404:
URL: https://github.com/apache/pulsar/issues/7404#issuecomment-674660795
@codelipenghui I'm thinking adding a config for lazy recovering cursors for ledger and default to false so current user won't be affected. Then add a pendingRecoverCursors similar to the uninitializedCursors we have: https://github.com/apache/pulsar/blob/master/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerImpl.java#L169, if choose to lazily recover cursor then just create CompletableFutures for cursor recovery after ledger is opened and the ledger will be ready to write and don't need to wait for cursor recovery. Does this approach sound good?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiazhai closed issue #7404: [managed ledger] Load cursors lazily
Posted by GitBox <gi...@apache.org>.
jiazhai closed issue #7404:
URL: https://github.com/apache/pulsar/issues/7404
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org