You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@qpid.apache.org by "Daniil Kirilyuk (Jira)" <ji...@apache.org> on 2021/09/29 07:40:00 UTC
[jira] [Commented] (QPID-8557) [Broker-J] Batching mode for
CoalescingCommitter
[ https://issues.apache.org/jira/browse/QPID-8557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421980#comment-17421980 ]
Daniil Kirilyuk commented on QPID-8557:
---------------------------------------
Hi [~rgodfrey],
Could you please elaborate the optimizations could be made on message publishing? We would like to work on this in future.
We would also like to add some tests to ensure the guarantees expected of the broker you mentioned. Could you suggest a test scenario breaking them?
> [Broker-J] Batching mode for CoalescingCommitter
> ------------------------------------------------
>
> Key: QPID-8557
> URL: https://issues.apache.org/jira/browse/QPID-8557
> Project: Qpid
> Issue Type: Improvement
> Components: Broker-J
> Affects Versions: qpid-java-broker-8.0.5
> Reporter: Daniil Kirilyuk
> Priority: Minor
>
> Although QPID-8547 introduced configurable parameters for CoalescingCommitter, BDB log is flushed to disc on every message. That is caused by calling future.get() inside of org.apache.qpid.server.txn.AsyncCommand.complete(). Such call forces broker to wait until CoalescingCommiter calls #CommitThread#processJobs() making the operation effectively sync instead of async (every message triggers processJobs() and data flush).
> To improve overall performance we suggest to add batching mode for CoalescingCommitter, which would consider BDBVirtualHost parameters and flush data in chunks of size ${qpid.broker.bdbCommiterNotifyThreshold} or every ${qpid.broker.bdbCommiterWaitTimeout} ms (whatever comes first).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@qpid.apache.org
For additional commands, e-mail: dev-help@qpid.apache.org