You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@qpid.apache.org by "Rob Godfrey (Created) (JIRA)" <ji...@apache.org> on 2012/01/08 18:49:39 UTC

[jira] [Created] (QPID-3736) [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement

[Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement
-----------------------------------------------------------------------------------------------------------

                 Key: QPID-3736
                 URL: https://issues.apache.org/jira/browse/QPID-3736
             Project: Qpid
          Issue Type: Improvement
            Reporter: Rob Godfrey
            Assignee: Rob Godfrey


BDB v5 adds a new method to Environment to allow for the flushing of logs to disk (synchronously if desired) without having to run a full checkpoint.  This seems to directly address our use case of BDB.  

Upgrading BDB and making use of this feature shows significant performance benefits, especially where there are a low number of concurrent connections.

For a single producer/consumer transactional case, I have observed a performance increase of 56%; for 2 producers/consumers 50%...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org


[jira] [Updated] (QPID-3736) [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement

Posted by "Rob Godfrey (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/QPID-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Godfrey updated QPID-3736:
------------------------------

    Status: Ready To Review  (was: In Progress)
    
> [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: QPID-3736
>                 URL: https://issues.apache.org/jira/browse/QPID-3736
>             Project: Qpid
>          Issue Type: Improvement
>            Reporter: Rob Godfrey
>            Assignee: Rob Godfrey
>         Attachments: QPID-3736.diff
>
>
> BDB v5 adds a new method to Environment to allow for the flushing of logs to disk (synchronously if desired) without having to run a full checkpoint.  This seems to directly address our use case of BDB.  
> Upgrading BDB and making use of this feature shows significant performance benefits, especially where there are a low number of concurrent connections.
> For a single producer/consumer transactional case, I have observed a performance increase of 56%; for 2 producers/consumers 50%...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org


[jira] [Updated] (QPID-3736) [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement

Posted by "Rob Godfrey (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/QPID-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Godfrey updated QPID-3736:
------------------------------

    Attachment: QPID-3736.diff

Attached a diff file of the necessary changes
                
> [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: QPID-3736
>                 URL: https://issues.apache.org/jira/browse/QPID-3736
>             Project: Qpid
>          Issue Type: Improvement
>            Reporter: Rob Godfrey
>            Assignee: Rob Godfrey
>         Attachments: QPID-3736.diff
>
>
> BDB v5 adds a new method to Environment to allow for the flushing of logs to disk (synchronously if desired) without having to run a full checkpoint.  This seems to directly address our use case of BDB.  
> Upgrading BDB and making use of this feature shows significant performance benefits, especially where there are a low number of concurrent connections.
> For a single producer/consumer transactional case, I have observed a performance increase of 56%; for 2 producers/consumers 50%...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org


[jira] [Resolved] (QPID-3736) [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement

Posted by "Robbie Gemmell (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/QPID-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robbie Gemmell resolved QPID-3736.
----------------------------------

    Resolution: Fixed

Change looks good to me.
                
> [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: QPID-3736
>                 URL: https://issues.apache.org/jira/browse/QPID-3736
>             Project: Qpid
>          Issue Type: Improvement
>          Components: Java Broker, Java Broker BDB Store
>            Reporter: Rob Godfrey
>            Assignee: Rob Godfrey
>             Fix For: 0.15
>
>         Attachments: QPID-3736.diff
>
>
> BDB v5 adds a new method to Environment to allow for the flushing of logs to disk (synchronously if desired) without having to run a full checkpoint.  This seems to directly address our use case of BDB.  
> Upgrading BDB and making use of this feature shows significant performance benefits, especially where there are a low number of concurrent connections.
> For a single producer/consumer transactional case, I have observed a performance increase of 56%; for 2 producers/consumers 50%...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org


[jira] [Updated] (QPID-3736) [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement

Posted by "Rob Godfrey (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/QPID-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Godfrey updated QPID-3736:
------------------------------

      Component/s: Java Broker BDB Store
                   Java Broker
    Fix Version/s: 0.15
    
> [Java Broker] Update BDB store to v5 and utilise explicit log flush for significant performance improvement
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: QPID-3736
>                 URL: https://issues.apache.org/jira/browse/QPID-3736
>             Project: Qpid
>          Issue Type: Improvement
>          Components: Java Broker, Java Broker BDB Store
>            Reporter: Rob Godfrey
>            Assignee: Rob Godfrey
>             Fix For: 0.15
>
>         Attachments: QPID-3736.diff
>
>
> BDB v5 adds a new method to Environment to allow for the flushing of logs to disk (synchronously if desired) without having to run a full checkpoint.  This seems to directly address our use case of BDB.  
> Upgrading BDB and making use of this feature shows significant performance benefits, especially where there are a low number of concurrent connections.
> For a single producer/consumer transactional case, I have observed a performance increase of 56%; for 2 producers/consumers 50%...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org