You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/02/06 23:39:00 UTC

[jira] [Work logged] (CAMEL-14514) Improving Google Pub/Sub performance

     [ https://issues.apache.org/jira/browse/CAMEL-14514?focusedWorklogId=383261&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383261 ]

ASF GitHub Bot logged work on CAMEL-14514:
------------------------------------------

                Author: ASF GitHub Bot
            Created on: 06/Feb/20 23:38
            Start Date: 06/Feb/20 23:38
    Worklog Time Spent: 10m 
      Work Description: alvinkwekel commented on pull request #3551: CAMEL-14514: Improve performance of Camel Google Pub/Sub
URL: https://github.com/apache/camel/pull/3551
 
 
   Use google-cloud-pubsub library
   Asynchronous pull
   Cache producers
   
   https://issues.apache.org/jira/browse/CAMEL-14514
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 383261)
    Remaining Estimate: 0h
            Time Spent: 10m

> Improving Google Pub/Sub performance
> ------------------------------------
>
>                 Key: CAMEL-14514
>                 URL: https://issues.apache.org/jira/browse/CAMEL-14514
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-google-pubsub
>    Affects Versions: 3.1.0
>            Reporter: Alvin Kwekel
>            Priority: Major
>              Labels: performance
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> I want to explore if it's possible to improve the performance of the Google Pub/Sub component.
> I did some experimenting with replacing the com.google.apis:google-api-services-pubsub library with com.google.cloud:google-cloud-pubsub and replacing the synchronous pull with the asynchronous one. I've also created a cache for the message producers.
> This combination lead to a significant improvement. More than 50 times faster in a simple test with a producer in a splitter with parallel processing and a consumer with concurrent consumers.
> I'd like to invite the community to see if these changes are in right direction and help out to take it further.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)