[jira] [Commented] (CAMEL-11262) camel-google-pubsub - Improve to work with streaming mode

["Evgeny Minkevich (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CAMEL-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017191#comment-16017191 ] 

Evgeny Minkevich commented on CAMEL-11262:
------------------------------------------

A few use cases that need to be considered when switching to async.

1. Downstream blocking queues (such as seda limited to let's say 100 with explicit blocking until processed)

The use case here was when PubSub is under load, Camel had tendency to extract messages first leading to reading the queue all the time and not processing the downstream.

2. throttle

One of the use cases - how would this play out with async?

3. explicit concurrentConsumers

I have noticed a slight performance degradation with a large number of concurrent consumers against PubSub - but mainly concerned with downstream systems

Important discussions to consider:

https://github.com/GoogleCloudPlatform/google-cloud-java/issues/1661
https://github.com/GoogleCloudPlatform/google-cloud-java/issues/1157

As you can see synchronous pull has been requested by more than one person.
From my perspective, the improvements to be introduced would need to extend the current model.

> camel-google-pubsub - Improve to work with streaming mode
> ---------------------------------------------------------
>
>                 Key: CAMEL-11262
>                 URL: https://issues.apache.org/jira/browse/CAMEL-11262
>             Project: Camel
>          Issue Type: Improvement
>          Components: camel-google-pubsub
>    Affects Versions: 2.19.0
>            Reporter: Claus Ibsen
>             Fix For: 2.20.0
>
>
> The pubsub component
> https://github.com/apache/camel/tree/master/components/camel-google-pubsub
> Can likely be improved to work better with streaming mode and use Camel asynchronous processing. 
> There may be other things.
> Ray Tsang from Google has some ideas and want to help out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)