You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@beam.apache.org by "hsy541@gmail.com" <hs...@gmail.com> on 2023/12/19 18:16:44 UTC
pubsubliteio is super slow
Any one is using pubsublite? I find it super slow 5 messages/sec and there
is no options for me to tune the performance
Re: pubsubliteio is super slow
Posted by Valentyn Tymofieiev via user <us...@beam.apache.org>.
Hello, I talked offline to a few folks about this,
- NO_CLIENT_TOKENS means the client code is getting flow controlled.
- we'd need more information to debug further, such as the Dataflow job
id , or project id , the version of the Beam SDK you use.
- Reaching out to GCP support sounds like a good next step to get help.
See: https://cloud.google.com/support-hub and
https://cloud.google.com/support/docs/issue-trackers .
On Tue, Dec 19, 2023 at 10:54 PM hsy541@gmail.com <hs...@gmail.com> wrote:
> Do you have a ticket?
>
> And in the pubsublite metrics it show NO_CLIENT_TOKENS
>
> On Tue, Dec 19, 2023 at 1:39 PM Nirav Patel <ni...@gmail.com> wrote:
>
>> we have. yes it is super slow. I tested python, java IO version as well
>> besides beam IO. we reported to google about this problem.
>>
>> On Tue, Dec 19, 2023 at 10:17 AM hsy541@gmail.com <hs...@gmail.com>
>> wrote:
>>
>>> Any one is using pubsublite? I find it super slow 5 messages/sec and
>>> there is no options for me to tune the performance
>>>
>>
Re: pubsubliteio is super slow
Posted by "hsy541@gmail.com" <hs...@gmail.com>.
Do you have a ticket?
And in the pubsublite metrics it show NO_CLIENT_TOKENS
On Tue, Dec 19, 2023 at 1:39 PM Nirav Patel <ni...@gmail.com> wrote:
> we have. yes it is super slow. I tested python, java IO version as well
> besides beam IO. we reported to google about this problem.
>
> On Tue, Dec 19, 2023 at 10:17 AM hsy541@gmail.com <hs...@gmail.com>
> wrote:
>
>> Any one is using pubsublite? I find it super slow 5 messages/sec and
>> there is no options for me to tune the performance
>>
>
Re: pubsubliteio is super slow
Posted by Nirav Patel <ni...@gmail.com>.
we have. yes it is super slow. I tested python, java IO version as well
besides beam IO. we reported to google about this problem.
On Tue, Dec 19, 2023 at 10:17 AM hsy541@gmail.com <hs...@gmail.com> wrote:
> Any one is using pubsublite? I find it super slow 5 messages/sec and there
> is no options for me to tune the performance
>