You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2021/01/23 02:53:00 UTC

[jira] [Updated] (BEAM-5806) Allow to change the PubsubClientFactory when using PubsubIO

     [ https://issues.apache.org/jira/browse/BEAM-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chamikara Madhusanka Jayalath updated BEAM-5806:
------------------------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Open)

> Allow to change the PubsubClientFactory when using PubsubIO
> -----------------------------------------------------------
>
>                 Key: BEAM-5806
>                 URL: https://issues.apache.org/jira/browse/BEAM-5806
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-java-gcp
>            Reporter: Logan HAUSPIE
>            Priority: P3
>   Original Estimate: 24h
>          Time Spent: 4h
>  Remaining Estimate: 20h
>
> By using the PubsubIO to read from or write to Pub/Sub we are obliged to use the PubsubJsonClient to interact with the Pub/Sub API.
> This PubsubJsonClient encode the message in base 64 and increase the size of this one by 30% and there is no way to change the PubsubClient used by PubsubIO.
>  
> What I suggest is to allow developper to change the PubsubClientFactory by specifying it at the definition-time like the following:
> {{^PubsubIO.Read<String> read = PubsubIO.readStrings()
>           .fromTopic(StaticValueProvider.of(topic))^}}
>           .withTimestampAttribute("myTimestamp")^}}
>           .withIdAttribute("myId")^}}
>           *.withClientFactory(PubsubGrpcClient.FACTORY)*;^}}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)