[GitHub] [beam] bquinart opened a new issue, #22573: [Feature Request]: IO Connector for Salesforce Pub/Sub API

[GitBox <gi...@apache.org>]

bquinart opened a new issue, #22573:
URL: https://github.com/apache/beam/issues/22573

   ### What would you like to happen?
   
   Consider building a connector for the Salesforce Pub/Sub API.
   Salesforce is ubiquitous and such a connector would add value to the Beam community.
   
   Salesforce has a number of API's (batch and 'event driven'), but has recently introduced a modern API based on gRPC and branded as "Pub/Sub API".
   Documentation is [here](https://developer.salesforce.com/docs/platform/pub-sub-api/overview).
   There is some samples available [here](https://resources.docs.salesforce.com/rel1/doc/en-us/static/pdf/Salesforce_Pub_Sub_API_Pilot.pdf).
   I think a source is most relevant but the same API can be used as sink.
   Not clear to me if it would be possible to parallelise the source.
   
   Such a connector would allow a number of architectures, for example when operational Salesforce data needs to be integrated in real-time with a data & AI platform.
   
   I posted this based on Beam Summit 2022 video from Ken in which he mentions the ambitious to grow the number of connectors.
   
   Note that I previously also made a feature request to add a similar connector to Google Datastream ([here](https://issuetracker.google.com/issues/234475025)). However Beam would be a lot more flexible and allow for a lot more specific scenarios.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: io-ideas


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org