You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Daniel Thevessen (Jira)" <ji...@apache.org> on 2021/05/03 20:37:00 UTC

[jira] [Created] (BEAM-12272) Python - Backport FirestoreIO connector's ramp-up to DatastoreIO connector

Daniel Thevessen created BEAM-12272:
---------------------------------------

             Summary: Python - Backport FirestoreIO connector's ramp-up to DatastoreIO connector
                 Key: BEAM-12272
                 URL: https://issues.apache.org/jira/browse/BEAM-12272
             Project: Beam
          Issue Type: Improvement
          Components: io-py-gcp
            Reporter: Daniel Thevessen
            Assignee: Daniel Thevessen


The FirestoreIO connector (BEAM-8376) for the Java SDK is currently out for review.  

Some of the features for the Firestore connector are new relative to the Datastore connector, so the Firestore team would like to add them there as well. Most notably the Firestore connector has a gradual ramp-up feature that slowly increases throughput in line with Datastore/Firestore best practices.  
Some minor adjustments to constants for batch sizing and backoff may also be worth looking at.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)