You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Luke Cwik (JIRA)" <ji...@apache.org> on 2019/04/03 16:55:02 UTC

[jira] [Created] (BEAM-7000) Consider adding support for batching state requests

Luke Cwik created BEAM-7000:
-------------------------------

             Summary: Consider adding support for batching state requests
                 Key: BEAM-7000
                 URL: https://issues.apache.org/jira/browse/BEAM-7000
             Project: Beam
          Issue Type: Sub-task
          Components: beam-model
            Reporter: Luke Cwik


The current user facing API looks like a future which can be resolved later, we want to minimize the amount of time a user spends blocking after queuing up all their requests.

Google Cloud Dataflow has experienced performance problems in the past without having support for a batch API because solutions that add fixed delays ("wait for N milliseconds for a batch to form") have caused large problems for pipelines with few numbers of keys.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)