You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Eduardo Morales (JIRA)" <ji...@apache.org> on 2018/06/25 18:05:00 UTC

[jira] [Created] (BEAM-4636) Make beam.Run() (and/or friends) thread-safe.

Eduardo Morales created BEAM-4636:
-------------------------------------

             Summary: Make beam.Run() (and/or friends) thread-safe.
                 Key: BEAM-4636
                 URL: https://issues.apache.org/jira/browse/BEAM-4636
             Project: Beam
          Issue Type: Improvement
          Components: sdk-go
            Reporter: Eduardo Morales
            Assignee: Henning Rohde


It would be nice to be able to launch dataflow pipelines in parallel. 

For example, here is my use case:
 * I consume data produced by my clients/customers.
 * I need to launch a pipeline on an event dispatch.
 * I may receive multiple events, from multiple customers at the same time.
 * Go code could be simpler if synchronization/cooperation wouldn't be needed from goroutines handling each customer. In particular, setting options through flags is cumbersome.
 * Launching dataflow pipelines serially may not scale if I am able to sign up many customers. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)