You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Pablo Estrada (Jira)" <ji...@apache.org> on 2019/12/05 01:32:00 UTC

[jira] [Created] (BEAM-8892) Move Chicago Taxi Example Benchmarks to Beam orchestrator

Pablo Estrada created BEAM-8892:
-----------------------------------

             Summary: Move Chicago Taxi Example Benchmarks to Beam orchestrator
                 Key: BEAM-8892
                 URL: https://issues.apache.org/jira/browse/BEAM-8892
             Project: Beam
          Issue Type: Improvement
          Components: benchmarking-py
            Reporter: Pablo Estrada


As originally implemented, the Chicago Taxi Example benchmarks for Beam Python SDK rely on on a custom bash script that runs (orchestrates) each of the pipelines that are part of the Chicago Taxi Example.

 

The TFX team recently developed a Beam-based pipeline orchestrator:  [https://www.tensorflow.org/tfx/guide/beam_orchestrator]

 

The example with Beam orchestrator: [https://github.com/tensorflow/tfx/blob/master/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_beam.py]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)