You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ilya Kozyrev (Jira)" <ji...@apache.org> on 2020/10/14 18:50:00 UTC

[jira] [Created] (BEAM-11065) Apache Beam Template to ingest from Apache Kafka to Google Pub/Sub

Ilya Kozyrev created BEAM-11065:
-----------------------------------

             Summary: Apache Beam Template to ingest from Apache Kafka to Google Pub/Sub
                 Key: BEAM-11065
                 URL: https://issues.apache.org/jira/browse/BEAM-11065
             Project: Beam
          Issue Type: Improvement
          Components: examples-java
            Reporter: Ilya Kozyrev


In the Beam repository, we have awesome examples on java and python, however, there are not presented any templates.

The reason for templates here, some users would like to use parametrized flex templates for common use cases. For example, if I want to do a typical pipeline, read from some source, and write to another source, I would happy if Beam provides a finally implemented pipeline for my common case in which I can put only parameters to customize input and output sources.

I propose to add the new directory in the root of the project and name it "templates". It will be a new Gradle module in the project. As a first template, I propose to implement Kafka to Pubsub template.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)