You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ilya Kozyrev (Jira)" <ji...@apache.org> on 2020/12/07 20:03:00 UTC

[jira] [Created] (BEAM-11410) Example of E2E test for Kafka environ

Ilya Kozyrev created BEAM-11410:
-----------------------------------

             Summary: Example of E2E test for Kafka environ 
                 Key: BEAM-11410
                 URL: https://issues.apache.org/jira/browse/BEAM-11410
             Project: Beam
          Issue Type: Improvement
          Components: examples-java
            Reporter: Ilya Kozyrev
            Assignee: Ilya Kozyrev


Kafka to Pub/Sub pipeline [example|https://github.com/apache/beam/pull/13112] needs to have e2e tests. However, in Beam Testing Guide [https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide] , we have not found examples or documentation for e2e tests that require Kafka environment can be set up.

During the investigation and with the help of our reviewers we found possible approaches for our issue. 

For Kafka, e2e test could use [test container|https://github.com/apache/beam/blob/02da3ae62e9025ff093747bb7a098982d34eff1b/sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaIOIT.java#L336]

These e2e test examples can be referenced in the [https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide] to serve examples of how customers may approach e2e testing of pipelines in their environments.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)