You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ilya Kozyrev (Jira)" <ji...@apache.org> on 2020/12/07 20:03:00 UTC
[jira] [Created] (BEAM-11410) Example of E2E test for Kafka environ
Ilya Kozyrev created BEAM-11410:
-----------------------------------
Summary: Example of E2E test for Kafka environ
Key: BEAM-11410
URL: https://issues.apache.org/jira/browse/BEAM-11410
Project: Beam
Issue Type: Improvement
Components: examples-java
Reporter: Ilya Kozyrev
Assignee: Ilya Kozyrev
Kafka to Pub/Sub pipeline [example|https://github.com/apache/beam/pull/13112] needs to have e2e tests. However, in Beam Testing Guide [https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide] , we have not found examples or documentation for e2e tests that require Kafka environment can be set up.
During the investigation and with the help of our reviewers we found possible approaches for our issue.
For Kafka, e2e test could use [test container|https://github.com/apache/beam/blob/02da3ae62e9025ff093747bb7a098982d34eff1b/sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaIOIT.java#L336]
These e2e test examples can be referenced in the [https://cwiki.apache.org/confluence/display/BEAM/Contribution+Testing+Guide] to serve examples of how customers may approach e2e testing of pipelines in their environments.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)