You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/08/04 08:47:39 UTC

[GitHub] [beam] piotr-szuberski edited a comment on pull request #12325: [BEAM-10543] Upgrade Kafka cross-language python tests

piotr-szuberski edited a comment on pull request #12325:
URL: https://github.com/apache/beam/pull/12325#issuecomment-668469132


   > Is there any way to share the pipeline codes in `CrossLanguageKafkaIOTest` and `CrossLanguageKafkaIO`? Could we share the pipeline codes and use `max_num_records` only in `CrossLanguageKafkaIOTest`? The internal test only checks `sum_counter` so you could keep any value in the `PCollection` afterward and assert it.
   
   It required a small modification (triggers don't work with bounded source - max_num_records changes unbounded to bounded) and sum_counter returns [None], so I use just ReadFromKafka and skip the rest of the read pipeline.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org