You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/05/07 01:20:00 UTC

[jira] [Updated] (BEAM-12300) Remove the need for --test-pipeline-options in flink/spark Python tests.

     [ https://issues.apache.org/jira/browse/BEAM-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver updated BEAM-12300:
-------------------------------
    Status: Open  (was: Triage Needed)

> Remove the need for --test-pipeline-options in flink/spark Python tests.
> ------------------------------------------------------------------------
>
>                 Key: BEAM-12300
>                 URL: https://issues.apache.org/jira/browse/BEAM-12300
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink, runner-spark
>            Reporter: Kyle Weaver
>            Priority: P3
>              Labels: portability-flink, portability-spark
>
> Flink and Spark Python tests are skipped if --test-pipeline-options is unset, but that's just an unfortunate implementation detail of the test framework - we want to skip Flink and Spark tests in the general pytest suite. We should find a better way to know to skip these tests, so that there's less cognitive load in trying to figure out what --test-pipeline-options should be set to.
> https://github.com/apache/beam/blob/51541a595b09751dd3dde2c50caf2a968ac01b68/sdks/python/apache_beam/runners/portability/flink_runner_test.py#L81



--
This message was sent by Atlassian Jira
(v8.3.4#803005)