[jira] [Created] (BEAM-11999) Enable Dataflow in ValidatesRunner test framework.

["Daniel Oliveira (Jira)" <ji...@apache.org>]

Daniel Oliveira created BEAM-11999:
--------------------------------------

             Summary: Enable Dataflow in ValidatesRunner test framework.
                 Key: BEAM-11999
                 URL: https://issues.apache.org/jira/browse/BEAM-11999
             Project: Beam
          Issue Type: Sub-task
          Components: sdk-go
            Reporter: Daniel Oliveira
            Assignee: Daniel Oliveira


_This is an ex-post-facto bug documenting work that should have had it's own JIRA but didn't. The purpose of this bug is to add a more detailed summary of work that is already finished._

Dataflow needed to be enabled in the Go SDK's new test framework. Before this work was done the test framework was only initially supporting direct, Python ULR, Spark, and Flink. This is because a decent amount of additional setup was necessary to enable Dataflow, mostly adjusting the script running the tests so that it could handle GCP related tasks.

The work involved was mostly straightforward as there was an existing reference to use, in the existing test framework. Most of the delay getting this change in was focused on attempting to get the cross-language tests working, which turned out to be very difficult, and involved a slow development cycle (each attempted fix would take about 5+ minutes to test, as it involved running a Dataflow job). That effort was put on pause and documented on BEAM-11574 and the final PR only included Dataflow support for non-cross-language tests. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)