You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Robert Burke (Jira)" <ji...@apache.org> on 2022/04/11 23:15:00 UTC

[jira] [Created] (BEAM-14295) [Go SDK] Add flag for Dataflow Service Options to dataflow runner

Robert Burke created BEAM-14295:
-----------------------------------

             Summary: [Go SDK] Add flag for Dataflow Service Options to dataflow runner
                 Key: BEAM-14295
                 URL: https://issues.apache.org/jira/browse/BEAM-14295
             Project: Beam
          Issue Type: Wish
          Components: sdk-go
            Reporter: Robert Burke


This would allow the Go SDK to use dataflow service options for environment configuration

eg. for enabling secure container boot:
https://cloud.google.com/dataflow/docs/guides/deploying-a-pipeline#python_12

They eventually get plumbed to here: https://pkg.go.dev/google.golang.org/api/dataflow/v1b3#Environment

Ultimately, needs to be plumbed to the Environment.ServiceOptions field somewhere here:
https://github.com/apache/beam/blob/716e3b1ddce527d6a10d054e55da55d80ebe8513/sdks/go/pkg/beam/runners/dataflow/dataflowlib/job.go#L157

Simple enough: Add a flag  that accepts a comma separated list of options, parse those to a []string, and populate 

Flag would go here: https://github.com/apache/beam/blob/716e3b1ddce527d6a10d054e55da55d80ebe8513/sdks/go/pkg/beam/runners/dataflow/dataflow.go#L53



--
This message was sent by Atlassian Jira
(v8.20.1#820001)