You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Robert Burke (Jira)" <ji...@apache.org> on 2022/04/11 23:15:00 UTC
[jira] [Created] (BEAM-14295) [Go SDK] Add flag for Dataflow Service Options to dataflow runner
Robert Burke created BEAM-14295:
-----------------------------------
Summary: [Go SDK] Add flag for Dataflow Service Options to dataflow runner
Key: BEAM-14295
URL: https://issues.apache.org/jira/browse/BEAM-14295
Project: Beam
Issue Type: Wish
Components: sdk-go
Reporter: Robert Burke
This would allow the Go SDK to use dataflow service options for environment configuration
eg. for enabling secure container boot:
https://cloud.google.com/dataflow/docs/guides/deploying-a-pipeline#python_12
They eventually get plumbed to here: https://pkg.go.dev/google.golang.org/api/dataflow/v1b3#Environment
Ultimately, needs to be plumbed to the Environment.ServiceOptions field somewhere here:
https://github.com/apache/beam/blob/716e3b1ddce527d6a10d054e55da55d80ebe8513/sdks/go/pkg/beam/runners/dataflow/dataflowlib/job.go#L157
Simple enough: Add a flag that accepts a comma separated list of options, parse those to a []string, and populate
Flag would go here: https://github.com/apache/beam/blob/716e3b1ddce527d6a10d054e55da55d80ebe8513/sdks/go/pkg/beam/runners/dataflow/dataflow.go#L53
--
This message was sent by Atlassian Jira
(v8.20.1#820001)