You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lo...@apache.org on 2020/03/26 18:46:56 UTC
[beam] 01/01: Update the Go SDK roadmap for April 2020
This is an automated email from the ASF dual-hosted git repository.
lostluck pushed a commit to branch lostluck-go-roadmap
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 85af9fadd8f468b74ded62d0defc7ca5f0a84ec6
Author: Robert Burke <lo...@users.noreply.github.com>
AuthorDate: Thu Mar 26 11:46:39 2020 -0700
Update the Go SDK roadmap for April 2020
---
website/src/roadmap/go-sdk.md | 36 +++++++++++++++++++++---------------
1 file changed, 21 insertions(+), 15 deletions(-)
diff --git a/website/src/roadmap/go-sdk.md b/website/src/roadmap/go-sdk.md
index c2e463c..29378e9 100644
--- a/website/src/roadmap/go-sdk.md
+++ b/website/src/roadmap/go-sdk.md
@@ -24,23 +24,29 @@ The Go SDK is currently experimental. As the first purely portable Beam SDK, the
by the status of the [Beam Portabillity Framework](https://beam.apache.org/roadmap/portability/) and the existence of
portable runners.
-With that in mind present work on the Go SDK has the following goals:
+**April 2020 Update**
+This year we hope to move the SDK out of experimental at least for Batch usage.
+
+To do so, there are a few blocking changes:
+ * Support Interoperability with other SDKs
+ * Scalable IOs
+ * Portability Proto stability
+ * Go Ecosystem integration improvements
+
+Interoperability while not a blocking feature in itself, requires Beam Schema support, which
+the SDK could then use as it's default coder. Batch Splittable DoFns are nearly ready for
+playing with on Flink, and the Python Direct Runner, answering the scalable batch IO question.
+There's much work getting the portability protos to a stable baseline. This will allow runner
+and SDK independance, so they don't need to be updated in lockstep. Finally, the Go SDK should
+adopt Go Modules as it's versioning solution, and officially "catch up" with the current beam
+version.
+
+The Go SDK has the following goals for the next few months:
## Usability
-The Go SDK should not block users from writing the pipelines they need to run.
-
-* Support large elements [BEAM-4124](https://issues.apache.org/jira/browse/BEAM-4124)
-* Coder Registry to support complex user elements [BEAM-3306](https://issues.apache.org/jira/browse/BEAM-3306)
-
-## Performance
-
-Since the Go SDK has no official runner support at this time, this gives us the chance to work on the performance
-of the SDK harness. When portable runners are ready, the Go SDK should be ready as well.
-
-* Reducing framework overhead on the SDK Harness side [BEAM-4726](https://issues.apache.org/jira/browse/BEAM-4726)
-* Tooling to enable and verify pipeline performance [BEAM-3612](https://issues.apache.org/jira/browse/BEAM-3612)
-* Measure the performance of the SDK at scale.
+* Beam Schema Support [BEAM-9615](https://issues.apache.org/jira/browse/BEAM-4124)
+* Improvements to starcgen [BEAM-9616](https://issues.apache.org/jira/browse/BEAM-9616)
## Integrating with the Go ecosystem
@@ -68,5 +74,5 @@ Otherwise, improving examples and documentation for devs and users alike is ongo
Contributions are welcome. Please contact the [dev list](mailto:dev@beam.apache.org?subject=%5BGo%20SDK%5D%20How%20can%20I%20help%3F)
for assistance in finding a place to help out.
- - JIRA: [sdk-go](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go) / [BEAM-2083](https://issues.apache.org/jira/browse/BEAM-2083)
+ - JIRA: [sdk-go](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go)
- Contact: Robert Burke (@lostluck) [Email](mailto:lostluck@apache.org?subject=%5BGo%20SDK%20Roadmap%5D) - Please also cc the dev@beam.apache.org list. I strongly prefer public discussion of Go SDK matters.