You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/03/27 19:03:49 UTC

[beam] branch asf-site updated: Publishing website 2020/03/27 19:03:41 at commit 2b3180e

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new e7eb80d  Publishing website 2020/03/27 19:03:41 at commit 2b3180e
e7eb80d is described below

commit e7eb80d29307c029cd91d1be95429bc6d58d65b5
Author: jenkins <bu...@apache.org>
AuthorDate: Fri Mar 27 19:03:41 2020 +0000

    Publishing website 2020/03/27 19:03:41 at commit 2b3180e
---
 .../generated-content/roadmap/go-sdk/index.html    | 35 ++++++++++++----------
 1 file changed, 20 insertions(+), 15 deletions(-)

diff --git a/website/generated-content/roadmap/go-sdk/index.html b/website/generated-content/roadmap/go-sdk/index.html
index 73a15f0..bc401db 100644
--- a/website/generated-content/roadmap/go-sdk/index.html
+++ b/website/generated-content/roadmap/go-sdk/index.html
@@ -228,7 +228,6 @@
 
 <ul class="nav">
   <li><a href="#usability">Usability</a></li>
-  <li><a href="#performance">Performance</a></li>
   <li><a href="#integrating-with-the-go-ecosystem">Integrating with the Go ecosystem</a></li>
   <li><a href="#implement-portability-features">Implement Portability features</a></li>
 </ul>
@@ -257,26 +256,32 @@ limitations under the License.
 by the status of the <a href="https://beam.apache.org/roadmap/portability/">Beam Portabillity Framework</a> and the existence of
 portable runners.</p>
 
-<p>With that in mind present work on the Go SDK has the following goals:</p>
-
-<h2 id="usability">Usability</h2>
-
-<p>The Go SDK should not block users from writing the pipelines they need to run.</p>
+<p><strong>April 2020 Update</strong>
+This year we hope to move the SDK out of experimental at least for Batch usage.</p>
 
+<p>To do so, there are a few blocking changes:</p>
 <ul>
-  <li>Support large elements <a href="https://issues.apache.org/jira/browse/BEAM-4124">BEAM-4124</a></li>
-  <li>Coder Registry to support complex user elements <a href="https://issues.apache.org/jira/browse/BEAM-3306">BEAM-3306</a></li>
+  <li>Support Interoperability with other SDKs</li>
+  <li>Scalable IOs</li>
+  <li>Portability Proto stability</li>
+  <li>Go Ecosystem integration improvements</li>
 </ul>
 
-<h2 id="performance">Performance</h2>
+<p>Interoperability while not a blocking feature in itself, requires Beam Schema support, which
+the SDK could then use as it’s default coder. Batch Splittable DoFns are nearly ready for
+playing with on Flink, and the Python Direct Runner, answering the scalable batch IO question.
+There’s much work getting the portability protos to a stable baseline. This will allow runner
+and SDK independance, so they don’t need to be updated in lockstep. Finally, the Go SDK should
+adopt Go Modules as it’s versioning solution, and officially “catch up” with the current beam
+version.</p>
 
-<p>Since the Go SDK has no official runner support at this time, this gives us the chance to work on the performance
-of the SDK harness. When portable runners are ready, the Go SDK should be ready as well.</p>
+<p>The Go SDK has the following goals for the next few months:</p>
+
+<h2 id="usability">Usability</h2>
 
 <ul>
-  <li>Reducing framework overhead on the SDK Harness side <a href="https://issues.apache.org/jira/browse/BEAM-4726">BEAM-4726</a></li>
-  <li>Tooling to enable and verify pipeline performance <a href="https://issues.apache.org/jira/browse/BEAM-3612">BEAM-3612</a></li>
-  <li>Measure the performance of the SDK at scale.</li>
+  <li>Beam Schema Support <a href="https://issues.apache.org/jira/browse/BEAM-4124">BEAM-9615</a></li>
+  <li>Improvements to starcgen <a href="https://issues.apache.org/jira/browse/BEAM-9616">BEAM-9616</a></li>
 </ul>
 
 <h2 id="integrating-with-the-go-ecosystem">Integrating with the Go ecosystem</h2>
@@ -316,7 +321,7 @@ Contributions are welcome. Please contact the <a href="mailto:dev@beam.apache.or
 for assistance in finding a place to help out.</p>
 
 <ul>
-  <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2083">BEAM-2083</a></li>
+  <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a></li>
   <li>Contact: Robert Burke (@lostluck) <a href="mailto:lostluck@apache.org?subject=%5BGo%20SDK%20Roadmap%5D">Email</a> - Please also cc the dev@beam.apache.org list. I strongly prefer public discussion of Go SDK matters.</li>
 </ul>