You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/05/15 04:56:04 UTC
[beam-site] branch asf-site updated (7a34444 -> 520d1ae)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from 7a34444 Merge #436: Add Community top-level section
add 67b9a07 Move Release Guide to committers section
add 333740a Move committer section to the bottom (we can find it :-)
add a4f2e5c Streamline the contribution section
add 4284b6a Google has scrapped research, now only AI
add 25a50fe Temporarily suppress validation of ai.google links
add d0d7c53 This closes #438
new 520d1ae Prepare repository for deployment.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Rakefile | 6 +-
.../05/27/where-is-my-pcollection-dot-map.html | 5 +-
content/contribute/become-a-committer/index.html | 34 +-
content/contribute/committer-guide/index.html | 34 +-
content/contribute/contribution-guide/index.html | 652 +--------------------
content/contribute/design-principles/index.html | 306 +---------
content/contribute/docker-images/index.html | 34 +-
content/contribute/eclipse/index.html | 68 +--
content/contribute/feature-branches/index.html | 309 +---------
content/contribute/index.html | 261 +++++++--
content/contribute/intellij/index.html | 34 +-
content/contribute/portability/index.html | 34 +-
.../contribute/ptransform-style-guide/index.html | 34 +-
content/contribute/release-guide/index.html | 34 +-
content/contribute/runner-guide/index.html | 34 +-
content/contribute/source-repository/index.html | 246 +-------
content/contribute/testing/index.html | 34 +-
.../contribute/website-contributions/index.html | 34 +-
content/contribute/work-in-progress/index.html | 280 +--------
content/contribution-guide/index.html | 8 +-
.../{contribute.html => contribute/index.html} | 0
content/source_repository/index.html | 10 -
src/_includes/section-menu/contribute.html | 34 +-
.../2016-05-20-where-is-my-pcollection-dot-map.md | 5 +-
src/contribute/contribution-guide.md | 387 ------------
src/contribute/design-principles.md | 53 --
src/contribute/eclipse.md | 18 +-
src/contribute/index.md | 187 +++++-
src/contribute/source-repository.md | 29 -
src/contribute/work-in-progress.md | 33 --
30 files changed, 563 insertions(+), 2674 deletions(-)
rename content/docs/{contribute.html => contribute/index.html} (100%)
delete mode 100644 content/source_repository/index.html
delete mode 100644 src/contribute/contribution-guide.md
delete mode 100644 src/contribute/design-principles.md
delete mode 100644 src/contribute/source-repository.md
delete mode 100644 src/contribute/work-in-progress.md
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 01/01: Prepare repository for deployment.
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 520d1aec5ea4a0ff40a381296c4e247fc52b27bf
Author: Mergebot <me...@apache.org>
AuthorDate: Mon May 14 21:56:01 2018 -0700
Prepare repository for deployment.
---
.../05/27/where-is-my-pcollection-dot-map.html | 5 +-
content/contribute/become-a-committer/index.html | 34 +-
content/contribute/committer-guide/index.html | 34 +-
content/contribute/contribution-guide/index.html | 652 +--------------------
content/contribute/design-principles/index.html | 306 +---------
content/contribute/docker-images/index.html | 34 +-
content/contribute/eclipse/index.html | 68 +--
content/contribute/feature-branches/index.html | 309 +---------
content/contribute/index.html | 261 +++++++--
content/contribute/intellij/index.html | 34 +-
content/contribute/portability/index.html | 34 +-
.../contribute/ptransform-style-guide/index.html | 34 +-
content/contribute/release-guide/index.html | 34 +-
content/contribute/runner-guide/index.html | 34 +-
content/contribute/source-repository/index.html | 246 +-------
content/contribute/testing/index.html | 34 +-
.../contribute/website-contributions/index.html | 34 +-
content/contribute/work-in-progress/index.html | 280 +--------
content/contribution-guide/index.html | 8 +-
.../{contribute.html => contribute/index.html} | 0
content/source_repository/index.html | 10 -
21 files changed, 368 insertions(+), 2117 deletions(-)
diff --git a/content/blog/2016/05/27/where-is-my-pcollection-dot-map.html b/content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
index fd8fcd7..d896c58 100644
--- a/content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
+++ b/content/blog/2016/05/27/where-is-my-pcollection-dot-map.html
@@ -98,7 +98,10 @@
<!--more-->
-<p>Though Beam is relatively new, its design draws heavily on many years of experience with real-world pipelines. One of the primary inspirations is <a href="http://research.google.com/pubs/pub35650.html">FlumeJava</a>, which is Google’s internal successor to MapReduce first introduced in 2009.</p>
+<p>Though Beam is relatively new, its design draws heavily on many years of
+experience with real-world pipelines. One of the primary inspirations is
+<a href="https://ai.google/research/pubs/pub35650">FlumeJava</a>, which is Google’s
+internal successor to MapReduce first introduced in 2009.</p>
<p>The original FlumeJava API has methods like <code class="highlighter-rouge">count</code> and <code class="highlighter-rouge">parallelDo</code> on the PCollections. Though slightly more succinct, this approach has many disadvantages to extensibility. Every new user to FlumeJava wanted to add transforms, and adding them as methods to PCollection simply doesn’t scale well. In contrast, a PCollection in Beam has a single <code class="highlighter-rouge">apply</code> method which takes any [...]
diff --git a/content/contribute/become-a-committer/index.html b/content/contribute/become-a-committer/index.html
index 45408f9..e0cfe9c 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/committer-guide/index.html b/content/contribute/committer-guide/index.html
index b5ab0eb..699d7e6 100644
--- a/content/contribute/committer-guide/index.html
+++ b/content/contribute/committer-guide/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/contribution-guide/index.html b/content/contribute/contribution-guide/index.html
index 6d702e0..c0fa7ea 100644
--- a/content/contribute/contribution-guide/index.html
+++ b/content/contribute/contribution-guide/index.html
@@ -1,646 +1,10 @@
<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Beam Contribution Guide</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/contribution-guide/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">SDKS</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/intellij/">IntelliJ Tips</a></li>
- <li><a href="/contribute/eclipse/">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Other Guides</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical References</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- </ul>
-</li>
-
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
-
-
-<ul class="nav">
- <li><a href="#review-then-commit-workflow">Review-then-commit workflow</a></li>
- <li><a href="#engage">Engage</a>
- <ul>
- <li><a href="#mailing-lists">Mailing list(s)</a></li>
- <li><a href="#jira-issue-tracker">JIRA issue tracker</a></li>
- <li><a href="#online-discussions">Online discussions</a></li>
- </ul>
- </li>
- <li><a href="#design">Design</a></li>
- <li><a href="#code">Code</a>
- <ul>
- <li><a href="#one-time-setup">One-time Setup</a></li>
- <li><a href="#create-a-branch-in-your-fork">Create a branch in your fork</a></li>
- <li><a href="#syncing-and-pushing-your-branch">Syncing and pushing your branch</a></li>
- <li><a href="#testing">Testing</a></li>
- </ul>
- </li>
- <li><a href="#review">Review</a>
- <ul>
- <li><a href="#create-a-pull-request">Create a pull request</a></li>
- <li><a href="#code-review-and-revision">Code Review and Revision</a></li>
- <li><a href="#lgtm">LGTM</a></li>
- <li><a href="#deleting-your-branch">Deleting your branch</a></li>
- <li><a href="#stale-pull-requests">Stale pull requests</a></li>
- </ul>
- </li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <h1 id="apache-beam-contribution-guide">Apache Beam Contribution Guide</h1>
-
-<p>The Apache Beam community welcomes contributions from anyone!</p>
-
-<p>There are lots of opportunities:</p>
-
-<ul>
- <li>write new examples</li>
- <li>improve the documentation</li>
- <li>add new user-facing libraries (new statistical libraries, new IO connectors,
-etc)</li>
- <li>improve your favorite language SDK (Java, Python, Go, etc)</li>
- <li>improve specific runners (Apache Apex, Apache Flink, Apache Spark, Google
-Cloud Dataflow, etc)</li>
- <li>work on the core programming model (what is a Beam pipeline and how does it
-run?)</li>
-</ul>
-
-<p>Most importantly, if you have an idea of how to contribute, then do it!</p>
-
-<p>For a list of open starter tasks, check
-<a href="https://s.apache.org/beam-starter-tasks">https://s.apache.org/beam-starter-tasks</a>.</p>
-
-<p>What follows is a more comprehensive document covering details of things that
-may come up.</p>
-
-<h2 id="review-then-commit-workflow">Review-then-commit workflow</h2>
-
-<p>We use a review-then-commit workflow in Beam.</p>
-
-<p><img src="/images/contribution-guide-1.png" alt="The Beam contribution workflow has 5 steps: engage, design, code, review, and commit." /></p>
-
-<p><strong>For larger contributions or those that affect multiple components:</strong></p>
-
-<ol>
- <li><strong>Engage</strong>: We encourage you to work with the Beam community on the <a href="https://issues.apache.org/jira/browse/BEAM">Apache
-JIRA issue tracker</a> and
-<a href="/get-started/support/">developer’s mailing list</a> to identify
-good areas for contribution.</li>
- <li><strong>Design:</strong> More complicated contributions will likely benefit from some
-early discussion in order to scope and design them well.</li>
-</ol>
-
-<p><strong>For all contributions:</strong></p>
-
-<ol>
- <li><strong>Code:</strong> The best part ;-)</li>
- <li><strong>Review:</strong> Submit a pull request with your contribution to our <a href="https://github.com/apache/beam/">GitHub
-mirror</a>. Work with a committer to review
-and iterate on the code, if needed.</li>
- <li><strong>Commit:</strong> A Beam committer merges the pull request into our <a href="https://gitbox.apache.org/repos/asf/beam.git">Apache
-repository</a>.</li>
-</ol>
-
-<p>We look forward to working with you!</p>
-
-<h2 id="engage">Engage</h2>
-
-<h3 id="mailing-lists">Mailing list(s)</h3>
-
-<p>We discuss design and implementation issues on the <code class="highlighter-rouge">dev@beam.apache.org</code>
-mailing list, which is archived
-<a href="https://lists.apache.org/list.html?dev@beam.apache.org">here</a>. Join by
-emailing
-<a href="mailto:dev-subscribe@beam.apache.org"><code class="highlighter-rouge">dev-subscribe@beam.apache.org</code></a>.
-Anyone is welcome to join, and we’d love to hear what you’re interested in.</p>
-
-<p>If interested, you can also join the other <a href="/get-started/support/">mailing lists</a>.</p>
-
-<h3 id="jira-issue-tracker">JIRA issue tracker</h3>
-
-<p>We use the Apache Software Foundation’s
-<a href="https://issues.apache.org/jira/browse/BEAM">JIRA</a> as an issue tracking and
-project management tool.</p>
-
-<p>If you do not already have an Apache JIRA account, sign up
-<a href="https://issues.apache.org/jira/">here</a>.</p>
-
-<p>If a quick
-<a href="https://issues.apache.org/jira/issues/?jql=project%3DBEAM%20AND%20text%20~%20%22the%20thing%20I%20want%20to%20contribute%22">search</a>
-doesn’t turn up an existing JIRA issue for the work you want to contribute,
-feel free to create one.</p>
-
-<p>If there’s an existing JIRA issue for your intended contribution, please
-comment about your intended work. A committer can
-assign the issue to you. (If you don’t have a JIRA role yet, you’ll be added to
-the “contributor” role.) If an issue is currently assigned, it is generally
-good practice to at least reach out the current assignee before reassigning.</p>
-
-<p>For moderate or large contributions, we recommend engaging on the developer
-mailing list before investing significant effort to gather feedback,
-avoid frustration, and prevent duplicated work.
-Simple changes, like fixing typos, do not nead JIRA entries
-and are welcome via direct pull requests.</p>
-
-<h3 id="online-discussions">Online discussions</h3>
-
-<p>We don’t have an official IRC channel. Most of the online discussions happen in
-the <a href="https://apachebeam.slack.com/">Apache Beam Slack channel</a>. If you want
-access, you need to send an email to the user mailing list to <a href="mailto:user@beam.apache.org?subject=Regarding Beam Slack
-Channel&body=Hello%0D%0A%0ACan someone please add me to the Beam slack
-channel?%0D%0A%0AThanks.">request
-access</a>.</p>
-
-<p>Chat rooms are great for quick questions or discussions on specialized topics.
-Remember that we strongly encourage communication via the mailing lists, and we
-prefer to discuss more complex subjects by email. Developers should be careful
-to move or duplicate all the official or useful discussions to the issue
-tracking system and/or the dev mailing list.</p>
-
-<h2 id="design">Design</h2>
-
-<p>To avoid potential frustration during the code review cycle, we encourage you
-to clearly scope and design non-trivial contributions with the Beam community
-before you start coding.</p>
-
-<p>Generally, the developer mailing list is the best place to get help,
-solicit feedback, and communicate design docs.
-It’s great to explicitly include relevant stakeholders
-early in the conversation. JIRA is useful for keeping track of the current
-state of implementation and automatically gets updated for actions on pull
-requests that start with <code class="highlighter-rouge">[BEAM-JIRA_ID]</code>.</p>
-
-<p>We suggest using <a href="https://docs.google.com/">Google Docs</a> for sharing designs
-that may benefit from diagrams or comments. Please remember to make the
-document world-commentable and add a link to it from the relevant JIRA issue.
-You may want to start from this
-<a href="https://docs.google.com/document/d/1qYQPGtabN5-E4MjHsecqqC7PXvJtXvZukPfLXQ8rHJs/edit?usp=sharing">template</a>.</p>
-
-<h2 id="code">Code</h2>
-
-<p>To contribute code to Apache Beam, you’ll have to do a few administrative steps
-once, and then follow a few guidelines for each contribution.</p>
-
-<p>When developing a new <code class="highlighter-rouge">PTransform</code>, consult the <a href="/contribute/ptransform-style-guide">PTransform Style Guide</a>.</p>
-
-<h3 id="one-time-setup">One-time Setup</h3>
-
-<h4 id="potentially-submit-contributor-license-agreement">[Potentially] Submit Contributor License Agreement</h4>
-
-<p>Apache Software Foundation (ASF) desires that all contributors of ideas, code,
-or documentation to the Apache projects complete, sign, and submit an
-<a href="https://www.apache.org/licenses/icla.pdf">Individual Contributor License
-Agreement</a> (ICLA). The purpose of
-this agreement is to clearly define the terms under which intellectual property
-has been contributed to the ASF and thereby allow us to defend the project
-should there be a legal dispute regarding the software at some future time.</p>
-
-<p>We require you to have an ICLA on file with the Apache Secretary for larger
-contributions only. For smaller ones, however, we rely on <a href="http://www.apache.org/licenses/LICENSE-2.0#contributions">clause
-five</a> of the Apache
-License, Version 2.0, describing licensing of intentionally submitted
-contributions and do not require an ICLA in that case.</p>
-
-<h4 id="obtain-a-github-account">Obtain a GitHub account</h4>
-
-<p>We use GitHub’s pull request functionality to review proposed code changes.</p>
-
-<p>If you do not already have a personal GitHub account, sign up
-<a href="https://github.com/join">here</a>.</p>
-
-<h4 id="fork-the-repository-on-github">Fork the repository on GitHub</h4>
-
-<p>Go to the <a href="https://github.com/apache/beam/">Beam GitHub repository</a> and fork the
-it to your own private account. This will be your private workspace for
-staging changes.</p>
-
-<h4 id="clone-the-repository-locally">Clone the repository locally</h4>
-
-<p>You are now ready to create the development environment on your local machine.
-Feel free to repeat these steps on all machines that you want to use for
-development.</p>
-
-<p>We assume you are using SSH-based authentication with GitHub. If necessary,
-exchange SSH keys with GitHub by following <a href="https://help.github.com/articles/generating-an-ssh-key/">their
-instructions</a>.</p>
-
-<p>Clone Beam’s GitHub repository.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git clone https://github.com/apache/beam.git
-$ cd beam
-</code></pre>
-</div>
-
-<p>Add your forked repository as an additional Git remote, where you’ll push your
-changes.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git remote add <GitHub_user> git@github.com:<GitHub_user>/beam.git
-</code></pre>
-</div>
-
-<p>You are now ready to start developing!</p>
-
-<h4 id="python-sdk-only-set-up-a-virtual-environment">[Python SDK Only] Set up a virtual environment</h4>
-
-<p>We recommend setting up a virtual environment for developing Python SDK. Please
-see instructions available in <a href="/get-started/quickstart-py/">Quickstart (Python)</a> for setting up a virtual environment.</p>
-
-<h4 id="optional-ide-setup">[Optional] IDE Setup</h4>
-
-<p>Depending on your preferred development environment, you may need to prepare it
-to develop Beam code. We have some collected tips for <a href="/contribute/intellij">IntelliJ</a>
-and <a href="/contribute/eclipse">Eclipse</a>.</p>
-
-<h3 id="create-a-branch-in-your-fork">Create a branch in your fork</h3>
-
-<p>You’ll work on your contribution in a branch in your own (forked) repository.
-Create a local branch, initialized with the state of the branch you expect your
-changes to be merged into. Keep in mind that we use several branches, including
-<code class="highlighter-rouge">master</code>, feature-specific, and release-specific branches. If you are unsure,
-initialize with the state of the <code class="highlighter-rouge">master</code> branch.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git fetch --all
-$ git checkout -b <my-branch> origin/master
-</code></pre>
-</div>
-
-<p>At this point, you can start making and committing changes to this branch in a
-standard way.</p>
-
-<h3 id="syncing-and-pushing-your-branch">Syncing and pushing your branch</h3>
-
-<p>Periodically while you work, and certainly before submitting a pull request,
-you should update your branch with the most recent changes to the target
-branch.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git pull --rebase
-</code></pre>
-</div>
-
-<p>Remember to always use <code class="highlighter-rouge">--rebase</code> parameter to avoid extraneous merge commits.</p>
-
-<p>Then you can push your local, committed changes to your (forked) repository on
-GitHub. Since rebase may change that branch’s history, you may need to force
-push. You’ll run:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git push <GitHub_user> <my-branch> --force
-</code></pre>
-</div>
-
-<h3 id="testing">Testing</h3>
-
-<p>All code should have appropriate unit testing coverage. New code should have
-new tests in the same contribution. Bug fixes should include a regression test
-to prevent the issue from reoccurring.</p>
-
-<p>The entire set of tests can be run with this command at the root of the git
-repository.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ ./gradlew check --rerun-tasks
-</code></pre>
-</div>
-
-<p>You can also limit tests to certain language SDKs.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ ./gradlew beam-sdks-java-core:check --rerun-tasks
-$ ./gradlew beam-sdks-python:check --rerun-tasks
-$ ./gradlew beam-sdks-go:check --rerun-tasks
-</code></pre>
-</div>
-
-<h4 id="python-sdk">Python SDK</h4>
-
-<p>For contributions to the Python code, you can use the commands below to run unit
-tests locally. The above Gradle commands should also work, but these commands
-may run faster for you.</p>
-
-<p>If you update any of the <a href="http://cython.org">cythonized</a>
-files in Python SDK, you must install the <code class="highlighter-rouge">cython</code> package before running following
-command to properly test your code. We recommend setting up a virtual
-environment before testing your code.</p>
-
-<p>The following commands should be run in the <code class="highlighter-rouge">sdks/python</code> directory.
-This command runs all Python tests.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py nosetests
-</code></pre>
-</div>
-
-<p>You can use following command to run a single test method.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py nosetests --tests <module>:<test class>.<test method>
-
-Example:
-$ python setup.py nosetests --tests apache_beam.io.textio_test:TextSourceTest.test_progress
-</code></pre>
-</div>
-
-<p>To check just for lint errors, run the following command.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ ../../gradlew lint
-</code></pre>
-</div>
-
-<h5 id="remote-testing">Remote testing</h5>
-
-<p>This step is only required for testing SDK code changes remotely (not using
-directrunner). In order to do this you must build the Beam tarball. From the
-root of the git repository, run:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ cd sdks/python/
-$ python setup.py sdist
-</code></pre>
-</div>
-
-<p>Pass the <code class="highlighter-rouge">--sdk_location</code> flag to use the newly built version. For example:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py sdist > /dev/null && \
- python -m apache_beam.examples.wordcount ... \
- --sdk_location dist/apache-beam-2.5.0.dev0.tar.gz
-</code></pre>
-</div>
-
-<h2 id="review">Review</h2>
-
-<p>Once the initial code is complete and the tests pass, it’s time to start the
-code review process. All code is peer reviewed, no matter who authors it.
-It’s a great way to build community, since you can learn from other developers,
-and they become familiar with your contribution. It also builds a strong
-project by encouraging a high quality bar and keeping code consistent
-throughout the project.</p>
-
-<h3 id="create-a-pull-request">Create a pull request</h3>
-
-<p>Organize your commits to make a committer’s job easier when reviewing.
-Committers normally prefer multiple small pull requests, instead of a single
-large pull request. Within a pull request, a relatively small number of commits
-that break the problem into logical steps is preferred. For most pull requests,
-you’ll squash your changes down to 1 commit. You can use the following command
-to re-order, squash, edit, or change description of individual commits.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git rebase -i origin/master
-</code></pre>
-</div>
-
-<p>You’ll then push to your branch on GitHub. Note: when updating your commit
-after pull request feedback and use squash to get back to one commit, you will
-need to do a force submit to the branch on your repo.</p>
-
-<p>Navigate to the <a href="https://github.com/apache/beam">Beam GitHub mirror</a> to create
-a pull request. The title of the pull request should be strictly in the
-following format:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>[BEAM-<JIRA-issue-#>] <Title of the pull request>
-</code></pre>
-</div>
-
-<p>Please include a descriptive pull request message to help make the committer’s
-job easier when reviewing. It’s fine to refer to existing design docs or the
-contents of the associated JIRA as appropriate.</p>
-
-<p>If you know a good committer to review your pull request, please make a comment
-like the following. If not, don’t worry – a committer will pick it up.</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>Hi @<GitHub-committer-username>, can you please take a look?
-</code></pre>
-</div>
-
-<p>When choosing a committer to review, think about who is the expert on the
-relevant code, who the stakeholders are for this change, and who else would
-benefit from becoming familiar with the code. If you’d appreciate comments from
-additional folks but already have a main committer, you can explicitly cc them
-using <code class="highlighter-rouge">@<GitHub-committer-username></code>.</p>
-
-<h3 id="code-review-and-revision">Code Review and Revision</h3>
-
-<p>During the code review process, be careful about whether and when to rebase
-your branch or otherwise modify published commits, since this can remove
-existing comment history and be confusing to the committer when reviewing. When
-you make a revision, always push it in a new commit.</p>
-
-<p>Our GitHub mirror automatically provides pre-commit testing coverage using
-Jenkins. Please make sure those tests pass; the contribution cannot be merged
-otherwise.</p>
-
-<h3 id="lgtm">LGTM</h3>
-
-<p>Once the committer is happy with the change, they’ll respond with an LGTM
-(“<em>looks good to me!</em>”). At this point, the committer may ask you to tidy
-up the commit history before they merge your changes into the codebase.
-This makes it easy for community to look through the history and understand how
-something came about, look for a candidate commit to roll back, etc.</p>
-
-<p>In the case the author is also a committer, either can merge the pull request.
-Just be sure to communicate clearly whose responsibility it is in this
-particular case.</p>
-
-<p>Thank you for your contribution to Beam!</p>
-
-<h3 id="deleting-your-branch">Deleting your branch</h3>
-
-<p>Once the pull request is merged into the Beam repository, you can safely delete
-the branch locally and purge it from your forked repository.</p>
-
-<p>From another local branch, run:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git fetch --all
-$ git branch -d <my-branch>
-$ git push <GitHub_user> --delete <my-branch>
-</code></pre>
-</div>
-
-<h3 id="stale-pull-requests">Stale pull requests</h3>
-
-<p>The community will close stale pull requests in order to keep the project
-healthy. A pull request becomes stale after its author fails to respond to
-actionable comments for 60 days. Author of a closed pull request is welcome to
-reopen the same pull request again in the future. The associated JIRAs will be
-unassigned from the author but will stay open.</p>
-
- </div>
- </div>
- <footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/contribute/design-principles/index.html b/content/contribute/design-principles/index.html
index 159563d..c0fa7ea 100644
--- a/content/contribute/design-principles/index.html
+++ b/content/contribute/design-principles/index.html
@@ -1,300 +1,10 @@
<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Design Principles in Beam</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/design-principles/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">SDKS</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/intellij/">IntelliJ Tips</a></li>
- <li><a href="/contribute/eclipse/">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Other Guides</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical References</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- </ul>
-</li>
-
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
-
-
-<ul class="nav">
- <li><a href="#use-cases">Use cases</a>
- <ul>
- <li><a href="#unify-the-model">Unify the model</a></li>
- <li><a href="#separate-data-shapes-and-runtime-requirements">Separate data shapes and runtime requirements</a></li>
- <li><a href="#make-efficient-things-easy-rather-than-make-easy-things-efficient">Make efficient things easy, rather than make easy things efficient</a></li>
- </ul>
- </li>
- <li><a href="#usability">Usability</a>
- <ul>
- <li><a href="#validate-early">Validate Early</a></li>
- <li><a href="#public-apis-like-diamonds-are-forever-at-least-until-the-next-major-version">Public APIs, like diamonds, are forever (at least until the next major version)</a></li>
- <li><a href="#examples-should-be-pedagogical">Examples should be pedagogical</a></li>
- </ul>
- </li>
- <li><a href="#extensibility">Extensibility</a>
- <ul>
- <li><a href="#use-ptransforms-for-modularity">Use PTransforms for modularity</a></li>
- <li><a href="#keep-beam-sdks-consistent">Keep Beam SDKs consistent</a></li>
- <li><a href="#when-in-rome-python-do-as-the-romans-pythonians-do">When in <del>Rome</del> Python, do as the <del>Romans</del> Pythonians do</a></li>
- <li><a href="#encourage-dsls">Encourage DSLs</a></li>
- <li><a href="#design-for-the-model-not-specific-runners">Design for the model, not specific runners</a></li>
- </ul>
- </li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <h1 id="design-principles-in-the-apache-beam-project">Design Principles in the Apache Beam Project</h1>
-
-<p>Joshua Bloch’s <a href="https://www.infoq.com/articles/API-Design-Joshua-Bloch">API Design Bumper Stickers</a> are a great list of what makes for good API design. In addition, we have specific design principles we follow in Beam.</p>
-
-<ul id="markdown-toc">
- <li><a href="#use-cases" id="markdown-toc-use-cases">Use cases</a> <ul>
- <li><a href="#unify-the-model" id="markdown-toc-unify-the-model">Unify the model</a></li>
- <li><a href="#separate-data-shapes-and-runtime-requirements" id="markdown-toc-separate-data-shapes-and-runtime-requirements">Separate data shapes and runtime requirements</a></li>
- <li><a href="#make-efficient-things-easy-rather-than-make-easy-things-efficient" id="markdown-toc-make-efficient-things-easy-rather-than-make-easy-things-efficient">Make efficient things easy, rather than make easy things efficient</a></li>
- </ul>
- </li>
- <li><a href="#usability" id="markdown-toc-usability">Usability</a> <ul>
- <li><a href="#validate-early" id="markdown-toc-validate-early">Validate Early</a></li>
- <li><a href="#public-apis-like-diamonds-are-forever-at-least-until-the-next-major-version" id="markdown-toc-public-apis-like-diamonds-are-forever-at-least-until-the-next-major-version">Public APIs, like diamonds, are forever (at least until the next major version)</a></li>
- <li><a href="#examples-should-be-pedagogical" id="markdown-toc-examples-should-be-pedagogical">Examples should be pedagogical</a></li>
- </ul>
- </li>
- <li><a href="#extensibility" id="markdown-toc-extensibility">Extensibility</a> <ul>
- <li><a href="#use-ptransforms-for-modularity" id="markdown-toc-use-ptransforms-for-modularity">Use PTransforms for modularity</a></li>
- <li><a href="#keep-beam-sdks-consistent" id="markdown-toc-keep-beam-sdks-consistent">Keep Beam SDKs consistent</a></li>
- <li><a href="#when-in-rome-python-do-as-the-romans-pythonians-do" id="markdown-toc-when-in-rome-python-do-as-the-romans-pythonians-do">When in <del>Rome</del> Python, do as the <del>Romans</del> Pythonians do</a></li>
- <li><a href="#encourage-dsls" id="markdown-toc-encourage-dsls">Encourage DSLs</a></li>
- <li><a href="#design-for-the-model-not-specific-runners" id="markdown-toc-design-for-the-model-not-specific-runners">Design for the model, not specific runners</a></li>
- </ul>
- </li>
-</ul>
-
-<h2 id="use-cases">Use cases</h2>
-
-<h3 id="unify-the-model">Unify the model</h3>
-<p>Provide one model that works over both bounded (aka. batch) and unbounded (aka. streaming) datasets. Pay special attention to windows / triggers / state / timers, which often trip up folks used to a batch world. Provide users with the right abstractions to adjust latency and completeness guarantees to cover both traditional batch and streaming use cases.</p>
-
-<h3 id="separate-data-shapes-and-runtime-requirements">Separate data shapes and runtime requirements</h3>
-<p>The model should focus on letting users describe their data and processing, without exposing any details of a specific runtime system. For example, bounded and unbounded describe the shape of data, but batch and streaming describe the behavior of specific runtime systems. Good test cases are to imagine a mythical micro-batching runner that sits somewhere between batch and streaming or a engine that dynamically switches between streaming and batch depending on the backlog.</p>
-
-<h3 id="make-efficient-things-easy-rather-than-make-easy-things-efficient">Make efficient things easy, rather than make easy things efficient</h3>
-<p>Don’t prevent efficiency for ease of use. Design APIs that provide the information necessary for efficiently executing at scale. Provide class hierarchies and wrappers to make the common cases simpler.</p>
-
-<h2 id="usability">Usability</h2>
-
-<h3 id="validate-early">Validate Early</h3>
-<p>Validate constraints on graph shape, runner requirements, etc as early in the compile time - construction time - submission time - execution time spectrum as reasonably possible in order to provide a smoother user experience.</p>
-
-<h3 id="public-apis-like-diamonds-are-forever-at-least-until-the-next-major-version">Public APIs, like diamonds, are forever (at least until the next major version)</h3>
-<p>Backwards incompatible changes can only be made in the next major version. Because of the burden major versions place on users (code has to be modified, conflicting dependency nightmares, etc), we aim to do this infrequently. Clearly mark APIs that are considered experimental (may change at any point) and deprecated (will be removed in the next major version). Consider what APIs are more amenable to future changes (abstract classes vs. interfaces, etc.)</p>
-
-<h3 id="examples-should-be-pedagogical">Examples should be pedagogical</h3>
-<p>Canonical examples help people ingrain the principles. Design examples that teach complex concepts in modular chunks. If you can’t explain the concept easily, then the API isn’t right. Examples should withstand random copy-pasting.</p>
-
-<h2 id="extensibility">Extensibility</h2>
-
-<h3 id="use-ptransforms-for-modularity">Use PTransforms for modularity</h3>
-<p>Composite transformations (transformations formed by a subgraph of other transformations) are treated as first class objects. They can be named and applied directly in any pipeline to nicely encapsulate concepts. This removes the artificial separation between those built into PCollection and those provided by users. In addition, PTransforms can be used as a clear concept in graphical monitoring and provide a way to scope metadata like aggregators, logging, and resources. Use these whe [...]
-
-<h3 id="keep-beam-sdks-consistent">Keep Beam SDKs consistent</h3>
-<p>Beam SDKs should expose the complete set of concepts in the programming model. They should all use the same set of abstractions and be able to share conceptual documentation.</p>
-
-<h3 id="when-in-rome-python-do-as-the-romans-pythonians-do">When in <del>Rome</del> Python, do as the <del>Romans</del> Pythonians do</h3>
-<p>Each SDK must feel right to those who live and breath that language. Adapt the general Beam concepts into language-dependent styles when the benefits clearly outweigh the drawbacks.</p>
-
-<h3 id="encourage-dsls">Encourage DSLs</h3>
-<p>Many use cases or user communities can be served by provided ‘wrapper’ SDKs that provide a simpler or domain-specific set of abstractions that then build on a Beam SDK and take advantage of Beam Runners.</p>
-
-<h3 id="design-for-the-model-not-specific-runners">Design for the model, not specific runners</h3>
-
-<p>The Beam APIs should serve all runners. Behind every runner-specific hook, there is a general principle in the model. Design APIs that generalize across multiple runners.</p>
-
- </div>
- </div>
- <footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/contribute/docker-images/index.html b/content/contribute/docker-images/index.html
index 5f57e5a..6287cfc 100644
--- a/content/contribute/docker-images/index.html
+++ b/content/contribute/docker-images/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/eclipse/index.html b/content/contribute/eclipse/index.html
index 59be565..a11530c 100644
--- a/content/contribute/eclipse/index.html
+++ b/content/contribute/eclipse/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
@@ -186,35 +168,23 @@ from the commandline by building a sample package:</p>
</code></pre>
</div>
-<p>If you receive any errors, first verify your environment setup based on the
-<a href="/contribute/contribution-guide#one-time-setup">Contribution guide</a>.</p>
+<p>If you receive any errors, first verify your environment setup:</p>
<ol>
- <li>
- <p>If running on Mac or Linux, launch Eclipse from a terminal. This is necessary
+ <li>If running on Mac or Linux, launch Eclipse from a terminal. This is necessary
to ensure that Eclipse has proper environment setup from user profile
-scripts, i.e. .bashrc.</p>
- </li>
- <li>
- <p>Install <a href="https://marketplace.eclipse.org/content/buildship-gradle-integration">Buildship Gradle
+scripts, i.e. .bashrc.</li>
+ <li>Install <a href="https://marketplace.eclipse.org/content/buildship-gradle-integration">Buildship Gradle
Integration</a>.
-This will allow importing and interacting with the Gradle build.</p>
- </li>
- <li>
- <p>Open the project import wizard in Eclipse via “File” > “Import”.</p>
- </li>
- <li>
- <p>From the “Import” screen, select “Gradle” > “Existing Gradle Project”, and click
-Next.</p>
- </li>
- <li>
- <p>From the “Import Gradle Project” screen, fill in the Project root directory
-with your local git path, and click Finish.</p>
- </li>
+This will allow importing and interacting with the Gradle build.</li>
+ <li>Open the project import wizard in Eclipse via “File” > “Import”.</li>
+ <li>From the “Import” screen, select “Gradle” > “Existing Gradle Project”, and click
+Next.</li>
+ <li>From the “Import Gradle Project” screen, fill in the Project root directory
+with your local git path, and click Finish.</li>
</ol>
-<p>Eclipse will scan the project tree and import each as a separate
-Package.</p>
+<p>Eclipse will scan the project tree and import each as a separate Package.</p>
<p>Verify that your workspace is correctly configured by invoking
‘beam-runners-direct-java:build’ from the “Gradle Tasks” pane. The build should
diff --git a/content/contribute/feature-branches/index.html b/content/contribute/feature-branches/index.html
index 0831e34..c0fa7ea 100644
--- a/content/contribute/feature-branches/index.html
+++ b/content/contribute/feature-branches/index.html
@@ -1,303 +1,10 @@
<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Beam Feature Branches</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/feature-branches/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">SDKS</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/intellij/">IntelliJ Tips</a></li>
- <li><a href="/contribute/eclipse/">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Other Guides</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical References</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- </ul>
-</li>
-
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
-
-
-<ul class="nav">
- <li><a href="#establishing-a-feature-branch">Establishing a feature branch</a></li>
- <li><a href="#developing-on-a-feature-branch">Developing on a feature branch</a></li>
- <li><a href="#merging-into-master">Merging into <code class="highlighter-rouge">master</code></a>
- <ul>
- <li><a href="#merging-a-new-runner-into-master">Merging a new runner into <code class="highlighter-rouge">master</code></a></li>
- <li><a href="#merging-a-new-sdk-into-master">Merging a new SDK into <code class="highlighter-rouge">master</code></a></li>
- </ul>
- </li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <h1 id="feature-branches">Feature Branches</h1>
-
-<p>Some larger features are developed on a feature branch before being merged into
-<code class="highlighter-rouge">master</code>. In particular, this is often used for initial development of new
-components like SDKs or runners.</p>
-
-<p>We expect the work on a feature branch to be <em>incomplete</em>, but it must not
-be lower quality. Code reviews for feature branches must have the same
-standards as code reviews for <code class="highlighter-rouge">master</code>. Once a feature branch is ready for
-merge to <code class="highlighter-rouge">master</code>, the set of changes will be too large to review in its
-entirety. Because of this, the code reviews during development must be
-thorough and trustworthy.</p>
-
-<h2 id="establishing-a-feature-branch">Establishing a feature branch</h2>
-
-<p>If your project is large enough to need a feature branch, there should
-be a discussion on the mailing list. The first step is to <a href="/contribute/contribution-guide/#engage">engage</a> there to raise awareness
-that you want to start a large project. Almost any project should be accepted
-– there is no real cost to letting a feature branch exist – but you may find
-other interested contributors or gain other advice from the community.</p>
-
-<p>After the community discussion, a committer must create your feature branch.
-Any committer can do create the branch through the GitHub UIs or by pushing
-directly to GitHub or ASF’s gitbox.</p>
-
-<h2 id="developing-on-a-feature-branch">Developing on a feature branch</h2>
-
-<p>To contribute code on a feature branch, use the same process as in the
-<a href="/contribute/contribution-guide/">Contribution Guide</a>, but
-replace <code class="highlighter-rouge">master</code> with the name of the feature branch.</p>
-
-<p>Since feature branches are often used for new components, you may find that
-there is no committer familiar with all the details of the new language or
-runner. In that case, consider asking someone else familiar with the technology
-to do an initial review before looping in a committer for a final review and
-merge.</p>
-
-<p>If you are working on a feature branch, you’ll also want to frequently merge in
-changes from <code class="highlighter-rouge">master</code>. This prevents the feature branch from
-deviating too far from the current state of <code class="highlighter-rouge">master</code>. Like all changes, this
-should be done via pull request. A committer may self-merge such a pull request
-if there are no conflicts or test failures. If there are any conflicts or tests
-that need fixing, then those should get a full review from another committer.</p>
-
-<h2 id="merging-into-master">Merging into <code class="highlighter-rouge">master</code></h2>
-
-<p>To merge a feature branch into <code class="highlighter-rouge">master</code>, new components and major features
-should meet the following guidelines.</p>
-
-<ol>
- <li>Have at least 2 contributors interested in maintaining it, and 1 committer
-interested in supporting it</li>
- <li>Provide both end-user and developer-facing documentation</li>
- <li>Have at least a basic level of unit test coverage</li>
- <li>Run all existing applicable integration tests with other Beam components and
-create additional tests as appropriate</li>
-</ol>
-
-<h3 id="merging-a-new-runner-into-master">Merging a new runner into <code class="highlighter-rouge">master</code></h3>
-
-<p>A new runner should:</p>
-
-<ol>
- <li>Be able to handle a subset of the model that addresses a significant set of
-use cases, such as ‘traditional batch’ or ‘processing time streaming’.</li>
- <li>Update the capability matrix with the current status</li>
- <li>Add a webpage under <code class="highlighter-rouge">documentation/runners</code></li>
-</ol>
-
-<h3 id="merging-a-new-sdk-into-master">Merging a new SDK into <code class="highlighter-rouge">master</code></h3>
-
-<p>A new SDK should:</p>
-
-<ol>
- <li>Provide the ability to construct graphs with all the basic building blocks
-of the model (ParDo, GroupByKey, Window, Trigger, etc)</li>
- <li>Begin fleshing out the common composite transforms (Count, Join, etc) and I/O
-connectors (Text, Kafka, etc)</li>
- <li>Have at least one runner that can execute the complete model (may be a
-direct runner)</li>
- <li>Provide integration tests for executing against current and future runners</li>
- <li>Add a webpage under <code class="highlighter-rouge">documentation/sdks</code></li>
-</ol>
-
-
- </div>
- </div>
- <footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/contribute/index.html b/content/contribute/index.html
index aaf2a28..ff9877d 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -4,7 +4,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Contribute to Beam</title>
+ <title>Beam Contribution Guide</title>
<meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
@@ -144,33 +126,232 @@
<nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
+<ul class="nav">
+ <li><a href="#contributing-code">Contributing code</a>
+ <ul>
+ <li><a href="#building--testing">Building & Testing</a></li>
+ <li><a href="#testing-the-python-sdk">Testing the Python SDK</a></li>
+ </ul>
+ </li>
+ <li><a href="#contributing-to-the-website">Contributing to the website</a></li>
+ <li><a href="#works-in-progress">Works in progress</a>
+ <ul>
+ <li><a href="#portability-framework">Portability Framework</a></li>
+ <li><a href="#apache-spark-20-runner">Apache Spark 2.0 Runner</a></li>
+ <li><a href="#jstorm-runner">JStorm Runner</a></li>
+ <li><a href="#mapreduce-runner">MapReduce Runner</a></li>
+ <li><a href="#tez-runner">Tez Runner</a></li>
+ <li><a href="#go-sdk">Go SDK</a></li>
+ </ul>
+ </li>
+ <li><a href="#stale-pull-requests">Stale pull requests</a></li>
+</ul>
</nav>
<div class="body__contained body__section-nav">
- <h1 id="contribute-to-the-apache-beam-project">Contribute to the Apache Beam Project</h1>
+ <h1 id="apache-beam-contribution-guide">Apache Beam Contribution Guide</h1>
+
+<p>The Apache Beam community welcomes contributions from anyone!</p>
-<p>Learn how you can contribute to Beam:</p>
+<p>There are lots of opportunities:</p>
+
+<ul>
+ <li>write new examples</li>
+ <li>improve the documentation</li>
+ <li>add new user-facing libraries (new statistical libraries, new IO connectors,
+etc)</li>
+ <li>improve your favorite language SDK (Java, Python, Go, etc)</li>
+ <li>improve specific runners (Apache Apex, Apache Flink, Apache Spark, Google
+Cloud Dataflow, etc)</li>
+ <li>work on the core programming model (what is a Beam pipeline and how does it
+run?)</li>
+</ul>
-<h4 id="contribution-guide"><a href="/contribute/contribution-guide/">Contribution Guide</a></h4>
-<p>Learn how to contribute to the Beam project.</p>
+<p>Most importantly, if you have an idea of how to contribute, then do it!</p>
-<h4 id="technical-vision"><a href="https://goo.gl/nk5OM0">Technical Vision</a></h4>
-<p>Learn about the technical vision for Beam, including the designs for SDKs and runners, and the development process.</p>
+<p>For a list of open starter tasks, check
+<a href="https://s.apache.org/beam-starter-tasks">https://s.apache.org/beam-starter-tasks</a>.</p>
-<h4 id="ptransform-style-guide"><a href="/contribute/ptransform-style-guide">PTransform Style Guide</a></h4>
-<p>Learn about the best practices for developing new PTransforms.</p>
+<p>And, of course, we would love if you <a href="/community/contact-us/">contact us</a> and introduce yourself.</p>
-<h4 id="resources">Resources</h4>
-<p>Resources for contributing to Beam, including mailing lists, the main GitHub repo, and the issues tracker.</p>
+<h2 id="contributing-code">Contributing code</h2>
+
+<p>Coding happens at
+<a href="https://github.com/apache/beam">https://github.com/apache/beam</a>. To
+contribute, follow the usual GitHub process: fork the repo, make your changes,
+and open a pull request. If you are unfamiliar with this workflow, GitHub
+maintains these helpful guides:</p>
<ul>
- <li><a href="/get-started/support/">Mailing Lists</a></li>
- <li><a href="/contribute/source-repository">Source Repository</a></li>
- <li><a href="/get-started/support/">Issue Tracking</a></li>
+ <li><a href="https://guides.github.com/introduction/git-handbook/">Git Handbook</a></li>
+ <li><a href="https://guides.github.com/activities/forking/">Forking a repository</a></li>
</ul>
+<p>If your change is large, it is a good idea to <a href="/community/contact-us/">discuss it on the dev@ mailing list</a>. You will also
+need to submit a signed <a href="https://www.apache.org/licenses/icla.pdf">Individual Contributor License
+Agreement</a> (ICLA) to the Apache
+Software Foundation (ASF). The purpose of this agreement is to clearly define
+the terms under which intellectual property has been contributed to the ASF and
+thereby allow us to defend the project should there be a legal dispute
+regarding the software at some future time.</p>
+
+<p>If you are contributing a <code class="highlighter-rouge">PTransform</code> to Beam, we have an extensive
+<a href="/contribute/ptransform-style-guide">PTransform Style Guide</a>.</p>
+
+<h3 id="building--testing">Building & Testing</h3>
+
+<p>We use Gradle to orchestrate building and testing.</p>
+
+<p>The entire set of tests can be run with this command at the root of the git
+repository.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ ./gradlew check
+</code></pre>
+</div>
+
+<p>You can limit testing to a particular module and Gradle will build just the
+necessary things to run those tests. For example:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ ./gradlew -p sdks/go check
+$ ./gradlew -p sdks/java/io/cassandra check
+$ ./gradlew -p runners/flink check
+</code></pre>
+</div>
+
+<h3 id="testing-the-python-sdk">Testing the Python SDK</h3>
+
+<p>You can directly use the Python toolchain instead of having Gradle orchestrate
+it. This may be faster for you. We recommend setting up a virtual environment
+before testing your code.</p>
+
+<p>If you update any of the <a href="http://cython.org">cythonized</a> files in Python SDK,
+you must install the <code class="highlighter-rouge">cython</code> package before running following command to
+properly test your code.</p>
+
+<p>The following commands should be run in the <code class="highlighter-rouge">sdks/python</code> directory.
+This command runs all Python tests.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py nosetests
+</code></pre>
+</div>
+
+<p>You can use following command to run a single test method.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py nosetests --tests <module>:<test class>.<test method>
+
+Example:
+$ python setup.py nosetests --tests apache_beam.io.textio_test:TextSourceTest.test_progress
+</code></pre>
+</div>
+
+<p>To check just for lint errors, run the following command.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ ../../gradlew lint
+</code></pre>
+</div>
+
+<h4 id="remote-testing">Remote testing</h4>
+
+<p>This step is only required for testing SDK code changes remotely (not using
+directrunner). In order to do this you must build the Beam tarball. From the
+root of the git repository, run:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ cd sdks/python/
+$ python setup.py sdist
+</code></pre>
+</div>
+
+<p>Pass the <code class="highlighter-rouge">--sdk_location</code> flag to use the newly built version. For example:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>$ python setup.py sdist > /dev/null && \
+ python -m apache_beam.examples.wordcount ... \
+ --sdk_location dist/apache-beam-2.5.0.dev0.tar.gz
+</code></pre>
+</div>
+
+<h2 id="contributing-to-the-website">Contributing to the website</h2>
+
+<p>The Beam website is in the <a href="https://github.com/apache/beam-site">Beam Site GitHub
+mirror</a> repository in the <code class="highlighter-rouge">asf-site</code>
+branch (<em>not</em> <code class="highlighter-rouge">master</code>). The
+<a href="https://github.com/apache/beam-site/blob/asf-site/README.md">README</a> there
+explains how to modify different parts of the site. The GitHub workflow is the
+same - make your change and open a pull request.</p>
+
+<p>Issues are tracked in the
+<a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20website">website</a>
+component in JIRA.</p>
+
+<h2 id="works-in-progress">Works in progress</h2>
+
+<p>A great way to contribute is to join an existing effort. There are many
+works in progress, some on branches because they are very incomplete.</p>
+
+<h3 id="portability-framework">Portability Framework</h3>
+
+<p>The primary Beam vision: Any SDK on any runner. This is a cross-cutting effort
+across Java, Python, and Go, and every Beam runner.</p>
+
+<ul>
+ <li><a href="/contribute/portability/">Read more</a></li>
+</ul>
+
+<h3 id="apache-spark-20-runner">Apache Spark 2.0 Runner</h3>
+
+<ul>
+ <li>Feature branch: <a href="https://github.com/apache/beam/tree/runners-spark2">runners-spark2</a></li>
+ <li>Contact: <a href="mailto:jbonofre@apache.org">Jean-Baptiste Onofré</a></li>
+</ul>
+
+<h3 id="jstorm-runner">JStorm Runner</h3>
+
+<ul>
+ <li><a href="/documentation/runners/jstorm">Docs</a></li>
+ <li>Feature branch: <a href="https://github.com/apache/beam/tree/jstorm-runner">jstorm-runner</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-jstorm">runner-jstorm</a> / <a href="https://issues.apache.org/jira/browse/BEAM-1899">BEAM-1899</a></li>
+ <li>Contact: <a href="mailto:pei@apache.org">Pei He</a></li>
+</ul>
+
+<h3 id="mapreduce-runner">MapReduce Runner</h3>
+
+<ul>
+ <li>Feature branch: <a href="https://github.com/apache/beam/tree/mr-runner">mr-runner</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-mapreduce">runner-mapreduce</a> / <a href="https://issues.apache.org/jira/browse/BEAM-165">BEAM-165</a></li>
+ <li>Contact: <a href="mailto:pei@apache.org">Pei He</a></li>
+</ul>
+
+<h3 id="tez-runner">Tez Runner</h3>
+
+<ul>
+ <li>Feature branch: <a href="https://github.com/apache/beam/tree/tez-runner">tez-runner</a></li>
+ <li>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-tez">runner-tez</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2709">BEAM-2709</a></li>
+</ul>
+
+<h3 id="go-sdk">Go SDK</h3>
+
+<ul>
+ <li>
+ <table>
+ <tbody>
+ <tr>
+ <td>JIRA: <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a> / <a href="https://issues.apache.org/jira/browse/BEAM-2083">BEAM-2083</a></td>
+ </tr>
+ </tbody>
+ </table>
+ </li>
+ <li>Contact: <a href="mailto:herohde@google.com">Henning Rohde</a></li>
+</ul>
+
+<h2 id="stale-pull-requests">Stale pull requests</h2>
+
+<p>The community will close stale pull requests in order to keep the project
+healthy. A pull request becomes stale after its author fails to respond to
+actionable comments for 60 days. Author of a closed pull request is welcome to
+reopen the same pull request again in the future. The associated JIRAs will be
+unassigned from the author but will stay open.</p>
+
</div>
</div>
<footer class="footer">
diff --git a/content/contribute/intellij/index.html b/content/contribute/intellij/index.html
index 1b4b59a..2cee952 100644
--- a/content/contribute/intellij/index.html
+++ b/content/contribute/intellij/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/portability/index.html b/content/contribute/portability/index.html
index 40a828d..08d3175 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/ptransform-style-guide/index.html b/content/contribute/ptransform-style-guide/index.html
index 51165bd..acc992e 100644
--- a/content/contribute/ptransform-style-guide/index.html
+++ b/content/contribute/ptransform-style-guide/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/release-guide/index.html b/content/contribute/release-guide/index.html
index cc5f21c..2fd347f 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/runner-guide/index.html b/content/contribute/runner-guide/index.html
index c12f9db..2512225 100644
--- a/content/contribute/runner-guide/index.html
+++ b/content/contribute/runner-guide/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/source-repository/index.html b/content/contribute/source-repository/index.html
index afe926c..c0fa7ea 100644
--- a/content/contribute/source-repository/index.html
+++ b/content/contribute/source-repository/index.html
@@ -1,240 +1,10 @@
<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Beam Source Repository</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/source-repository/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">SDKS</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/intellij/">IntelliJ Tips</a></li>
- <li><a href="/contribute/eclipse/">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Other Guides</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical References</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- </ul>
-</li>
-
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
-
-
-<ul class="nav">
- <li><a href="#web-browser-access">Web Browser Access</a></li>
- <li><a href="#anonymous-access">Anonymous Access</a></li>
- <li><a href="#developer-access">Developer Access</a></li>
- <li><a href="#access-from-behind-a-firewall">Access from Behind a Firewall</a></li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <h1 id="apache-beam-source-repository">Apache Beam Source Repository</h1>
-
-<p>This project uses <a href="http://git-scm.com">Git</a> to manage its source code.</p>
-
-<h2 id="web-browser-access">Web Browser Access</h2>
-<p>The following is a link to a browsable version of the source repository:</p>
-
-<p><a href="https://gitbox.apache.org/repos/asf/beam.git">https://gitbox.apache.org/repos/asf/beam.git</a></p>
-
-<h2 id="anonymous-access">Anonymous Access</h2>
-<p>The source can be checked out anonymously from Git with this command (See http://git-scm.com/docs/git-clone):</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git clone https://gitbox.apache.org/repos/asf/beam.git
-</code></pre>
-</div>
-
-<h2 id="developer-access">Developer Access</h2>
-<p>Only project developers can access the Git tree via this method (See http://git-scm.com/docs/git-clone).</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ git clone https://gitbox.apache.org/repos/asf/beam.git
-</code></pre>
-</div>
-
-<h2 id="access-from-behind-a-firewall">Access from Behind a Firewall</h2>
-<p>Refer to the documentation of the SCM used for more information about access behind a firewall.</p>
-
- </div>
- </div>
- <footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/contribute/testing/index.html b/content/contribute/testing/index.html
index eaec8f5..ca0747b 100644
--- a/content/contribute/testing/index.html
+++ b/content/contribute/testing/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/website-contributions/index.html b/content/contribute/website-contributions/index.html
index 5a30e31..9674bfd 100644
--- a/content/contribute/website-contributions/index.html
+++ b/content/contribute/website-contributions/index.html
@@ -89,24 +89,7 @@
<nav>
<ul class="section-nav-list" data-section-nav>
<li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
+<li><a href="/contribute/">Get started contributing</a></li>
<li>
<span class="section-nav-list-title">IDE tips</span>
@@ -116,24 +99,23 @@
</ul>
</li>
<li>
- <span class="section-nav-list-title">Other Guides</span>
+ <span class="section-nav-list-title">Technical Docs</span>
<ul class="section-nav-list">
<li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
<li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
<li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
+ <li><a href="/contribute/portability/">Portability Framework</a></li>
+ <li><a href="/contribute/docker-images/">Docker images</a></li>
</ul>
</li>
<li>
- <span class="section-nav-list-title">Technical References</span>
+ <span class="section-nav-list-title">Committers</span>
<ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
+ <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
+ <li><a href="/contribute/committer-guide/">Committer guide</a></li>
+ <li><a href="/contribute/release-guide/">Release guide</a></li>
</ul>
</li>
diff --git a/content/contribute/work-in-progress/index.html b/content/contribute/work-in-progress/index.html
index 001ae31..c0fa7ea 100644
--- a/content/contribute/work-in-progress/index.html
+++ b/content/contribute/work-in-progress/index.html
@@ -1,274 +1,10 @@
<!DOCTYPE html>
-<html lang="en">
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <title>In Progress Work in Beam</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
- <link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
- <link rel="stylesheet" href="/css/site.css">
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"></script>
- <script src="/js/bootstrap.min.js"></script>
- <script src="/js/language-switch.js"></script>
- <script src="/js/fix-menu.js"></script>
- <script src="/js/section-nav.js"></script>
- <script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/contribute/work-in-progress/" data-proofer-ignore>
- <link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
- <link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
- ga('create', 'UA-73650088-1', 'auto');
- ga('send', 'pageview');
- </script>
-</head>
-
- <body class="body" data-spy="scroll" data-target=".page-nav" data-offset="0">
- <nav class="header navbar navbar-fixed-top">
- <div class="navbar-header">
- <button type="button" class="navbar-toggle" aria-expanded="false" aria-controls="navbar">
- <span class="sr-only">Toggle navigation</span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
-
- <a href="/" class="navbar-brand" >
- <img alt="Brand" style="height: 25px" src="/images/beam_logo_navbar.png">
- </a>
- </div>
-
- <div class="navbar-mask closed"></div>
-
- <div id="navbar" class="navbar-container closed">
- <ul class="nav navbar-nav">
- <li>
- <a href="/get-started/beam-overview/">Get Started</a>
- </li>
- <li>
- <a href="/documentation/">Documentation</a>
- </li>
- <li>
- <a href="/documentation/sdks/java/">SDKS</a>
- </li>
- <li>
- <a href="/documentation/runners/capability-matrix/">RUNNERS</a>
- </li>
- <li>
- <a href="/contribute/">Contribute</a>
- </li>
- <li>
- <a href="/community/contact-us/">Community</a>
- </li>
- <li><a href="/blog">Blog</a></li>
- </ul>
- <ul class="nav navbar-nav navbar-right">
- <li class="dropdown">
- <a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false"><img src="https://www.apache.org/foundation/press/kit/feather_small.png" alt="Apache Logo" style="height:20px;"><span class="caret"></span></a>
- <ul class="dropdown-menu dropdown-menu-right">
- <li><a href="http://www.apache.org/">ASF Homepage</a></li>
- <li><a href="http://www.apache.org/licenses/">License</a></li>
- <li><a href="http://www.apache.org/security/">Security</a></li>
- <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
- <li><a href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
-</nav>
-
- <div class="clearfix container-main-content">
- <div class="section-nav closed" data-offset-top="90" data-offset-bottom="500">
- <span class="section-nav-back glyphicon glyphicon-menu-left"></span>
- <nav>
- <ul class="section-nav-list" data-section-nav>
- <li><span class="section-nav-list-main-title">Contribute</span></li>
-<li><a href="/contribute">Get started contributing</a></li>
-<li>
- <span class="section-nav-list-title">How to contribute</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/contribution-guide/">Contribution guide</a></li>
- <li><a href="/contribute/website-contributions/">Website contributions</a></li>
- <li><a href="/contribute/feature-branches/">Feature branches</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Committers</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/become-a-committer/">Become a committer</a></li>
- <li><a href="/contribute/committer-guide/">Committer guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">IDE tips</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/intellij/">IntelliJ Tips</a></li>
- <li><a href="/contribute/eclipse/">Eclipse Tips</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Other Guides</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/testing/">Testing guide</a></li>
- <li><a href="/contribute/release-guide/">Release guide</a></li>
- <li><a href="/contribute/ptransform-style-guide/">PTransform style guide</a></li>
- <li><a href="/contribute/runner-guide/">Runner authoring guide</a></li>
- </ul>
-</li>
-<li>
- <span class="section-nav-list-title">Technical References</span>
-
- <ul class="section-nav-list">
- <li><a href="/contribute/design-principles/">Design principles</a></li>
- <li><a href="/contribute/portability/">Portability Framework</a></li>
- <li><a href="/contribute/work-in-progress/">Ongoing projects</a></li>
- <li><a href="/contribute/source-repository/">Source repository</a></li>
- <li><a href="/contribute/docker-images/">Docker images</a></li>
- </ul>
-</li>
-
- </ul>
- </nav>
- </div>
-
- <nav class="page-nav clearfix" data-offset-top="90" data-offset-bottom="500">
-
-
-<ul class="nav">
- <li><a href="#starter-tasks">Starter Tasks</a></li>
- <li><a href="#feature-branches">Feature Branches</a></li>
-</ul>
-
-
- </nav>
-
- <div class="body__contained body__section-nav">
- <h1 id="work-in-progress-in-the-apache-beam-project">Work In Progress in the Apache Beam Project</h1>
-
-<p>As mentioned in the <a href="/contribute/contribution-guide/">Contribution Guide</a>, all work in Beam is tracked in our <a href="https://issues.apache.org/jira/browse/BEAM">Apache JIRA</a>. In addition, the following types of work may be of particular interest to the Beam community.</p>
-
-<ul id="markdown-toc">
- <li><a href="#starter-tasks" id="markdown-toc-starter-tasks">Starter Tasks</a></li>
- <li><a href="#feature-branches" id="markdown-toc-feature-branches">Feature Branches</a></li>
-</ul>
-
-<h2 id="starter-tasks">Starter Tasks</h2>
-
-<p>The community regular tags good getting started tasks with the label <code class="highlighter-rouge">starter</code>. Use a quick <a href="https://issues.apache.org/jira/issues?jql=project%20%3D%20BEAM%20AND%20status%20%3D%20Open%20AND%20labels%20%3D%20starter">JIRA search</a> to identify ways you can get started <a href="/contribute/contribution-guide/">contributing</a> to Beam.</p>
-
-<h2 id="feature-branches">Feature Branches</h2>
-
-<p>Larger features with multiple active developers may be developed on a <a href="/contribute/feature-branches/">feature branch</a> before being merged in the master branch. In particular, this is often used for initial development of new components like SDKs or runners.</p>
-
-<p>Current branches include:</p>
-
-<table class="table">
- <thead>
- <tr>
- <th>Feature</th>
- <th>Branch</th>
- <th>JIRA Component</th>
- <th>More Info</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td>Apache Spark 2.0 Runner</td>
- <td><a href="https://github.com/apache/beam/tree/runners-spark2">runners-spark2</a></td>
- <td>-</td>
- <td><a href="https://lists.apache.org/thread.html/e38ac4e4914a6cb1b865b1f32a6ca06c2be28ea4aa0f6b18393de66f@%3Cdev.beam.apache.org%3E">thread</a></td>
- </tr>
- <tr>
- <td><a href="/documentation/runners/jstorm">JStorm Runner</a></td>
- <td><a href="https://github.com/apache/beam/tree/jstorm-runner">jstorm-runner</a></td>
- <td><a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-jstorm">runner-jstorm</a></td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-1899">BEAM-1899</a></td>
- </tr>
- <tr>
- <td>MapReduce Runner</td>
- <td><a href="https://github.com/apache/beam/tree/mr-runner">mr-runner</a></td>
- <td><a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-mapreduce">runner-mapreduce</a></td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-165">BEAM-165</a></td>
- </tr>
- <tr>
- <td>Tez Runner</td>
- <td><a href="https://github.com/apache/beam/tree/tez-runner">tez-runner</a></td>
- <td><a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-tez">runner-tez</a></td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-2709">BEAM-2709</a></td>
- </tr>
- <tr>
- <td>Go SDK</td>
- <td>master</td>
- <td><a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go">sdk-go</a></td>
- <td><a href="https://issues.apache.org/jira/browse/BEAM-2083">BEAM-2083</a></td>
- </tr>
- </tbody>
-</table>
-
- </div>
- </div>
- <footer class="footer">
- <div class="footer__contained">
- <div class="footer__cols">
- <div class="footer__cols__col">
- <div class="footer__cols__col__logo">
- <img src="/images/beam_logo_circle.svg" class="footer__logo" alt="Beam logo">
- </div>
- <div class="footer__cols__col__logo">
- <img src="/images/apache_logo_circle.svg" class="footer__logo" alt="Apache logo">
- </div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Start</div>
- <div class="footer__cols__col__link"><a href="/get-started/beam-overview/">Overview</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-java/">Quickstart (Java)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/quickstart-py/">Quickstart (Python)</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/downloads/">Downloads</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Docs</div>
- <div class="footer__cols__col__link"><a href="/documentation/programming-guide/">Concepts</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/pipelines/design-your-pipeline/">Pipelines</a></div>
- <div class="footer__cols__col__link"><a href="/documentation/runners/capability-matrix/">Runners</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Community</div>
- <div class="footer__cols__col__link"><a href="/contribute/">Contribute</a></div>
- <div class="footer__cols__col__link"><a href="https://projects.apache.org/committee.html?beam" target="_blank">Team<img src="/images/external-link-icon.png"
- width="14" height="14"
- alt="External link."></a></div>
- <div class="footer__cols__col__link"><a href="/contribute/presentation-materials/">Media</a></div>
- </div>
- <div class="footer__cols__col footer__cols__col--md">
- <div class="footer__cols__col__title">Resources</div>
- <div class="footer__cols__col__link"><a href="/blog/">Blog</a></div>
- <div class="footer__cols__col__link"><a href="/get-started/support/">Support</a></div>
- <div class="footer__cols__col__link"><a href="https://github.com/apache/beam">GitHub</a></div>
- </div>
- </div>
- </div>
- <div class="footer__bottom">
- ©
- <a href="http://www.apache.org">The Apache Software Foundation</a>
- | <a href="/privacy_policy">Privacy Policy</a>
- | <a href="/feed.xml">RSS Feed</a>
- <br><br>
- Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are
- either registered trademarks or trademarks of The Apache Software
- Foundation. All other products or name brands are trademarks of their
- respective holders, including The Apache Software Foundation.
- </div>
-</footer>
-
- </body>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/contribution-guide/index.html b/content/contribution-guide/index.html
index bc80fb2..c0fa7ea 100644
--- a/content/contribution-guide/index.html
+++ b/content/contribution-guide/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting…</title>
-<link rel="canonical" href="https://beam.apache.org/contribute/contribution-guide/">
-<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/contribution-guide/">
+<link rel="canonical" href="https://beam.apache.org/contribute/">
+<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/">
<h1>Redirecting…</h1>
-<a href="https://beam.apache.org/contribute/contribution-guide/">Click here if you are not redirected.</a>
-<script>location="https://beam.apache.org/contribute/contribution-guide/"</script>
+<a href="https://beam.apache.org/contribute/">Click here if you are not redirected.</a>
+<script>location="https://beam.apache.org/contribute/"</script>
</html>
diff --git a/content/docs/contribute.html b/content/docs/contribute/index.html
similarity index 100%
rename from content/docs/contribute.html
rename to content/docs/contribute/index.html
diff --git a/content/source_repository/index.html b/content/source_repository/index.html
deleted file mode 100644
index c72852c..0000000
--- a/content/source_repository/index.html
+++ /dev/null
@@ -1,10 +0,0 @@
-<!DOCTYPE html>
-<html lang="en-US">
-<meta charset="utf-8">
-<title>Redirecting…</title>
-<link rel="canonical" href="https://beam.apache.org/contribute/source-repository/">
-<meta http-equiv="refresh" content="0; url=https://beam.apache.org/contribute/source-repository/">
-<h1>Redirecting…</h1>
-<a href="https://beam.apache.org/contribute/source-repository/">Click here if you are not redirected.</a>
-<script>location="https://beam.apache.org/contribute/source-repository/"</script>
-</html>
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.