You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/11/12 23:40:06 UTC
[GitHub] [beam] pabloem commented on a change in pull request #13326: [BEAM-10480] Update SDF programming guide
pabloem commented on a change in pull request #13326:
URL: https://github.com/apache/beam/pull/13326#discussion_r522507487
##########
File path: website/www/site/content/en/documentation/programming-guide.md
##########
@@ -5188,16 +5188,60 @@ restriction pairs.
#### 12.1.1. A basic SDF {#a-basic-sdf}
A basic SDF is composed of three parts: a restriction, a restriction provider, and a
-restriction tracker. The restriction is used to represent a subset of work for a given element.
-The restriction provider lets SDF authors override default implementations for splitting, sizing,
-watermark estimation, and so forth. In [Java](https://github.com/apache/beam/blob/f4c2734261396858e388ebef2eef50e7d48231a8/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/DoFn.java#L92)
+restriction tracker. If you want to control the watermark properly especially in a streaming
+pipeline, two more components are needed: a watermark estimator provider and a watermark estimator.
+
+The restriction is a user-defined object which is used to represent a subset of
+work for a given element. For example, we defined OffsetRange as a restriction to represent offset
+positions in [Java](https://beam.apache.org/releases/javadoc/2.25.0/org/apache/beam/sdk/io/range/OffsetRange.html)
Review comment:
You can link to `current`. See: https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/range/OffsetRange.html
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org