You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by tw...@apache.org on 2019/01/14 13:08:08 UTC
[flink] branch release-1.7 updated (233a032 -> 21019c3)
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a change to branch release-1.7
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 233a032 [hotfix] [docs] Fix kafka doc mistake classname
new f6da761 [FLINK-11304][docs][table] Fix typo in time attributes doc
new 21019c3 [hotfix][docs][table] Fix more typos in time attributes doc
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/dev/table/streaming/time_attributes.md | 31 +++++++++++++++++++++--------
1 file changed, 23 insertions(+), 8 deletions(-)
[flink] 01/02: [FLINK-11304][docs][table] Fix typo in time
attributes doc
Posted by tw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a commit to branch release-1.7
in repository https://gitbox.apache.org/repos/asf/flink.git
commit f6da7617a0c036421393ae5cdaa9a289d36e6883
Author: JaryZhen <ja...@JZ.local>
AuthorDate: Mon Jan 14 12:30:10 2019 +0800
[FLINK-11304][docs][table] Fix typo in time attributes doc
This closes #7477.
---
docs/dev/table/streaming/time_attributes.md | 24 ++++++++++++++++++------
1 file changed, 18 insertions(+), 6 deletions(-)
diff --git a/docs/dev/table/streaming/time_attributes.md b/docs/dev/table/streaming/time_attributes.md
index 27208fb..447b058 100644
--- a/docs/dev/table/streaming/time_attributes.md
+++ b/docs/dev/table/streaming/time_attributes.md
@@ -264,7 +264,7 @@ Moreover, the `DataStream` returned by the `getDataStream()` method must have wa
<div data-lang="java" markdown="1">
{% highlight java %}
// define a table source with a rowtime attribute
-public class UserActionSource implements StreamTableSource<Row>, DefinedRowtimeAttribute {
+public class UserActionSource implements StreamTableSource<Row>, DefinedRowtimeAttributes {
@Override
public TypeInformation<Row> getReturnType() {
@@ -284,9 +284,15 @@ public class UserActionSource implements StreamTableSource<Row>, DefinedRowtimeA
}
@Override
- public String getRowtimeAttribute() {
+ public List<RowtimeAttributeDescriptor> getRowtimeAttributeDescriptors() {
// Mark the "UserActionTime" attribute as event-time attribute.
- return "UserActionTime";
+ // We create one attribute descriptor of "UserActionTime".
+ RowtimeAttributeDescriptor rowtimeAttrDescr = new RowtimeAttributeDescriptor(
+ "UserActionTime",
+ new ExistingField("UserActionTime"),
+ new AscendingTimestamps());
+ List<RowtimeAttributeDescriptor> listRowtimeAttrDescr = Collections.singletonList(rowtimeAttrDescr);
+ return listRowtimeAttrDescr;
}
}
@@ -301,7 +307,7 @@ WindowedTable windowedTable = tEnv
<div data-lang="scala" markdown="1">
{% highlight scala %}
// define a table source with a rowtime attribute
-class UserActionSource extends StreamTableSource[Row] with DefinedRowtimeAttribute {
+class UserActionSource extends StreamTableSource[Row] with DefinedRowtimeAttributes {
override def getReturnType = {
val names = Array[String]("Username" , "Data", "UserActionTime")
@@ -317,9 +323,15 @@ class UserActionSource extends StreamTableSource[Row] with DefinedRowtimeAttribu
stream
}
- override def getRowtimeAttribute = {
+ override def getRowtimeAttributeDescriptors: util.List[RowtimeAttributeDescriptor] = {
// Mark the "UserActionTime" attribute as event-time attribute.
- "UserActionTime"
+ // We create one attribute descriptor of "UserActionTime".
+ val rowtimeAttrDescr = new RowtimeAttributeDescriptor(
+ "UserActionTime",
+ new ExistingField("UserActionTime"),
+ new AscendingTimestamps)
+ val listRowtimeAttrDescr = Collections.singletonList(rowtimeAttrDescr)
+ listRowtimeAttrDescr
}
}
[flink] 02/02: [hotfix][docs][table] Fix more typos in time
attributes doc
Posted by tw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a commit to branch release-1.7
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 21019c36c853b24dca2be4b584163ff0db9cd74d
Author: Timo Walther <tw...@apache.org>
AuthorDate: Mon Jan 14 14:05:46 2019 +0100
[hotfix][docs][table] Fix more typos in time attributes doc
---
docs/dev/table/streaming/time_attributes.md | 7 +++++--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/docs/dev/table/streaming/time_attributes.md b/docs/dev/table/streaming/time_attributes.md
index 447b058..64da171 100644
--- a/docs/dev/table/streaming/time_attributes.md
+++ b/docs/dev/table/streaming/time_attributes.md
@@ -256,9 +256,12 @@ val windowedTable = table.window(Tumble over 10.minutes on 'UserActionTime as 'u
### Using a TableSource
-The event time attribute is defined by a `TableSource` that implements the `DefinedRowtimeAttribute` interface. The `getRowtimeAttribute()` method returns the name of an existing field that carries the event time attribute of the table and is of type `LONG` or `TIMESTAMP`.
+The event time attribute is defined by a `TableSource` that implements the `DefinedRowtimeAttributes` interface. The `getRowtimeAttributeDescriptors()` method returns a list of `RowtimeAttributeDescriptor` for describing the final name of a time attribute, a timestamp extractor to derive the values of the attribute, and the watermark strategy associated with the attribute.
-Moreover, the `DataStream` returned by the `getDataStream()` method must have watermarks assigned that are aligned with the defined time attribute. Please note that the timestamps of the `DataStream` (the ones which are assigned by a `TimestampAssigner`) are ignored. Only the values of the `TableSource`'s rowtime attribute are relevant.
+Please make sure that the `DataStream` returned by the `getDataStream()` method is aligned with the defined time attribute.
+The timestamps of the `DataStream` (the ones which are assigned by a `TimestampAssigner`) are only considered if a `StreamRecordTimestamp` timestamp extractor is defined.
+Watermarks of a `DataStream` are only preserved if a `PreserveWatermarks` watermark strategy is defined.
+Otherwise, only the values of the `TableSource`'s rowtime attribute are relevant.
<div class="codetabs" markdown="1">
<div data-lang="java" markdown="1">