You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@calcite.apache.org by jh...@apache.org on 2016/02/20 00:35:25 UTC
[3/5] calcite git commit: Add "Streaming SQL" talk
Add "Streaming SQL" talk
Project: http://git-wip-us.apache.org/repos/asf/calcite/repo
Commit: http://git-wip-us.apache.org/repos/asf/calcite/commit/d42581d9
Tree: http://git-wip-us.apache.org/repos/asf/calcite/tree/d42581d9
Diff: http://git-wip-us.apache.org/repos/asf/calcite/diff/d42581d9
Branch: refs/heads/master
Commit: d42581d9a56dba377fac5d827c03b5aa12a648b7
Parents: 9188736
Author: Julian Hyde <jh...@apache.org>
Authored: Thu Feb 18 17:43:21 2016 -0800
Committer: Julian Hyde <jh...@apache.org>
Committed: Fri Feb 19 14:28:08 2016 -0800
----------------------------------------------------------------------
site/_docs/stream.md | 13 ++++++--
site/_posts/2016-02-17-streaming-sql-talk.md | 40 +++++++++++++++++++++++
site/community/index.md | 8 +++++
3 files changed, 59 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/calcite/blob/d42581d9/site/_docs/stream.md
----------------------------------------------------------------------
diff --git a/site/_docs/stream.md b/site/_docs/stream.md
index 395447b..c43d89f 100644
--- a/site/_docs/stream.md
+++ b/site/_docs/stream.md
@@ -205,7 +205,15 @@ at or after 11:00:00, it will never see a row that will contribute to a 10:00:00
total.
A column or expression that is increasing or decreasing is said to be
-*monotonic*. Without a monotonic expression in the `GROUP BY` clause, Calcite is
+*monotonic*.
+
+If column or expression has values that are slightly out of order,
+and the stream has a mechanism (such as punctuation or watermarks)
+to declare that a particular value will never be seen again, then
+the column or expression is said to be *quasi-monotonic*.
+
+Without a monotonic or quasi-monotonic expression in the `GROUP BY` clause,
+Calcite is
not able to make progress, and it will not allow the query:
{% highlight sql %}
@@ -217,7 +225,8 @@ not able to make progress, and it will not allow the query:
ERROR: Streaming aggregation requires at least one monotonic expression in GROUP BY clause
{% endhighlight %}
-Monotonic columns need to be declared in the schema. The monotonicity is
+Monotonic and quasi-monotonic columns need to be declared in the schema.
+The monotonicity is
enforced when records enter the stream and assumed by queries that read from
that stream. We recommend that you give each stream a timestamp column called
`rowtime`, but you can declare others, `orderId`, for example.
http://git-wip-us.apache.org/repos/asf/calcite/blob/d42581d9/site/_posts/2016-02-17-streaming-sql-talk.md
----------------------------------------------------------------------
diff --git a/site/_posts/2016-02-17-streaming-sql-talk.md b/site/_posts/2016-02-17-streaming-sql-talk.md
new file mode 100644
index 0000000..9c5d55a
--- /dev/null
+++ b/site/_posts/2016-02-17-streaming-sql-talk.md
@@ -0,0 +1,40 @@
+---
+layout: news_item
+title: "Streaming SQL in Samza"
+date: "2016-02-17 11:53:00 -0800"
+author: jhyde
+categories: ["talks"]
+---
+<!--
+{% comment %}
+Licensed to the Apache Software Foundation (ASF) under one or more
+contributor license agreements. See the NOTICE file distributed with
+this work for additional information regarding copyright ownership.
+The ASF licenses this file to you under the Apache License, Version 2.0
+(the "License"); you may not use this file except in compliance with
+the License. You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+{% endcomment %}
+-->
+
+Julian Hyde gave a talk at the [Apache Samza](http://samza.apache.org/)
+meetup in Mountain View, CA.
+
+His talk asked the questions:
+
+* What is [SamzaSQL](https://github.com/milinda/samza-sql),
+ and what might I use it for?
+* Does this mean that Samza is turning into a database?
+* What is a query optimizer, and what can it do for my streaming queries?
+
+The talk is available in
+[[slides](http://www.slideshare.net/julianhyde/streaming-sql)]
+and
+[[video](http://www.ustream.tv/recorded/83322450#to00:55:48)].
http://git-wip-us.apache.org/repos/asf/calcite/blob/d42581d9/site/community/index.md
----------------------------------------------------------------------
diff --git a/site/community/index.md b/site/community/index.md
index ac2452c..b0c9fdb 100644
--- a/site/community/index.md
+++ b/site/community/index.md
@@ -97,6 +97,14 @@ Apache Kylin meetup, 2014;
<iframe src="//www.slideshare.net/slideshow/embed_code/key/fCGsAedsQiq53V" width="629" height="354" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe>
+## Streaming SQL
+
+At Samza meetup, Mountain View, CA, 2016
+[[video](http://www.ustream.tv/recorded/83322450#to00:55:48)],
+[[slides](http://www.slideshare.net/julianhyde/streaming-sql)].
+
+<iframe src="//www.slideshare.net/slideshow/embed_code/key/rzaptOy3H8K6Gz" width="595" height="485" frameborder="0" marginwidth="0" marginheight="0" scrolling="no" style="border:1px solid #CCC; border-width:1px; margin-bottom:5px; max-width: 100%;" allowfullscreen> </iframe>
+
## More talks
* <a href="https://github.com/julianhyde/share/blob/master/slides/hive-cbo-seattle-2014.pdf?raw=true">Cost-based optimization in Hive 0.14</a> (Seattle, 2014)