You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Hongyuhong <ho...@huawei.com> on 2017/01/05 11:00:08 UTC

答复: Som question about Flink stream sql

Hi Fabian,

Thanks for the reply.
As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,
Can you tell something about the progress of the row windows in Table API?

Regards.
Yuhong




发件人: Fabian Hueske [mailto:fhueske@gmail.com]
发送时间: 2017年1月5日 17:43
收件人: user@flink.apache.org
主题: Re: Som question about Flink stream sql

Hi Yuhong,
as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.
The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.
You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.
Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.
Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.
Best, Fabian


2017-01-05 4:40 GMT+01:00 Hongyuhong <ho...@huawei.com>>:
Hi,
We are currently exploring on Flink streamsql ,
And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.
I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.
And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?
The issue on calcite jira was raised in August, what’s the status right now?
Thanks in advance!

Regards
Yuhong

Re: 答复: Som question about Flink stream sql

Posted by Fabian Hueske <fh...@gmail.com>.
There are several JIRA issues for row windows, some of them might be
assigned.
I haven't seen pull requests and nothing to merged yet.

I would ask on the JIRA issue of the current status.

Best, Fabian

2017-01-05 12:00 GMT+01:00 Hongyuhong <ho...@huawei.com>:

> Hi Fabian,
>
>
>
> Thanks for the reply.
>
> As you noticed, row windows are already supported by Calcite and FLIP-11
> has planned,
>
> Can you tell something about the progress of the row windows in Table API?
>
>
>
> Regards.
>
> Yuhong
>
>
>
>
>
>
>
>
>
> *发件人:* Fabian Hueske [mailto:fhueske@gmail.com]
> *发送时间:* 2017年1月5日 17:43
> *收件人:* user@flink.apache.org
> *主题:* Re: Som question about Flink stream sql
>
>
>
> Hi Yuhong,
>
> as you noticed, FLIP-11 is about the window operations on the Table API
> and does not include SQL.
>
> The reason is that the Table API is completely Flink domain, i.e., we can
> design and implement the API. For SQL we have a dependency on Calcite.
>
> You are right, that Calcite's JIRA issue for group windows [1] seems to be
> stale. I don't have more information on that. You could ping there and ask
> what the status is.
>
> Row windows are already supported by Calcite (SQL's OVER and WINDOW
> clauses), so these could be implemented for SQL as well.
>
> Maybe it's even easier to start from the SQL side and add the Table API
> later to ensure a compatible compilation process.
>
> Best, Fabian
>
>
>
>
>
> 2017-01-05 4:40 GMT+01:00 Hongyuhong <ho...@huawei.com>:
>
> Hi,
>
> We are currently exploring on Flink streamsql ,
>
> And I see the group-window has been implemented in Table API, and
> row-window is also planning in FLIP-11. It seems that row-window grammar is
> more similar to calcite over clause.
>
> I’m curious about the detail plan and roadmap of stream sql, cause
> FLIP-11 just mentioned Table API.
>
> And is that streamsql priority implement row-window? Or if group-window is
> considered, what is the status on calcite integration?
>
> The issue on calcite jira was raised in August, what’s the status right
> now?
>
> Thanks in advance!
>
>
>
> Regards
>
> Yuhong
>
>
>
>
>
>
>
>
>

Re: Som question about Flink stream sql

Posted by Jark Wu <wu...@alibaba-inc.com>.
Hi Yuhong, 

The design doc is not ready. You can refer FLINK-4679. There are some discussions under the issue.

- Jark Wu 

> 在 2017年1月6日，下午3:08，Hongyuhong <ho...@huawei.com> 写道：
> 
> Thanks Jark
>  
> Do you have any design documents or instructions about row window? We are interested in adding supports of window in streamsql side and it’s greate if can have some reference.
> Thanks very much.
>  
> Best
> Yuhong
>  
>  
> 发件人: Jark Wu [mailto:wuchong.wc@alibaba-inc.com] 
> 发送时间: 2017年1月6日 11:01
> 收件人: user@flink.apache.org
> 主题: Re: Som question about Flink stream sql
>  
> Hi Yuhong, 
>  
> I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.
> I will push forward this issue in the next days.
>  
> - Jark Wu 
>  
> 在 2017年1月5日，下午7:00，Hongyuhong <hongyuhong@huawei.com <ma...@huawei.com>> 写道：
>  
> Hi Fabian,
>  
> Thanks for the reply.
> As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,
> Can you tell something about the progress of the row windows in Table API?
>  
> Regards.
> Yuhong
>  
>  
>  
>  
> 发件人: Fabian Hueske [mailto:fhueske@gmail.com <ma...@gmail.com>] 
> 发送时间: 2017年1月5日 17:43
> 收件人: user@flink.apache.org <ma...@flink.apache.org>
> 主题: Re: Som question about Flink stream sql
>  
> Hi Yuhong,
> 
> as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.
> The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.
> 
> You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.
> Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.
> Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.
> 
> Best, Fabian
>  
> 
>  
> 2017-01-05 4:40 GMT+01:00 Hongyuhong <hongyuhong@huawei.com <ma...@huawei.com>>:
> Hi,
> We are currently exploring on Flink streamsql ,
> And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.
> I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.
> And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?
> The issue on calcite jira was raised in August, what’s the status right now?
> Thanks in advance!
>  
> Regards
> Yuhong

Re: Som question about Flink stream sql

Posted by Hongyuhong <ho...@huawei.com>.
Thanks Jark

Do you have any design documents or instructions about row window? We are interested in adding supports of window in streamsql side and it’s greate if can have some reference.
Thanks very much.

Best
Yuhong


发件人: Jark Wu [mailto:wuchong.wc@alibaba-inc.com]
发送时间: 2017年1月6日 11:01
收件人: user@flink.apache.org
主题: Re: Som question about Flink stream sql

Hi Yuhong,

I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.
I will push forward this issue in the next days.

- Jark Wu

在 2017年1月5日，下午7:00，Hongyuhong <ho...@huawei.com>> 写道：

Hi Fabian,

Thanks for the reply.
As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,
Can you tell something about the progress of the row windows in Table API?

Regards.
Yuhong




发件人: Fabian Hueske [mailto:fhueske@gmail.com]
发送时间: 2017年1月5日 17:43
收件人: user@flink.apache.org<ma...@flink.apache.org>
主题: Re: Som question about Flink stream sql

Hi Yuhong,
as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.
The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.
You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.
Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.
Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.
Best, Fabian


2017-01-05 4:40 GMT+01:00 Hongyuhong <ho...@huawei.com>>:
Hi,
We are currently exploring on Flink streamsql ,
And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.
I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.
And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?
The issue on calcite jira was raised in August, what’s the status right now?
Thanks in advance!

Regards
Yuhong

Re: Som question about Flink stream sql

Posted by Jark Wu <wu...@alibaba-inc.com>.
Hi Yuhong, 

I have assigned an issue for tumble row-window, but the progress is still under design and discuss. The implementation of row window is more complex than group window.
I will push forward this issue in the next days.

- Jark Wu 

> 在 2017年1月5日，下午7:00，Hongyuhong <ho...@huawei.com> 写道：
> 
> Hi Fabian,
>  
> Thanks for the reply.
> As you noticed, row windows are already supported by Calcite and FLIP-11 has planned,
> Can you tell something about the progress of the row windows in Table API?
>  
> Regards.
> Yuhong
>  
>  
>  
>  
> 发件人: Fabian Hueske [mailto:fhueske@gmail.com] 
> 发送时间: 2017年1月5日 17:43
> 收件人: user@flink.apache.org
> 主题: Re: Som question about Flink stream sql
>  
> Hi Yuhong,
> 
> as you noticed, FLIP-11 is about the window operations on the Table API and does not include SQL.
> The reason is that the Table API is completely Flink domain, i.e., we can design and implement the API. For SQL we have a dependency on Calcite.
> 
> You are right, that Calcite's JIRA issue for group windows [1] seems to be stale. I don't have more information on that. You could ping there and ask what the status is.
> Row windows are already supported by Calcite (SQL's OVER and WINDOW clauses), so these could be implemented for SQL as well.
> Maybe it's even easier to start from the SQL side and add the Table API later to ensure a compatible compilation process.
> 
> Best, Fabian
>  
> 
>  
> 2017-01-05 4:40 GMT+01:00 Hongyuhong <hongyuhong@huawei.com <ma...@huawei.com>>:
> Hi,
> We are currently exploring on Flink streamsql ,
> And I see the group-window has been implemented in Table API, and row-window is also planning in FLIP-11. It seems that row-window grammar is more similar to calcite over clause.
> I’m curious about the detail plan and roadmap of stream sql, cause FLIP-11 just mentioned Table API.
> And is that streamsql priority implement row-window? Or if group-window is considered, what is the status on calcite integration?
> The issue on calcite jira was raised in August, what’s the status right now?
> Thanks in advance!
>  
> Regards
> Yuhong