You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by 刘大龙 <ld...@zju.edu.cn> on 2022/04/15 07:07:29 UTC
Discussion about enhancing the partitioned table syntax
Hi, everyone
For partitioned table, there are still some related syntaxes that are not supported, which will be very useful for partitioned table. In batch analysis scenarios, such as Hive table, partitioned table is a very common case. Since the current Flink is mainly for streaming processing, not much work has been done on partitioned table. In order to enhance the experience of using Flink in batch job, as well as to improve the DDL syntax. So I created the issue FLINK-27237 to discuss about enhancing the partition table syntax. You are welcome to discuss on the issue and give comments so that this proposal can be improved.
Best,
Ron
Re: Re: Re: Discussion about enhancing the partitioned table syntax
Posted by Martijn Visser <ma...@apache.org>.
Hi,
If this is already proposed and accepted in the FLIP, then we indeed don't
need a new FLIP.
Best regards,
Martijn Visser
https://twitter.com/MartijnVisser82
https://github.com/MartijnVisser
On Fri, 15 Apr 2022 at 11:25, 刘大龙 <ld...@zju.edu.cn> wrote:
> Hi，Martijn
>
> Thanks for the Jingsong remind. This issue is the part of FLIP [1] which
> propose the related partition syntax, In our this issue, here no new added
> DDL/DMLs is introduced about partitioned table, so these syntax have been
> discussed and voted in community. I think we don't need a new FLIP.
>
> [1]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
>
> Best,
>
> Ron
>
> > -----原始邮件-----
> > 发件人: "刘大龙" <ld...@zju.edu.cn>
> > 发送时间: 2022-04-15 17:15:36 (星期五)
> > 收件人: dev@flink.apache.org
> > 抄送:
> > 主题: Re: Re: Discussion about enhancing the partitioned table syntax
> >
> > Hi, Jingsong
> >
> > Thanks for your reply, this FLIP [1] is good to me, I have not found it.
> The enhanced partition syntax in FLINK-27237 is a part of FLIP [1], there
> is no new added DDL/DMLs, so these syntax have been discussed and voted in
> community. This issue is continue to finish the work of syntax part in FLIP
> [1].
> >
> >
> > [1]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
> >
> > Best,
> >
> > Ron
> >
> > > -----原始邮件-----
> > > 发件人: "Jingsong Li" <ji...@gmail.com>
> > > 发送时间: 2022-04-15 16:02:37 (星期五)
> > > 收件人: dev <de...@flink.apache.org>
> > > 抄送:
> > > 主题: Re: Discussion about enhancing the partitioned table syntax
> > >
> > > Thanks for taking this.
> > >
> > > There is a FLIP [1] to define some partition DMLs.
> > >
> > > If you have added DMLs, we need to vote again. (Create a new FLIP)
> > >
> > > [1]
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
> > >
> > > Best,
> > > Jingsong
> > >
> > > On Fri, Apr 15, 2022 at 3:20 PM Martijn Visser <
> martijnvisser@apache.org> wrote:
> > > >
> > > > Hi Ron,
> > > >
> > > > Thanks for reaching out to the mailing list. As I mentioned in the
> Jira
> > > > ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a
> > > > discussion and a vote, which is explained in more detail in the Flink
> > > > Bylaws [2]
> > > >
> > > > Please create a FLIP and follow the process for this.
> > > >
> > > > Best regards,
> > > >
> > > > Martijn Visser
> > > > https://twitter.com/MartijnVisser82
> > > > https://github.com/MartijnVisser
> > > >
> > > > [1]
> > > >
> https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals
> > > > [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws
> > > >
> > > >
> > > >
> > > > On Fri, 15 Apr 2022 at 09:08, 刘大龙 <ld...@zju.edu.cn> wrote:
> > > >
> > > > > Hi, everyone
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > For partitioned table, there are still some related syntaxes that
> are not
> > > > > supported, which will be very useful for partitioned table. In
> batch
> > > > > analysis scenarios, such as Hive table, partitioned table is a
> very common
> > > > > case. Since the current Flink is mainly for streaming processing,
> not much
> > > > > work has been done on partitioned table. In order to enhance the
> experience
> > > > > of using Flink in batch job, as well as to improve the DDL syntax.
> So I
> > > > > created the issue FLINK-27237 to discuss about enhancing the
> partition
> > > > > table syntax. You are welcome to discuss on the issue and give
> comments so
> > > > > that this proposal can be improved.
> > > > >
> > > > > Best,
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Ron
>
Re: Re: Re: Discussion about enhancing the partitioned table syntax
Posted by 刘大龙 <ld...@zju.edu.cn>.
Hi，Martijn
Thanks for the Jingsong remind. This issue is the part of FLIP [1] which propose the related partition syntax, In our this issue, here no new added DDL/DMLs is introduced about partitioned table, so these syntax have been discussed and voted in community. I think we don't need a new FLIP.
[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
Best,
Ron
> -----原始邮件-----
> 发件人: "刘大龙" <ld...@zju.edu.cn>
> 发送时间: 2022-04-15 17:15:36 (星期五)
> 收件人: dev@flink.apache.org
> 抄送:
> 主题: Re: Re: Discussion about enhancing the partitioned table syntax
>
> Hi, Jingsong
>
> Thanks for your reply, this FLIP [1] is good to me, I have not found it. The enhanced partition syntax in FLINK-27237 is a part of FLIP [1], there is no new added DDL/DMLs, so these syntax have been discussed and voted in community. This issue is continue to finish the work of syntax part in FLIP [1].
>
>
> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
>
> Best,
>
> Ron
>
> > -----原始邮件-----
> > 发件人: "Jingsong Li" <ji...@gmail.com>
> > 发送时间: 2022-04-15 16:02:37 (星期五)
> > 收件人: dev <de...@flink.apache.org>
> > 抄送:
> > 主题: Re: Discussion about enhancing the partitioned table syntax
> >
> > Thanks for taking this.
> >
> > There is a FLIP [1] to define some partition DMLs.
> >
> > If you have added DMLs, we need to vote again. (Create a new FLIP)
> >
> > [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
> >
> > Best,
> > Jingsong
> >
> > On Fri, Apr 15, 2022 at 3:20 PM Martijn Visser <ma...@apache.org> wrote:
> > >
> > > Hi Ron,
> > >
> > > Thanks for reaching out to the mailing list. As I mentioned in the Jira
> > > ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a
> > > discussion and a vote, which is explained in more detail in the Flink
> > > Bylaws [2]
> > >
> > > Please create a FLIP and follow the process for this.
> > >
> > > Best regards,
> > >
> > > Martijn Visser
> > > https://twitter.com/MartijnVisser82
> > > https://github.com/MartijnVisser
> > >
> > > [1]
> > > https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals
> > > [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws
> > >
> > >
> > >
> > > On Fri, 15 Apr 2022 at 09:08, 刘大龙 <ld...@zju.edu.cn> wrote:
> > >
> > > > Hi, everyone
> > > >
> > > >
> > > >
> > > >
> > > > For partitioned table, there are still some related syntaxes that are not
> > > > supported, which will be very useful for partitioned table. In batch
> > > > analysis scenarios, such as Hive table, partitioned table is a very common
> > > > case. Since the current Flink is mainly for streaming processing, not much
> > > > work has been done on partitioned table. In order to enhance the experience
> > > > of using Flink in batch job, as well as to improve the DDL syntax. So I
> > > > created the issue FLINK-27237 to discuss about enhancing the partition
> > > > table syntax. You are welcome to discuss on the issue and give comments so
> > > > that this proposal can be improved.
> > > >
> > > > Best,
> > > >
> > > >
> > > >
> > > >
> > > > Ron
Re: Re: Discussion about enhancing the partitioned table syntax
Posted by 刘大龙 <ld...@zju.edu.cn>.
Hi, Jingsong
Thanks for your reply, this FLIP [1] is good to me, I have not found it. The enhanced partition syntax in FLINK-27237 is a part of FLIP [1], there is no new added DDL/DMLs, so these syntax have been discussed and voted in community. This issue is continue to finish the work of syntax part in FLIP [1].
[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
Best,
Ron
> -----原始邮件-----
> 发件人: "Jingsong Li" <ji...@gmail.com>
> 发送时间: 2022-04-15 16:02:37 (星期五)
> 收件人: dev <de...@flink.apache.org>
> 抄送:
> 主题: Re: Discussion about enhancing the partitioned table syntax
>
> Thanks for taking this.
>
> There is a FLIP [1] to define some partition DMLs.
>
> If you have added DMLs, we need to vote again. (Create a new FLIP)
>
> [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
>
> Best,
> Jingsong
>
> On Fri, Apr 15, 2022 at 3:20 PM Martijn Visser <ma...@apache.org> wrote:
> >
> > Hi Ron,
> >
> > Thanks for reaching out to the mailing list. As I mentioned in the Jira
> > ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a
> > discussion and a vote, which is explained in more detail in the Flink
> > Bylaws [2]
> >
> > Please create a FLIP and follow the process for this.
> >
> > Best regards,
> >
> > Martijn Visser
> > https://twitter.com/MartijnVisser82
> > https://github.com/MartijnVisser
> >
> > [1]
> > https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals
> > [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws
> >
> >
> >
> > On Fri, 15 Apr 2022 at 09:08, 刘大龙 <ld...@zju.edu.cn> wrote:
> >
> > > Hi, everyone
> > >
> > >
> > >
> > >
> > > For partitioned table, there are still some related syntaxes that are not
> > > supported, which will be very useful for partitioned table. In batch
> > > analysis scenarios, such as Hive table, partitioned table is a very common
> > > case. Since the current Flink is mainly for streaming processing, not much
> > > work has been done on partitioned table. In order to enhance the experience
> > > of using Flink in batch job, as well as to improve the DDL syntax. So I
> > > created the issue FLINK-27237 to discuss about enhancing the partition
> > > table syntax. You are welcome to discuss on the issue and give comments so
> > > that this proposal can be improved.
> > >
> > > Best,
> > >
> > >
> > >
> > >
> > > Ron
Re: Discussion about enhancing the partitioned table syntax
Posted by Jingsong Li <ji...@gmail.com>.
Thanks for taking this.
There is a FLIP [1] to define some partition DMLs.
If you have added DMLs, we need to vote again. (Create a new FLIP)
[1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support
Best,
Jingsong
On Fri, Apr 15, 2022 at 3:20 PM Martijn Visser <ma...@apache.org> wrote:
>
> Hi Ron,
>
> Thanks for reaching out to the mailing list. As I mentioned in the Jira
> ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a
> discussion and a vote, which is explained in more detail in the Flink
> Bylaws [2]
>
> Please create a FLIP and follow the process for this.
>
> Best regards,
>
> Martijn Visser
> https://twitter.com/MartijnVisser82
> https://github.com/MartijnVisser
>
> [1]
> https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals
> [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws
>
>
>
> On Fri, 15 Apr 2022 at 09:08, 刘大龙 <ld...@zju.edu.cn> wrote:
>
> > Hi, everyone
> >
> >
> >
> >
> > For partitioned table, there are still some related syntaxes that are not
> > supported, which will be very useful for partitioned table. In batch
> > analysis scenarios, such as Hive table, partitioned table is a very common
> > case. Since the current Flink is mainly for streaming processing, not much
> > work has been done on partitioned table. In order to enhance the experience
> > of using Flink in batch job, as well as to improve the DDL syntax. So I
> > created the issue FLINK-27237 to discuss about enhancing the partition
> > table syntax. You are welcome to discuss on the issue and give comments so
> > that this proposal can be improved.
> >
> > Best,
> >
> >
> >
> >
> > Ron
Re: Discussion about enhancing the partitioned table syntax
Posted by Martijn Visser <ma...@apache.org>.
Hi Ron,
Thanks for reaching out to the mailing list. As I mentioned in the Jira
ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a
discussion and a vote, which is explained in more detail in the Flink
Bylaws [2]
Please create a FLIP and follow the process for this.
Best regards,
Martijn Visser
https://twitter.com/MartijnVisser82
https://github.com/MartijnVisser
[1]
https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals
[2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws
On Fri, 15 Apr 2022 at 09:08, 刘大龙 <ld...@zju.edu.cn> wrote:
> Hi, everyone
>
>
>
>
> For partitioned table, there are still some related syntaxes that are not
> supported, which will be very useful for partitioned table. In batch
> analysis scenarios, such as Hive table, partitioned table is a very common
> case. Since the current Flink is mainly for streaming processing, not much
> work has been done on partitioned table. In order to enhance the experience
> of using Flink in batch job, as well as to improve the DDL syntax. So I
> created the issue FLINK-27237 to discuss about enhancing the partition
> table syntax. You are welcome to discuss on the issue and give comments so
> that this proposal can be improved.
>
> Best,
>
>
>
>
> Ron