Using custom evictor and trigger on Table API

[eastcirclek <ea...@gmail.com>]

Hi all,

I’m looking into Table API for my new project.
It looks like a sweet spot between DataStream API/SQL.

However, it doesn’t seem like the expressivity of Table API equals to that of DataStream API.

My previous Flink projects were building simple pipelines using DataStream API with custom evictor (FF Berlin 17) and custom trigger (FF Berlin 18).
I believe these pipelines can be expressed with Table API/UDF/UDAF except the custom windowing components.

Do I have no way but to change the table into DataStream to use the custom components at the moment?

Best,
- Dongwon

Re: Using custom evictor and trigger on Table API

[Rong Rong <wa...@gmail.com>]

Hi Dongwon,

There was a previous thread regarding this[1], unfortunately this is not
supported yet.

However there are some latest development proposal[2,3] to enhance the
TableAPI which might be able to support your use case.

--
Rong

[1]
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Table-API-custom-window-td22199.html
[2]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Table-API-Enhancement-Outline-td25070.html
[3]
http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Enhancing-the-functionality-and-productivity-of-Table-API-td24963i20.html

On Wed, Feb 6, 2019 at 4:14 AM eastcirclek <ea...@gmail.com> wrote:

> Hi all,
>
> I’m looking into Table API for my new project.
> It looks like a sweet spot between DataStream API/SQL.
>
> However, it doesn’t seem like the expressivity of Table API equals to that
> of DataStream API.
>
> My previous Flink projects were building simple pipelines using DataStream
> API with custom evictor (FF Berlin 17) and custom trigger (FF Berlin 18).
> I believe these pipelines can be expressed with Table API/UDF/UDAF except
> the custom windowing components.
>
> Do I have no way but to change the table into DataStream to use the custom
> components at the moment?
>
> Best,
> - Dongwon
>
>