You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Esa Heikkinen <es...@student.tut.fi> on 2018/08/07 13:36:08 UTC
RE: FlinkCEP and scientific papers ?
There was one good example of pattern query in the paper made by SASE+ language (in attachment).
Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?
That SQL and CEP would also be very interesting, but when it is ready to use ?
BR Esa
From: vino yang <ya...@gmail.com>
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen <es...@student.tut.fi>
Cc: Till Rohrmann <tr...@apache.org>; Chesnay Schepler <ch...@apache.org>; user <us...@flink.apache.org>
Subject: Re: FlinkCEP and scientific papers ?
Hi Esa,
I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.
The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]
I think there is no newer paper related to current Flink CEP.
[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa
[2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP
Thanks, vino.
2018-07-23 16:05 GMT+08:00 Esa Heikkinen <es...@student.tut.fi>>:
Hi
Thank you. This was very good paper for me ☺
How much current FlinkCEP works like this (the paper was written 2008) ?
Are there exist newer papers related to current FlinkCEP ?
BR Esa
From: Till Rohrmann <tr...@apache.org>>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <ya...@gmail.com>>
Cc: Esa Heikkinen <es...@student.tut.fi>>; Chesnay Schepler <ch...@apache.org>>; user <us...@flink.apache.org>>
Subject: Re: FlinkCEP and scientific papers ?
You are right Vino,
the initial implementation was based on the above mentioned paper.
Cheers,
Till
On Tue, Jul 17, 2018 at 5:34 PM vino yang <ya...@gmail.com>> wrote:
Hi Esa,
AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:
1. NFA-b model on event stream
2. a shared versioned match buffer which is a optimized data structure
To Till and Chesnay:
Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.
[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf
Thanks, vino.
2018-07-17 22:01 GMT+08:00 Esa Heikkinen <es...@student.tut.fi>>:
Hi
I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?
I know Flink is based to Stratosphere, but how is it FlinkCEP ?
BR Esa
Re: FlinkCEP and scientific papers ?
Posted by Dawid Wysakowicz <dw...@apache.org>.
Hi Esa,
Flink 1.7 will come with an initial support for MATCH_RECOGNIZE clause
which integrates Flink CEP library with SQL.
You can find the documentation for that feature in the SNAPSHOT docs:
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/streaming/match_recognize.html
Best,
Dawid
On 28/11/2018 10:06, Esa Heikkinen wrote:
>
> Hi
>
>
>
> What is the situation of SQL/CEP ?
>
>
>
> Flink 1.7 is coming soon, but what about SQL/CEP ?
>
>
>
> Whether it already exists documentation of SQL/CEP ?
>
> Event better if there were scientific papers about it ?
>
>
>
> BR Esa
>
>
>
> *From:*Timo Walther <tw...@apache.org>
> *Sent:* Tuesday, August 7, 2018 4:52 PM
> *To:* user@flink.apache.org
> *Subject:* Re: FlinkCEP and scientific papers ?
>
>
>
> Hi Esa,
>
> the SQL/CEP integration might be part of Flink 1.7. The discussion has
> just been started again [1].
>
> Regards,
> Timo
>
> [1] https://issues.apache.org/jira/browse/FLINK-6935
>
> Am 07.08.18 um 15:36 schrieb Esa Heikkinen:
>
> There was one good example of pattern query in the paper made by
> SASE+ language (in attachment).
>
>
>
> Could you easily say how to do that FlickCEP with Scala ? Or is it
> possible ?
>
>
>
> That SQL and CEP would also be very interesting, but when it is
> ready to use ?
>
>
>
> BR Esa
>
>
>
> *From:*vino yang <ya...@gmail.com>
> <ma...@gmail.com>
> *Sent:* Monday, July 23, 2018 3:00 PM
> *To:* Esa Heikkinen <es...@student.tut.fi>
> <ma...@student.tut.fi>
> *Cc:* Till Rohrmann <tr...@apache.org>
> <ma...@apache.org>; Chesnay Schepler
> <ch...@apache.org> <ma...@apache.org>; user
> <us...@flink.apache.org> <ma...@flink.apache.org>
> *Subject:* Re: FlinkCEP and scientific papers ?
>
>
>
> Hi Esa,
>
>
>
> I think the core implementation pattern is still based that paper,
> there is a package named "nfa"[1] contains the main thought.
>
>
>
> The latest CEP module added more features and enhanced the old
> versio. What's more, there is a FLIP-20 which has been accepted,
> it described how to integrate with SQL and CEP.[2]
>
>
>
> I think there is no newer paper related to current Flink CEP.
>
>
>
> [1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa
>
> [2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP
>
>
>
> Thanks, vino.
>
>
>
>
>
> 2018-07-23 16:05 GMT+08:00 Esa Heikkinen
> <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>>:
>
> Hi
>
>
>
> Thank you. This was very good paper for me J
>
>
>
> How much current FlinkCEP works like this (the paper was
> written 2008) ?
>
>
>
> Are there exist newer papers related to current FlinkCEP ?
>
>
>
> BR Esa
>
>
>
> *From:*Till Rohrmann <trohrmann@apache.org
> <ma...@apache.org>>
> *Sent:* Wednesday, July 18, 2018 9:38 AM
> *To:* vino yang <yanghua1127@gmail.com
> <ma...@gmail.com>>
> *Cc:* Esa Heikkinen <esa.heikkinen@student.tut.fi
> <ma...@student.tut.fi>>; Chesnay Schepler
> <chesnay@apache.org <ma...@apache.org>>; user
> <user@flink.apache.org <ma...@flink.apache.org>>
> *Subject:* Re: FlinkCEP and scientific papers ?
>
>
>
> You are right Vino,
>
>
>
> the initial implementation was based on the above mentioned paper.
>
>
>
> Cheers,
>
> Till
>
>
>
> On Tue, Jul 17, 2018 at 5:34 PM vino yang
> <yanghua1127@gmail.com <ma...@gmail.com>> wrote:
>
> Hi Esa,
>
>
>
> AFAIK, the earlier Flink CEP refers to the Paper
> 《Efficient Pattern Matching over Event Streams》[1]. Flink
> absorbed two major idea from this paper:
>
>
>
> 1. NFA-b model on event stream
>
> 2. a shared versioned match buffer which is a optimized
> data structure
>
>
>
> To Till and Chesnay:
>
>
>
> Did I missed anything when as time goes on and the
> development of Flink? If yes, please give your additional
> remarks.
>
>
>
> [1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf
> <https://people.cs.umass.edu/%7Eyanlei/publications/sase-sigmod08.pdf>
>
>
>
> Thanks, vino.
>
>
>
> 2018-07-17 22:01 GMT+08:00 Esa Heikkinen
> <esa.heikkinen@student.tut.fi
> <ma...@student.tut.fi>>:
>
> Hi
>
>
>
> I don’t know this the correct forum to ask, but are
> there exist some good scientific papers about FlinkCEP
> (Complex Event Processing) ?
>
>
>
> I know Flink is based to Stratosphere, but how is it
> FlinkCEP ?
>
>
>
> BR Esa
>
>
>
>
>
>
>
RE: FlinkCEP and scientific papers ?
Posted by Esa Heikkinen <es...@student.tut.fi>.
Hi
What is the situation of SQL/CEP ?
Flink 1.7 is coming soon, but what about SQL/CEP ?
Whether it already exists documentation of SQL/CEP ?
Event better if there were scientific papers about it ?
BR Esa
From: Timo Walther <tw...@apache.org>
Sent: Tuesday, August 7, 2018 4:52 PM
To: user@flink.apache.org
Subject: Re: FlinkCEP and scientific papers ?
Hi Esa,
the SQL/CEP integration might be part of Flink 1.7. The discussion has just been started again [1].
Regards,
Timo
[1] https://issues.apache.org/jira/browse/FLINK-6935
Am 07.08.18 um 15:36 schrieb Esa Heikkinen:
There was one good example of pattern query in the paper made by SASE+ language (in attachment).
Could you easily say how to do that FlickCEP with Scala ? Or is it possible ?
That SQL and CEP would also be very interesting, but when it is ready to use ?
BR Esa
From: vino yang <ya...@gmail.com>
Sent: Monday, July 23, 2018 3:00 PM
To: Esa Heikkinen <es...@student.tut.fi>
Cc: Till Rohrmann <tr...@apache.org>; Chesnay Schepler <ch...@apache.org>; user <us...@flink.apache.org>
Subject: Re: FlinkCEP and scientific papers ?
Hi Esa,
I think the core implementation pattern is still based that paper, there is a package named "nfa"[1] contains the main thought.
The latest CEP module added more features and enhanced the old versio. What's more, there is a FLIP-20 which has been accepted, it described how to integrate with SQL and CEP.[2]
I think there is no newer paper related to current Flink CEP.
[1]: https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa
[2]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP
Thanks, vino.
2018-07-23 16:05 GMT+08:00 Esa Heikkinen <es...@student.tut.fi>>:
Hi
Thank you. This was very good paper for me ☺
How much current FlinkCEP works like this (the paper was written 2008) ?
Are there exist newer papers related to current FlinkCEP ?
BR Esa
From: Till Rohrmann <tr...@apache.org>>
Sent: Wednesday, July 18, 2018 9:38 AM
To: vino yang <ya...@gmail.com>>
Cc: Esa Heikkinen <es...@student.tut.fi>>; Chesnay Schepler <ch...@apache.org>>; user <us...@flink.apache.org>>
Subject: Re: FlinkCEP and scientific papers ?
You are right Vino,
the initial implementation was based on the above mentioned paper.
Cheers,
Till
On Tue, Jul 17, 2018 at 5:34 PM vino yang <ya...@gmail.com>> wrote:
Hi Esa,
AFAIK, the earlier Flink CEP refers to the Paper 《Efficient Pattern Matching over Event Streams》[1]. Flink absorbed two major idea from this paper:
1. NFA-b model on event stream
2. a shared versioned match buffer which is a optimized data structure
To Till and Chesnay:
Did I missed anything when as time goes on and the development of Flink? If yes, please give your additional remarks.
[1]: https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf<https://people.cs.umass.edu/%7Eyanlei/publications/sase-sigmod08.pdf>
Thanks, vino.
2018-07-17 22:01 GMT+08:00 Esa Heikkinen <es...@student.tut.fi>>:
Hi
I don’t know this the correct forum to ask, but are there exist some good scientific papers about FlinkCEP (Complex Event Processing) ?
I know Flink is based to Stratosphere, but how is it FlinkCEP ?
BR Esa
Re: FlinkCEP and scientific papers ?
Posted by Timo Walther <tw...@apache.org>.
Hi Esa,
the SQL/CEP integration might be part of Flink 1.7. The discussion has
just been started again [1].
Regards,
Timo
[1] https://issues.apache.org/jira/browse/FLINK-6935
Am 07.08.18 um 15:36 schrieb Esa Heikkinen:
>
> There was one good example of pattern query in the paper made by SASE+
> language (in attachment).
>
> Could you easily say how to do that FlickCEP with Scala ? Or is it
> possible ?
>
> That SQL and CEP would also be very interesting, but when it is ready
> to use ?
>
> BR Esa
>
> *From:*vino yang <ya...@gmail.com>
> *Sent:* Monday, July 23, 2018 3:00 PM
> *To:* Esa Heikkinen <es...@student.tut.fi>
> *Cc:* Till Rohrmann <tr...@apache.org>; Chesnay Schepler
> <ch...@apache.org>; user <us...@flink.apache.org>
> *Subject:* Re: FlinkCEP and scientific papers ?
>
> Hi Esa,
>
> I think the core implementation pattern is still based that paper,
> there is a package named "nfa"[1] contains the main thought.
>
> The latest CEP module added more features and enhanced the old versio.
> What's more, there is a FLIP-20 which has been accepted, it described
> how to integrate with SQL and CEP.[2]
>
> I think there is no newer paper related to current Flink CEP.
>
> [1]:
> https://github.com/apache/flink/tree/master/flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/nfa
>
> [2]:
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-20:+Integration+of+SQL+and+CEP
>
> Thanks, vino.
>
> 2018-07-23 16:05 GMT+08:00 Esa Heikkinen <esa.heikkinen@student.tut.fi
> <ma...@student.tut.fi>>:
>
> Hi
>
> Thank you. This was very good paper for me J
>
> How much current FlinkCEP works like this (the paper was written
> 2008) ?
>
> Are there exist newer papers related to current FlinkCEP ?
>
> BR Esa
>
> *From:*Till Rohrmann <trohrmann@apache.org
> <ma...@apache.org>>
> *Sent:* Wednesday, July 18, 2018 9:38 AM
> *To:* vino yang <yanghua1127@gmail.com <ma...@gmail.com>>
> *Cc:* Esa Heikkinen <esa.heikkinen@student.tut.fi
> <ma...@student.tut.fi>>; Chesnay Schepler
> <chesnay@apache.org <ma...@apache.org>>; user
> <user@flink.apache.org <ma...@flink.apache.org>>
> *Subject:* Re: FlinkCEP and scientific papers ?
>
> You are right Vino,
>
> the initial implementation was based on the above mentioned paper.
>
> Cheers,
>
> Till
>
> On Tue, Jul 17, 2018 at 5:34 PM vino yang <yanghua1127@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hi Esa,
>
> AFAIK, the earlier Flink CEP refers to the Paper 《Efficient
> Pattern Matching over Event Streams》[1]. Flink absorbed two
> major idea from this paper:
>
> 1. NFA-b model on event stream
>
> 2. a shared versioned match buffer which is a optimized data
> structure
>
> To Till and Chesnay:
>
> Did I missed anything when as time goes on and the development
> of Flink? If yes, please give your additional remarks.
>
> [1]:
> https://people.cs.umass.edu/~yanlei/publications/sase-sigmod08.pdf
> <https://people.cs.umass.edu/%7Eyanlei/publications/sase-sigmod08.pdf>
>
> Thanks, vino.
>
> 2018-07-17 22:01 GMT+08:00 Esa Heikkinen
> <esa.heikkinen@student.tut.fi
> <ma...@student.tut.fi>>:
>
> Hi
>
> I don’t know this the correct forum to ask, but are there
> exist some good scientific papers about FlinkCEP (Complex
> Event Processing) ?
>
> I know Flink is based to Stratosphere, but how is it
> FlinkCEP ?
>
> BR Esa
>