You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Esa Heikkinen <es...@student.tut.fi> on 2018/03/07 10:32:55 UTC
Simple CEP pattern
What would be the simplest working CEP (Scala) pattern ?
I want to test if my CEP application works at all.
Best, Esa
Re: Simple CEP pattern
Posted by Kostas Kloudas <k....@data-artisans.com>.
Hi,
You can adjust it to see if your pattern works.
I thought that this is what you want to do.
If you want to run it on a cluster or run a full job, then
the best way is actually do that. Write the job using the quickstart,
launch a cluster locally using the start-cluster.sh script, submit the job,
and check out its progress though the webmonitor.
There you also have access to the individual TaskManager and JobManager
logs, in case something goes wrong.
Cheers,
Kostas
> On Mar 7, 2018, at 3:44 PM, Esa Heikkinen <es...@student.tut.fi> wrote:
>
> Hi
>
> Yes I have access to the flink source code, but could you explain little bit more what to do with it in this case ?
>
> Best, Esa
>
> From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com]
> Sent: Wednesday, March 7, 2018 3:51 PM
> To: Esa Heikkinen <es...@student.tut.fi>
> Cc: user@flink.apache.org
> Subject: Re: Simple CEP pattern
>
> Hi Esa,
>
> You can always test your pattern in isolation.
> For an example on how to do that, if you have access to the flink source code,
> you can check the UntilConditionITCase or any other ITCase in the same package.
>
> It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java <https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java>
>
> Kostas
>
>
> On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>> wrote:
>
> Hi
>
> I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
>
> It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
> It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
>
> Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ?
>
> Best, Esa
>
> From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com <ma...@data-artisans.com>]
> Sent: Wednesday, March 7, 2018 2:54 PM
> To: Esa Heikkinen <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>>
> Cc: user@flink.apache.org <ma...@flink.apache.org>
> Subject: Re: Simple CEP pattern
>
> Hi Esa,
>
> You could try the examples either from the documentation or from the training.
> http://training.data-artisans.com/exercises/CEP.html <http://training.data-artisans.com/exercises/CEP.html>
>
> Kostas
>
>
> On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>> wrote:
>
> What would be the simplest working CEP (Scala) pattern ?
>
> I want to test if my CEP application works at all.
>
> Best, Esa
RE: Simple CEP pattern
Posted by Esa Heikkinen <es...@student.tut.fi>.
Hi
Yes I have access to the flink source code, but could you explain little bit more what to do with it in this case ?
Best, Esa
From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com]
Sent: Wednesday, March 7, 2018 3:51 PM
To: Esa Heikkinen <es...@student.tut.fi>
Cc: user@flink.apache.org
Subject: Re: Simple CEP pattern
Hi Esa,
You can always test your pattern in isolation.
For an example on how to do that, if you have access to the flink source code,
you can check the UntilConditionITCase or any other ITCase in the same package.
It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java
Kostas
On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <es...@student.tut.fi>> wrote:
Hi
I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ?
Best, Esa
From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com]
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <es...@student.tut.fi>>
Cc: user@flink.apache.org<ma...@flink.apache.org>
Subject: Re: Simple CEP pattern
Hi Esa,
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html
Kostas
On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <es...@student.tut.fi>> wrote:
What would be the simplest working CEP (Scala) pattern ?
I want to test if my CEP application works at all.
Best, Esa
Re: Simple CEP pattern
Posted by Kostas Kloudas <k....@data-artisans.com>.
Hi Esa,
You can always test your pattern in isolation.
For an example on how to do that, if you have access to the flink source code,
you can check the UntilConditionITCase or any other ITCase in the same package.
It can also be found here: https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java <https://github.com/apache/flink/blob/master/flink-libraries/flink-cep/src/test/java/org/apache/flink/cep/nfa/UntilConditionITCase.java>
Kostas
> On Mar 7, 2018, at 2:43 PM, Esa Heikkinen <es...@student.tut.fi> wrote:
>
> Hi
>
> I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple “Hello World” type example about Flink’s CEP.
>
> It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
> It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
>
> Often I don’t know is it problem with “pattern” or “select”, because no results.. Is there any way to debug CEP’s operations ?
>
> Best, Esa
>
> From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com]
> Sent: Wednesday, March 7, 2018 2:54 PM
> To: Esa Heikkinen <es...@student.tut.fi>
> Cc: user@flink.apache.org
> Subject: Re: Simple CEP pattern
>
> Hi Esa,
>
> You could try the examples either from the documentation or from the training.
> http://training.data-artisans.com/exercises/CEP.html
>
> Kostas
>
>
> On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <es...@student.tut.fi> wrote:
>
> What would be the simplest working CEP (Scala) pattern ?
>
> I want to test if my CEP application works at all.
>
> Best, Esa
RE: Simple CEP pattern
Posted by Esa Heikkinen <es...@student.tut.fi>.
Hi
I have tried this CEP example of Data-artisans and it works. It is also only fully working example I have found, but it little bit too complex for my purpose. I have also tried to read the documentation, but I have not found about simple "Hello World" type example about Flink's CEP.
It is surprisingly difficult to form correct Pattern, because there are many operators and how to combine them by correct way..
It looks like very simple, but in practice it has not been for me, but this maybe because I am new with FlinkCEP.
Often I don't know is it problem with "pattern" or "select", because no results.. Is there any way to debug CEP's operations ?
Best, Esa
From: Kostas Kloudas [mailto:k.kloudas@data-artisans.com]
Sent: Wednesday, March 7, 2018 2:54 PM
To: Esa Heikkinen <es...@student.tut.fi>
Cc: user@flink.apache.org
Subject: Re: Simple CEP pattern
Hi Esa,
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html
Kostas
On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <es...@student.tut.fi>> wrote:
What would be the simplest working CEP (Scala) pattern ?
I want to test if my CEP application works at all.
Best, Esa
Re: Simple CEP pattern
Posted by Kostas Kloudas <k....@data-artisans.com>.
Hi Esa,
You could try the examples either from the documentation or from the training.
http://training.data-artisans.com/exercises/CEP.html <http://training.data-artisans.com/exercises/CEP.html>
Kostas
> On Mar 7, 2018, at 11:32 AM, Esa Heikkinen <es...@student.tut.fi> wrote:
>
> What would be the simplest working CEP (Scala) pattern ?
>
> I want to test if my CEP application works at all.
>
> Best, Esa