You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Esa Heikkinen <es...@student.tut.fi> on 2018/02/13 12:21:52 UTC
Python and Scala
What the difference is to use Python and Scala in Flink ?
Can I do all the same things with Python and Scala ? For examples CEP with files.
Re: Python and Scala
Posted by Piotr Nowojski <pi...@data-artisans.com>.
Hi,
I have never used it before, but it’s described in the documentation:
https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/scala_shell.html <https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/scala_shell.html>
the "Adding external dependencies” part. It should answer to this question.
Piotrek
> On 14 Feb 2018, at 10:15, Esa Heikkinen <es...@student.tut.fi> wrote:
>
> Hi
>
> Good news. Is it way to supply Scala-code from file to REPL ?
>
> It seems the compiling is too complicated operation.. Actually I don’t get it to work yet.
>
> Esa
>
> From: Piotr Nowojski [mailto:piotr@data-artisans.com]
> Sent: Wednesday, February 14, 2018 10:55 AM
> To: Esa Heikkinen <es...@student.tut.fi>
> Cc: Esa Heikkinen <es...@student.tut.fi>; user@flink.apache.org
> Subject: Re: Python and Scala
>
> Hi
>
> Scala REPL uses the same code as compiled library so they should work the same.
>
> Piotrek
>
>
> On 13 Feb 2018, at 18:32, Esa Heikkinen <heikkin2@student.tut.fi <ma...@student.tut.fi>> wrote:
>
> Hi
> And what about the differences between Scala REPL and Scala (compiled) ?
> Esa
>
> Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:
> Hi,
>
> 1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.
> 2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886 <https://issues.apache.org/jira/browse/FLINK-5886>
> 3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream <https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream>
>
> Piotrek
>
>
> On 13 Feb 2018, at 13:21, Esa Heikkinen <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>> wrote:
>
>
> What the difference is to use Python and Scala in Flink ?
> Can I do all the same things with Python and Scala ? For examples CEP with files.
RE: Python and Scala
Posted by Esa Heikkinen <es...@student.tut.fi>.
Hi
Good news. Is it way to supply Scala-code from file to REPL ?
It seems the compiling is too complicated operation.. Actually I don’t get it to work yet.
Esa
From: Piotr Nowojski [mailto:piotr@data-artisans.com]
Sent: Wednesday, February 14, 2018 10:55 AM
To: Esa Heikkinen <es...@student.tut.fi>
Cc: Esa Heikkinen <es...@student.tut.fi>; user@flink.apache.org
Subject: Re: Python and Scala
Hi
Scala REPL uses the same code as compiled library so they should work the same.
Piotrek
On 13 Feb 2018, at 18:32, Esa Heikkinen <he...@student.tut.fi>> wrote:
Hi
And what about the differences between Scala REPL and Scala (compiled) ?
Esa
Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:
Hi,
1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.
2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886
3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream
Piotrek
On 13 Feb 2018, at 13:21, Esa Heikkinen <es...@student.tut.fi>> wrote:
What the difference is to use Python and Scala in Flink ?
Can I do all the same things with Python and Scala ? For examples CEP with files.
Re: Python and Scala
Posted by Piotr Nowojski <pi...@data-artisans.com>.
Hi
Scala REPL uses the same code as compiled library so they should work the same.
Piotrek
> On 13 Feb 2018, at 18:32, Esa Heikkinen <he...@student.tut.fi> wrote:
>
> Hi
>
> And what about the differences between Scala REPL and Scala (compiled) ?
> Esa
>
> Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:
>> Hi,
>>
>> 1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.
>> 2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886 <https://issues.apache.org/jira/browse/FLINK-5886>
>> 3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream <https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream>
>>
>> Piotrek
>>
>>> On 13 Feb 2018, at 13:21, Esa Heikkinen <esa.heikkinen@student.tut.fi <ma...@student.tut.fi>> wrote:
>>>
>>>
>>> What the difference is to use Python and Scala in Flink ?
>>> Can I do all the same things with Python and Scala ? For examples CEP with files.
>>
>
Re: Python and Scala
Posted by Esa Heikkinen <he...@student.tut.fi>.
Hi
And what about the differences between Scala REPL and Scala (compiled) ?
Esa
Piotr Nowojski kirjoitti 13.2.2018 klo 15:14:
> Hi,
>
> 1. Flink’s Python Batch API is not complete and it’s not on pair with
> Scala.
> 2. As for know there is no Python API for Flink Streaming, however
> there is some ongoing work with that:
> https://issues.apache.org/jira/browse/FLINK-5886
> 3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming
> for that:
> https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream
>
> Piotrek
>
>> On 13 Feb 2018, at 13:21, Esa Heikkinen <esa.heikkinen@student.tut.fi
>> <ma...@student.tut.fi>> wrote:
>>
>> What the difference is to use Python and Scala in Flink ?
>> Can I do all the same things with Python and Scala ? For examples CEP
>> with files.
>
Re: Python and Scala
Posted by Piotr Nowojski <pi...@data-artisans.com>.
Hi,
1. Flink’s Python Batch API is not complete and it’s not on pair with Scala.
2. As for know there is no Python API for Flink Streaming, however there is some ongoing work with that: https://issues.apache.org/jira/browse/FLINK-5886 <https://issues.apache.org/jira/browse/FLINK-5886>
3. CEP doesn’t work with Flink Batch, you have to use Flink Streaming for that: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream <https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/api_concepts.html#dataset-and-datastream>
Piotrek
> On 13 Feb 2018, at 13:21, Esa Heikkinen <es...@student.tut.fi> wrote:
>
>
> What the difference is to use Python and Scala in Flink ?
> Can I do all the same things with Python and Scala ? For examples CEP with files.