You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Jean-Baptiste Onofré <jb...@nanthrax.net> on 2017/12/18 10:50:55 UTC
[INFO] Spark runner updated to Spark 2.2.1
Hi all,
We are pleased to announce that Spark 2.x support in Spark runner has been
merged this morning. It supports Spark 2.2.1.
In the same PR, we did update to Scala 2.11, including Flink artifacts update to
2.11 (it means it's already ready to upgrade to Flink 1.4 !).
It also means, as planned, that Spark 2.x support will be included in next Beam
2.3.0 release.
Now, we are going to work on improvements in the Spark runner.
If you have any issue with the Spark runner, please let us know.
Thanks !
Regards
JB
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Romain Manni-Bucau <rm...@gmail.com>.
Congrats, was waited for a long time! Very impatient to see the
announcement of the 2.3!
Romain Manni-Bucau
@rmannibucau <https://twitter.com/rmannibucau> | Blog
<https://rmannibucau.metawerx.net/> | Old Blog
<http://rmannibucau.wordpress.com> | Github <https://github.com/rmannibucau> |
LinkedIn <https://www.linkedin.com/in/rmannibucau>
2017-12-18 16:55 GMT+01:00 Jean-Baptiste Onofré <jb...@nanthrax.net>:
> By the way, Flink has been updated to Flink 1.4.0 as well (as the
> artifacts already used Scala 2.11).
>
> Regards
> JB
>
> On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
>
>> Hi all,
>>
>> We are pleased to announce that Spark 2.x support in Spark runner has
>> been merged this morning. It supports Spark 2.2.1.
>>
>> In the same PR, we did update to Scala 2.11, including Flink artifacts
>> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>>
>> It also means, as planned, that Spark 2.x support will be included in
>> next Beam 2.3.0 release.
>>
>> Now, we are going to work on improvements in the Spark runner.
>>
>> If you have any issue with the Spark runner, please let us know.
>>
>> Thanks !
>> Regards
>> JB
>>
>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Romain Manni-Bucau <rm...@gmail.com>.
Congrats, was waited for a long time! Very impatient to see the
announcement of the 2.3!
Romain Manni-Bucau
@rmannibucau <https://twitter.com/rmannibucau> | Blog
<https://rmannibucau.metawerx.net/> | Old Blog
<http://rmannibucau.wordpress.com> | Github <https://github.com/rmannibucau> |
LinkedIn <https://www.linkedin.com/in/rmannibucau>
2017-12-18 16:55 GMT+01:00 Jean-Baptiste Onofré <jb...@nanthrax.net>:
> By the way, Flink has been updated to Flink 1.4.0 as well (as the
> artifacts already used Scala 2.11).
>
> Regards
> JB
>
> On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
>
>> Hi all,
>>
>> We are pleased to announce that Spark 2.x support in Spark runner has
>> been merged this morning. It supports Spark 2.2.1.
>>
>> In the same PR, we did update to Scala 2.11, including Flink artifacts
>> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>>
>> It also means, as planned, that Spark 2.x support will be included in
>> next Beam 2.3.0 release.
>>
>> Now, we are going to work on improvements in the Spark runner.
>>
>> If you have any issue with the Spark runner, please let us know.
>>
>> Thanks !
>> Regards
>> JB
>>
>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
By the way, Flink has been updated to Flink 1.4.0 as well (as the artifacts
already used Scala 2.11).
Regards
JB
On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts update to
> 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next Beam
> 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Kenneth Knowles <kl...@google.com>.
Sweet!
On Mon, Dec 18, 2017 at 9:20 AM, Reuven Lax <re...@google.com> wrote:
> Very nice!
>
> On Mon, Dec 18, 2017 at 2:50 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
>> Hi all,
>>
>> We are pleased to announce that Spark 2.x support in Spark runner has
>> been merged this morning. It supports Spark 2.2.1.
>>
>> In the same PR, we did update to Scala 2.11, including Flink artifacts
>> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>>
>> It also means, as planned, that Spark 2.x support will be included in
>> next Beam 2.3.0 release.
>>
>> Now, we are going to work on improvements in the Spark runner.
>>
>> If you have any issue with the Spark runner, please let us know.
>>
>> Thanks !
>> Regards
>> JB
>> --
>> Jean-Baptiste Onofré
>> jbonofre@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
>
>
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Reuven Lax <re...@google.com>.
Very nice!
On Mon, Dec 18, 2017 at 2:50 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts
> update to 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next
> Beam 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Aviem Zur <av...@gmail.com>.
Nice!
On Mon, Dec 18, 2017 at 12:51 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts
> update to
> 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next
> Beam
> 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
By the way, Flink has been updated to Flink 1.4.0 as well (as the artifacts
already used Scala 2.11).
Regards
JB
On 12/18/2017 11:50 AM, Jean-Baptiste Onofré wrote:
> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts update to
> 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next Beam
> 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
--
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com
Re: [INFO] Spark runner updated to Spark 2.2.1
Posted by Aviem Zur <av...@gmail.com>.
Nice!
On Mon, Dec 18, 2017 at 12:51 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:
> Hi all,
>
> We are pleased to announce that Spark 2.x support in Spark runner has been
> merged this morning. It supports Spark 2.2.1.
>
> In the same PR, we did update to Scala 2.11, including Flink artifacts
> update to
> 2.11 (it means it's already ready to upgrade to Flink 1.4 !).
>
> It also means, as planned, that Spark 2.x support will be included in next
> Beam
> 2.3.0 release.
>
> Now, we are going to work on improvements in the Spark runner.
>
> If you have any issue with the Spark runner, please let us know.
>
> Thanks !
> Regards
> JB
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>