You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Yin Huai <yh...@databricks.com> on 2016/12/29 16:02:59 UTC
[ANNOUNCE] Announcing Apache Spark 2.1.0
Hi all,
Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
makes significant strides in the production readiness of Structured
Streaming, with added support for event time watermarks
<https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
and Kafka 0.10 support
<https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
In addition, this release focuses more on usability, stability, and polish,
resolving over 1200 tickets.
We'd like to thank our contributors and users for their contributions and
early feedback to this release. This release would not have been possible
without you.
To download Spark 2.1.0, head over to the download page:
http://spark.apache.org/downloads.html
To view the release notes:
https://spark.apache.org/releases/spark-release-2-1-0.html
(note: If you see any issues with the release notes, webpage or published
artifacts, please contact me directly off-list)
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by 冯俊峰 <ju...@gmail.com>.
Congratulations! Will try this out.
On Thu, Dec 29, 2016 at 11:03 Yin Huai <yh...@databricks.com> wrote:
Hi all,
Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
makes significant strides in the production readiness of Structured
Streaming, with added support for event time watermarks
<https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
and Kafka 0.10 support
<https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
In addition, this release focuses more on usability, stability, and polish,
resolving over 1200 tickets.
We'd like to thank our contributors and users for their contributions and
early feedback to this release. This release would not have been possible
without you.
To download Spark 2.1.0, head over to the download page:
http://spark.apache.org/downloads.html
To view the release notes:
https://spark.apache.org/releases/spark-release-2-1-0.html
(note: If you see any issues with the release notes, webpage or published
artifacts, please contact me directly off-list)
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
if there is no objection, I will push patch in JIRA
https://issues.apache.org/jira/browse/BIGTOP-2653 by the end of
today (in 12 hrs)
On Sun, Jan 1, 2017 at 6:39 PM, MrAsanjar . <af...@gmail.com> wrote:
> Built the entire stack using spark 2.1 on ubuntu 16.04 without any
> failure. Going to submit a patch shortly.
>
> On Dec 31, 2016 4:45 AM, "Evans Ye" <ev...@apache.org> wrote:
>
>> +1
>> Spark 2.1 is more stable for production. Would be better to be included in
>> 1.2 release.
>>
>> MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
>>
>> > working on it..
>> >
>> >
>> >
>> > On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <
>> roman@shaposhnik.org>
>> >
>> > wrote:
>> >
>> >
>> >
>> > > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com>
>> wrote:
>> >
>> > > > team,
>> >
>> > > > It appears there have been many fixes and enhancement gone into
>> spark
>> >
>> > > 2.1,
>> >
>> > > > specially adding Kafka 0.10.support.
>> >
>> > > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>> >
>> > >
>> >
>> > > Seems like an good idea. Especially if the upgrade won't be painful.
>> Any
>> >
>> > > chance
>> >
>> > > you can run a build of the entire stack with this new Spark version
>> >
>> > > and report back?
>> >
>> > >
>> >
>> > > Thanks,
>> >
>> > > Roman.
>> >
>> > >
>> >
>> >
>>
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
Built the entire stack using spark 2.1 on ubuntu 16.04 without any failure.
Going to submit a patch shortly.
On Dec 31, 2016 4:45 AM, "Evans Ye" <ev...@apache.org> wrote:
> +1
> Spark 2.1 is more stable for production. Would be better to be included in
> 1.2 release.
>
> MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
>
> > working on it..
> >
> >
> >
> > On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <roman@shaposhnik.org
> >
> >
> > wrote:
> >
> >
> >
> > > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com>
> wrote:
> >
> > > > team,
> >
> > > > It appears there have been many fixes and enhancement gone into spark
> >
> > > 2.1,
> >
> > > > specially adding Kafka 0.10.support.
> >
> > > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
> >
> > >
> >
> > > Seems like an good idea. Especially if the upgrade won't be painful.
> Any
> >
> > > chance
> >
> > > you can run a build of the entire stack with this new Spark version
> >
> > > and report back?
> >
> > >
> >
> > > Thanks,
> >
> > > Roman.
> >
> > >
> >
> >
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Evans Ye <ev...@apache.org>.
+1
Spark 2.1 is more stable for production. Would be better to be included in
1.2 release.
MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
> working on it..
>
>
>
> On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <ro...@shaposhnik.org>
>
> wrote:
>
>
>
> > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
>
> > > team,
>
> > > It appears there have been many fixes and enhancement gone into spark
>
> > 2.1,
>
> > > specially adding Kafka 0.10.support.
>
> > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>
> >
>
> > Seems like an good idea. Especially if the upgrade won't be painful. Any
>
> > chance
>
> > you can run a build of the entire stack with this new Spark version
>
> > and report back?
>
> >
>
> > Thanks,
>
> > Roman.
>
> >
>
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
working on it..
On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
> > team,
> > It appears there have been many fixes and enhancement gone into spark
> 2.1,
> > specially adding Kafka 0.10.support.
> > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>
> Seems like an good idea. Especially if the upgrade won't be painful. Any
> chance
> you can run a build of the entire stack with this new Spark version
> and report back?
>
> Thanks,
> Roman.
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
> team,
> It appears there have been many fixes and enhancement gone into spark 2.1,
> specially adding Kafka 0.10.support.
> I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
Seems like an good idea. Especially if the upgrade won't be painful. Any chance
you can run a build of the entire stack with this new Spark version
and report back?
Thanks,
Roman.
Fwd: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
team,
It appears there have been many fixes and enhancement gone into spark 2.1,
specially adding Kafka 0.10.support.
I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
---------- Forwarded message ----------
From: Yin Huai <yh...@databricks.com>
Date: Thu, Dec 29, 2016 at 10:02 AM
Subject: [ANNOUNCE] Announcing Apache Spark 2.1.0
To: "dev@spark.apache.org" <de...@spark.apache.org>, user <
user@spark.apache.org>
Hi all,
Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
makes significant strides in the production readiness of Structured
Streaming, with added support for event time watermarks
<https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
and Kafka 0.10 support
<https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
In addition, this release focuses more on usability, stability, and polish,
resolving over 1200 tickets.
We'd like to thank our contributors and users for their contributions and
early feedback to this release. This release would not have been possible
without you.
To download Spark 2.1.0, head over to the download page:
http://spark.apache.org/downloads.html
To view the release notes: https://spark.apache.
org/releases/spark-release-2-1-0.html
(note: If you see any issues with the release notes, webpage or published
artifacts, please contact me directly off-list)
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Yin Huai <yh...@databricks.com>.
Hello Jacek,
Actually, Reynold is still the release manager and I am just sending this
message for him :) Sorry. I should have made it clear in my original email.
Thanks,
Yin
On Thu, Dec 29, 2016 at 10:58 AM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi Yan,
>
> I've been surprised the first time when I noticed rxin stepped back and a
> new release manager stepped in. Congrats on your first ANNOUNCE!
>
> I can only expect even more great stuff coming in to Spark from the dev
> team after Reynold spared some time 😉
>
> Can't wait to read the changes...
>
> Jacek
>
> On 29 Dec 2016 5:03 p.m., "Yin Huai" <yh...@databricks.com> wrote:
>
>> Hi all,
>>
>> Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
>> makes significant strides in the production readiness of Structured
>> Streaming, with added support for event time watermarks
>> <https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
>> and Kafka 0.10 support
>> <https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
>> In addition, this release focuses more on usability, stability, and polish,
>> resolving over 1200 tickets.
>>
>> We'd like to thank our contributors and users for their contributions and
>> early feedback to this release. This release would not have been possible
>> without you.
>>
>> To download Spark 2.1.0, head over to the download page:
>> http://spark.apache.org/downloads.html
>>
>> To view the release notes: https://spark.apache.or
>> g/releases/spark-release-2-1-0.html
>>
>> (note: If you see any issues with the release notes, webpage or published
>> artifacts, please contact me directly off-list)
>>
>>
>>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Yin Huai <yh...@databricks.com>.
Hello Jacek,
Actually, Reynold is still the release manager and I am just sending this
message for him :) Sorry. I should have made it clear in my original email.
Thanks,
Yin
On Thu, Dec 29, 2016 at 10:58 AM, Jacek Laskowski <ja...@japila.pl> wrote:
> Hi Yan,
>
> I've been surprised the first time when I noticed rxin stepped back and a
> new release manager stepped in. Congrats on your first ANNOUNCE!
>
> I can only expect even more great stuff coming in to Spark from the dev
> team after Reynold spared some time 😉
>
> Can't wait to read the changes...
>
> Jacek
>
> On 29 Dec 2016 5:03 p.m., "Yin Huai" <yh...@databricks.com> wrote:
>
>> Hi all,
>>
>> Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
>> makes significant strides in the production readiness of Structured
>> Streaming, with added support for event time watermarks
>> <https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
>> and Kafka 0.10 support
>> <https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
>> In addition, this release focuses more on usability, stability, and polish,
>> resolving over 1200 tickets.
>>
>> We'd like to thank our contributors and users for their contributions and
>> early feedback to this release. This release would not have been possible
>> without you.
>>
>> To download Spark 2.1.0, head over to the download page:
>> http://spark.apache.org/downloads.html
>>
>> To view the release notes: https://spark.apache.or
>> g/releases/spark-release-2-1-0.html
>>
>> (note: If you see any issues with the release notes, webpage or published
>> artifacts, please contact me directly off-list)
>>
>>
>>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi Yan,
I've been surprised the first time when I noticed rxin stepped back and a
new release manager stepped in. Congrats on your first ANNOUNCE!
I can only expect even more great stuff coming in to Spark from the dev
team after Reynold spared some time 😉
Can't wait to read the changes...
Jacek
On 29 Dec 2016 5:03 p.m., "Yin Huai" <yh...@databricks.com> wrote:
> Hi all,
>
> Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
> makes significant strides in the production readiness of Structured
> Streaming, with added support for event time watermarks
> <https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
> and Kafka 0.10 support
> <https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
> In addition, this release focuses more on usability, stability, and polish,
> resolving over 1200 tickets.
>
> We'd like to thank our contributors and users for their contributions and
> early feedback to this release. This release would not have been possible
> without you.
>
> To download Spark 2.1.0, head over to the download page:
> http://spark.apache.org/downloads.html
>
> To view the release notes: https://spark.apache.
> org/releases/spark-release-2-1-0.html
>
> (note: If you see any issues with the release notes, webpage or published
> artifacts, please contact me directly off-list)
>
>
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Jacek Laskowski <ja...@japila.pl>.
Hi Yan,
I've been surprised the first time when I noticed rxin stepped back and a
new release manager stepped in. Congrats on your first ANNOUNCE!
I can only expect even more great stuff coming in to Spark from the dev
team after Reynold spared some time 😉
Can't wait to read the changes...
Jacek
On 29 Dec 2016 5:03 p.m., "Yin Huai" <yh...@databricks.com> wrote:
> Hi all,
>
> Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
> makes significant strides in the production readiness of Structured
> Streaming, with added support for event time watermarks
> <https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
> and Kafka 0.10 support
> <https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
> In addition, this release focuses more on usability, stability, and polish,
> resolving over 1200 tickets.
>
> We'd like to thank our contributors and users for their contributions and
> early feedback to this release. This release would not have been possible
> without you.
>
> To download Spark 2.1.0, head over to the download page:
> http://spark.apache.org/downloads.html
>
> To view the release notes: https://spark.apache.
> org/releases/spark-release-2-1-0.html
>
> (note: If you see any issues with the release notes, webpage or published
> artifacts, please contact me directly off-list)
>
>
>