You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "MrAsanjar ." <af...@gmail.com> on 2016/12/29 16:22:24 UTC
Fwd: [ANNOUNCE] Announcing Apache Spark 2.1.0
team,
It appears there have been many fixes and enhancement gone into spark 2.1,
specially adding Kafka 0.10.support.
I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
---------- Forwarded message ----------
From: Yin Huai <yh...@databricks.com>
Date: Thu, Dec 29, 2016 at 10:02 AM
Subject: [ANNOUNCE] Announcing Apache Spark 2.1.0
To: "dev@spark.apache.org" <de...@spark.apache.org>, user <
user@spark.apache.org>
Hi all,
Apache Spark 2.1.0 is the second release of Spark 2.x line. This release
makes significant strides in the production readiness of Structured
Streaming, with added support for event time watermarks
<https://spark.apache.org/docs/2.1.0/structured-streaming-programming-guide.html#handling-late-data-and-watermarking>
and Kafka 0.10 support
<https://spark.apache.org/docs/2.1.0/structured-streaming-kafka-integration.html>.
In addition, this release focuses more on usability, stability, and polish,
resolving over 1200 tickets.
We'd like to thank our contributors and users for their contributions and
early feedback to this release. This release would not have been possible
without you.
To download Spark 2.1.0, head over to the download page:
http://spark.apache.org/downloads.html
To view the release notes: https://spark.apache.
org/releases/spark-release-2-1-0.html
(note: If you see any issues with the release notes, webpage or published
artifacts, please contact me directly off-list)
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
if there is no objection, I will push patch in JIRA
https://issues.apache.org/jira/browse/BIGTOP-2653 by the end of
today (in 12 hrs)
On Sun, Jan 1, 2017 at 6:39 PM, MrAsanjar . <af...@gmail.com> wrote:
> Built the entire stack using spark 2.1 on ubuntu 16.04 without any
> failure. Going to submit a patch shortly.
>
> On Dec 31, 2016 4:45 AM, "Evans Ye" <ev...@apache.org> wrote:
>
>> +1
>> Spark 2.1 is more stable for production. Would be better to be included in
>> 1.2 release.
>>
>> MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
>>
>> > working on it..
>> >
>> >
>> >
>> > On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <
>> roman@shaposhnik.org>
>> >
>> > wrote:
>> >
>> >
>> >
>> > > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com>
>> wrote:
>> >
>> > > > team,
>> >
>> > > > It appears there have been many fixes and enhancement gone into
>> spark
>> >
>> > > 2.1,
>> >
>> > > > specially adding Kafka 0.10.support.
>> >
>> > > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>> >
>> > >
>> >
>> > > Seems like an good idea. Especially if the upgrade won't be painful.
>> Any
>> >
>> > > chance
>> >
>> > > you can run a build of the entire stack with this new Spark version
>> >
>> > > and report back?
>> >
>> > >
>> >
>> > > Thanks,
>> >
>> > > Roman.
>> >
>> > >
>> >
>> >
>>
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
Built the entire stack using spark 2.1 on ubuntu 16.04 without any failure.
Going to submit a patch shortly.
On Dec 31, 2016 4:45 AM, "Evans Ye" <ev...@apache.org> wrote:
> +1
> Spark 2.1 is more stable for production. Would be better to be included in
> 1.2 release.
>
> MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
>
> > working on it..
> >
> >
> >
> > On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <roman@shaposhnik.org
> >
> >
> > wrote:
> >
> >
> >
> > > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com>
> wrote:
> >
> > > > team,
> >
> > > > It appears there have been many fixes and enhancement gone into spark
> >
> > > 2.1,
> >
> > > > specially adding Kafka 0.10.support.
> >
> > > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
> >
> > >
> >
> > > Seems like an good idea. Especially if the upgrade won't be painful.
> Any
> >
> > > chance
> >
> > > you can run a build of the entire stack with this new Spark version
> >
> > > and report back?
> >
> > >
> >
> > > Thanks,
> >
> > > Roman.
> >
> > >
> >
> >
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Evans Ye <ev...@apache.org>.
+1
Spark 2.1 is more stable for production. Would be better to be included in
1.2 release.
MrAsanjar . <af...@gmail.com>於 2016年12月31日 週六，上午3:17寫道：
> working on it..
>
>
>
> On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <ro...@shaposhnik.org>
>
> wrote:
>
>
>
> > On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
>
> > > team,
>
> > > It appears there have been many fixes and enhancement gone into spark
>
> > 2.1,
>
> > > specially adding Kafka 0.10.support.
>
> > > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>
> >
>
> > Seems like an good idea. Especially if the upgrade won't be painful. Any
>
> > chance
>
> > you can run a build of the entire stack with this new Spark version
>
> > and report back?
>
> >
>
> > Thanks,
>
> > Roman.
>
> >
>
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by "MrAsanjar ." <af...@gmail.com>.
working on it..
On Thu, Dec 29, 2016 at 12:07 PM, Roman Shaposhnik <ro...@shaposhnik.org>
wrote:
> On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
> > team,
> > It appears there have been many fixes and enhancement gone into spark
> 2.1,
> > specially adding Kafka 0.10.support.
> > I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
>
> Seems like an good idea. Especially if the upgrade won't be painful. Any
> chance
> you can run a build of the entire stack with this new Spark version
> and report back?
>
> Thanks,
> Roman.
>
Re: [ANNOUNCE] Announcing Apache Spark 2.1.0
Posted by Roman Shaposhnik <ro...@shaposhnik.org>.
On Thu, Dec 29, 2016 at 8:22 AM, MrAsanjar . <af...@gmail.com> wrote:
> team,
> It appears there have been many fixes and enhancement gone into spark 2.1,
> specially adding Kafka 0.10.support.
> I propose to upgrade bigtop's Spark to 2.1. Any thoughts?
Seems like an good idea. Especially if the upgrade won't be painful. Any chance
you can run a build of the entire stack with this new Spark version
and report back?
Thanks,
Roman.