You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Patrick Wendell <pw...@gmail.com> on 2015/04/08 07:46:09 UTC
[VOTE] Release Apache Spark 1.3.1 (RC2)
Please vote on releasing the following candidate as Apache Spark version 1.3.1!
The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
The list of fixes present in this release can be found at:
http://bit.ly/1C2nVPY
The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-1.3.1-rc2/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1083/
The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
The patches on top of RC1 are:
[SPARK-6737] Fix memory leak in OutputCommitCoordinator
https://github.com/apache/spark/pull/5397
[SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
https://github.com/apache/spark/pull/5302
[SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
NoClassDefFoundError
https://github.com/apache/spark/pull/4933
Please vote on releasing this package as Apache Spark 1.3.1!
The vote is open until Saturday, April 11, at 07:00 UTC and passes
if a majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 1.3.1
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see
http://spark.apache.org/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Sandy Ryza <sa...@cloudera.com>.
+1
Built against Hadoop 2.6 and ran some jobs against a pseudo-distributed
YARN cluster.
-Sandy
On Wed, Apr 8, 2015 at 12:49 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Oh I see - ah okay I'm guessing it was a transient build error and
> I'll get it posted ASAP.
>
> On Wed, Apr 8, 2015 at 3:41 PM, Denny Lee <de...@gmail.com> wrote:
> > Oh, it appears the 2.4 bits without hive are there but not the 2.4 bits
> with
> > hive. Cool stuff on the 2.6.
> > On Wed, Apr 8, 2015 at 12:30 Patrick Wendell <pw...@gmail.com> wrote:
> >>
> >> Hey Denny,
> >>
> >> I beleive the 2.4 bits are there. The 2.6 bits I had done specially
> >> (we haven't merge that into our upstream build script). I'll do it
> >> again now for RC2.
> >>
> >> - Patrick
> >>
> >> On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen <tn...@gmail.com> wrote:
> >> > +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain
> >> > mode.
> >> >
> >> > Tim
> >> >
> >> > On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee <de...@gmail.com>
> wrote:
> >> >> The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that
> intended
> >> >> (they were included in RC1)?
> >> >>
> >> >>
> >> >> On Wed, Apr 8, 2015 at 9:01 AM Tom Graves
> >> >> <tg...@yahoo.com.invalid>
> >> >> wrote:
> >> >>
> >> >>> +1. Tested spark on yarn against hadoop 2.6.
> >> >>> Tom
> >> >>>
> >> >>>
> >> >>> On Wednesday, April 8, 2015 6:15 AM, Sean Owen
> >> >>> <so...@cloudera.com>
> >> >>> wrote:
> >> >>>
> >> >>>
> >> >>> Still a +1 from me; same result (except that now of course the
> >> >>> UISeleniumSuite test does not fail)
> >> >>>
> >> >>> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pwendell@gmail.com
> >
> >> >>> wrote:
> >> >>> > Please vote on releasing the following candidate as Apache Spark
> >> >>> > version
> >> >>> 1.3.1!
> >> >>> >
> >> >>> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> >> >>> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
> >> >>> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> >> >>> >
> >> >>> > The list of fixes present in this release can be found at:
> >> >>> > http://bit.ly/1C2nVPY
> >> >>> >
> >> >>> > The release files, including signatures, digests, etc. can be
> found
> >> >>> > at:
> >> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> >> >>> >
> >> >>> > Release artifacts are signed with the following key:
> >> >>> > https://people.apache.org/keys/committer/pwendell.asc
> >> >>> >
> >> >>> > The staging repository for this release can be found at:
> >> >>> >
> >> >>> >
> https://repository.apache.org/content/repositories/orgapachespark-1083/
> >> >>> >
> >> >>> > The documentation corresponding to this release can be found at:
> >> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> >> >>> >
> >> >>> > The patches on top of RC1 are:
> >> >>> >
> >> >>> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> >> >>> > https://github.com/apache/spark/pull/5397
> >> >>> >
> >> >>> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> >> >>> > https://github.com/apache/spark/pull/5302
> >> >>> >
> >> >>> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> >> >>> > NoClassDefFoundError
> >> >>> > https://github.com/apache/spark/pull/4933
> >> >>> >
> >> >>> > Please vote on releasing this package as Apache Spark 1.3.1!
> >> >>> >
> >> >>> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> >> >>> > if a majority of at least 3 +1 PMC votes are cast.
> >> >>> >
> >> >>> > [ ] +1 Release this package as Apache Spark 1.3.1
> >> >>> > [ ] -1 Do not release this package because ...
> >> >>> >
> >> >>> > To learn more about Apache Spark, please see
> >> >>> > http://spark.apache.org/
> >> >>> >
> >> >>> >
> >> >>> >
> ---------------------------------------------------------------------
> >> >>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> >> >>> > For additional commands, e-mail: dev-help@spark.apache.org
> >> >>> >
> >> >>>
> >> >>>
> ---------------------------------------------------------------------
> >> >>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> >> >>> For additional commands, e-mail: dev-help@spark.apache.org
> >> >>>
> >> >>>
> >> >>>
> >> >>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
Oh I see - ah okay I'm guessing it was a transient build error and
I'll get it posted ASAP.
On Wed, Apr 8, 2015 at 3:41 PM, Denny Lee <de...@gmail.com> wrote:
> Oh, it appears the 2.4 bits without hive are there but not the 2.4 bits with
> hive. Cool stuff on the 2.6.
> On Wed, Apr 8, 2015 at 12:30 Patrick Wendell <pw...@gmail.com> wrote:
>>
>> Hey Denny,
>>
>> I beleive the 2.4 bits are there. The 2.6 bits I had done specially
>> (we haven't merge that into our upstream build script). I'll do it
>> again now for RC2.
>>
>> - Patrick
>>
>> On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen <tn...@gmail.com> wrote:
>> > +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain
>> > mode.
>> >
>> > Tim
>> >
>> > On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee <de...@gmail.com> wrote:
>> >> The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended
>> >> (they were included in RC1)?
>> >>
>> >>
>> >> On Wed, Apr 8, 2015 at 9:01 AM Tom Graves
>> >> <tg...@yahoo.com.invalid>
>> >> wrote:
>> >>
>> >>> +1. Tested spark on yarn against hadoop 2.6.
>> >>> Tom
>> >>>
>> >>>
>> >>> On Wednesday, April 8, 2015 6:15 AM, Sean Owen
>> >>> <so...@cloudera.com>
>> >>> wrote:
>> >>>
>> >>>
>> >>> Still a +1 from me; same result (except that now of course the
>> >>> UISeleniumSuite test does not fail)
>> >>>
>> >>> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com>
>> >>> wrote:
>> >>> > Please vote on releasing the following candidate as Apache Spark
>> >>> > version
>> >>> 1.3.1!
>> >>> >
>> >>> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>> >>> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
>> >>> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>> >>> >
>> >>> > The list of fixes present in this release can be found at:
>> >>> > http://bit.ly/1C2nVPY
>> >>> >
>> >>> > The release files, including signatures, digests, etc. can be found
>> >>> > at:
>> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>> >>> >
>> >>> > Release artifacts are signed with the following key:
>> >>> > https://people.apache.org/keys/committer/pwendell.asc
>> >>> >
>> >>> > The staging repository for this release can be found at:
>> >>> >
>> >>> > https://repository.apache.org/content/repositories/orgapachespark-1083/
>> >>> >
>> >>> > The documentation corresponding to this release can be found at:
>> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>> >>> >
>> >>> > The patches on top of RC1 are:
>> >>> >
>> >>> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
>> >>> > https://github.com/apache/spark/pull/5397
>> >>> >
>> >>> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
>> >>> > https://github.com/apache/spark/pull/5302
>> >>> >
>> >>> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
>> >>> > NoClassDefFoundError
>> >>> > https://github.com/apache/spark/pull/4933
>> >>> >
>> >>> > Please vote on releasing this package as Apache Spark 1.3.1!
>> >>> >
>> >>> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
>> >>> > if a majority of at least 3 +1 PMC votes are cast.
>> >>> >
>> >>> > [ ] +1 Release this package as Apache Spark 1.3.1
>> >>> > [ ] -1 Do not release this package because ...
>> >>> >
>> >>> > To learn more about Apache Spark, please see
>> >>> > http://spark.apache.org/
>> >>> >
>> >>> >
>> >>> > ---------------------------------------------------------------------
>> >>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> >>> > For additional commands, e-mail: dev-help@spark.apache.org
>> >>> >
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> >>> For additional commands, e-mail: dev-help@spark.apache.org
>> >>>
>> >>>
>> >>>
>> >>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Denny Lee <de...@gmail.com>.
Oh, it appears the 2.4 bits without hive are there but not the 2.4 bits
with hive. Cool stuff on the 2.6.
On Wed, Apr 8, 2015 at 12:30 Patrick Wendell <pw...@gmail.com> wrote:
> Hey Denny,
>
> I beleive the 2.4 bits are there. The 2.6 bits I had done specially
> (we haven't merge that into our upstream build script). I'll do it
> again now for RC2.
>
> - Patrick
>
> On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen <tn...@gmail.com> wrote:
> > +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain mode.
> >
> > Tim
> >
> > On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee <de...@gmail.com> wrote:
> >> The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended
> >> (they were included in RC1)?
> >>
> >>
> >> On Wed, Apr 8, 2015 at 9:01 AM Tom Graves <tgraves_cs@yahoo.com.invalid
> >
> >> wrote:
> >>
> >>> +1. Tested spark on yarn against hadoop 2.6.
> >>> Tom
> >>>
> >>>
> >>> On Wednesday, April 8, 2015 6:15 AM, Sean Owen <
> sowen@cloudera.com>
> >>> wrote:
> >>>
> >>>
> >>> Still a +1 from me; same result (except that now of course the
> >>> UISeleniumSuite test does not fail)
> >>>
> >>> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com>
> >>> wrote:
> >>> > Please vote on releasing the following candidate as Apache Spark
> version
> >>> 1.3.1!
> >>> >
> >>> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> >>> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
> >>> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> >>> >
> >>> > The list of fixes present in this release can be found at:
> >>> > http://bit.ly/1C2nVPY
> >>> >
> >>> > The release files, including signatures, digests, etc. can be found
> at:
> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> >>> >
> >>> > Release artifacts are signed with the following key:
> >>> > https://people.apache.org/keys/committer/pwendell.asc
> >>> >
> >>> > The staging repository for this release can be found at:
> >>> > https://repository.apache.org/content/repositories/
> orgapachespark-1083/
> >>> >
> >>> > The documentation corresponding to this release can be found at:
> >>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> >>> >
> >>> > The patches on top of RC1 are:
> >>> >
> >>> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> >>> > https://github.com/apache/spark/pull/5397
> >>> >
> >>> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> >>> > https://github.com/apache/spark/pull/5302
> >>> >
> >>> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> >>> > NoClassDefFoundError
> >>> > https://github.com/apache/spark/pull/4933
> >>> >
> >>> > Please vote on releasing this package as Apache Spark 1.3.1!
> >>> >
> >>> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> >>> > if a majority of at least 3 +1 PMC votes are cast.
> >>> >
> >>> > [ ] +1 Release this package as Apache Spark 1.3.1
> >>> > [ ] -1 Do not release this package because ...
> >>> >
> >>> > To learn more about Apache Spark, please see
> >>> > http://spark.apache.org/
> >>> >
> >>> > ------------------------------------------------------------
> ---------
> >>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> >>> > For additional commands, e-mail: dev-help@spark.apache.org
> >>> >
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> >>> For additional commands, e-mail: dev-help@spark.apache.org
> >>>
> >>>
> >>>
> >>>
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
Hey Denny,
I beleive the 2.4 bits are there. The 2.6 bits I had done specially
(we haven't merge that into our upstream build script). I'll do it
again now for RC2.
- Patrick
On Wed, Apr 8, 2015 at 1:53 PM, Timothy Chen <tn...@gmail.com> wrote:
> +1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain mode.
>
> Tim
>
> On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee <de...@gmail.com> wrote:
>> The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended
>> (they were included in RC1)?
>>
>>
>> On Wed, Apr 8, 2015 at 9:01 AM Tom Graves <tg...@yahoo.com.invalid>
>> wrote:
>>
>>> +1. Tested spark on yarn against hadoop 2.6.
>>> Tom
>>>
>>>
>>> On Wednesday, April 8, 2015 6:15 AM, Sean Owen <so...@cloudera.com>
>>> wrote:
>>>
>>>
>>> Still a +1 from me; same result (except that now of course the
>>> UISeleniumSuite test does not fail)
>>>
>>> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>> > Please vote on releasing the following candidate as Apache Spark version
>>> 1.3.1!
>>> >
>>> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>>> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
>>> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>>> >
>>> > The list of fixes present in this release can be found at:
>>> > http://bit.ly/1C2nVPY
>>> >
>>> > The release files, including signatures, digests, etc. can be found at:
>>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>>> >
>>> > Release artifacts are signed with the following key:
>>> > https://people.apache.org/keys/committer/pwendell.asc
>>> >
>>> > The staging repository for this release can be found at:
>>> > https://repository.apache.org/content/repositories/orgapachespark-1083/
>>> >
>>> > The documentation corresponding to this release can be found at:
>>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>>> >
>>> > The patches on top of RC1 are:
>>> >
>>> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
>>> > https://github.com/apache/spark/pull/5397
>>> >
>>> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
>>> > https://github.com/apache/spark/pull/5302
>>> >
>>> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
>>> > NoClassDefFoundError
>>> > https://github.com/apache/spark/pull/4933
>>> >
>>> > Please vote on releasing this package as Apache Spark 1.3.1!
>>> >
>>> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
>>> > if a majority of at least 3 +1 PMC votes are cast.
>>> >
>>> > [ ] +1 Release this package as Apache Spark 1.3.1
>>> > [ ] -1 Do not release this package because ...
>>> >
>>> > To learn more about Apache Spark, please see
>>> > http://spark.apache.org/
>>> >
>>> > ---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>> > For additional commands, e-mail: dev-help@spark.apache.org
>>> >
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: dev-help@spark.apache.org
>>>
>>>
>>>
>>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Timothy Chen <tn...@gmail.com>.
+1 Tested on 4 nodes Mesos cluster with fine-grain and coarse-grain mode.
Tim
On Wed, Apr 8, 2015 at 9:32 AM, Denny Lee <de...@gmail.com> wrote:
> The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended
> (they were included in RC1)?
>
>
> On Wed, Apr 8, 2015 at 9:01 AM Tom Graves <tg...@yahoo.com.invalid>
> wrote:
>
>> +1. Tested spark on yarn against hadoop 2.6.
>> Tom
>>
>>
>> On Wednesday, April 8, 2015 6:15 AM, Sean Owen <so...@cloudera.com>
>> wrote:
>>
>>
>> Still a +1 from me; same result (except that now of course the
>> UISeleniumSuite test does not fail)
>>
>> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com>
>> wrote:
>> > Please vote on releasing the following candidate as Apache Spark version
>> 1.3.1!
>> >
>> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
>> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>> >
>> > The list of fixes present in this release can be found at:
>> > http://bit.ly/1C2nVPY
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>> >
>> > Release artifacts are signed with the following key:
>> > https://people.apache.org/keys/committer/pwendell.asc
>> >
>> > The staging repository for this release can be found at:
>> > https://repository.apache.org/content/repositories/orgapachespark-1083/
>> >
>> > The documentation corresponding to this release can be found at:
>> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>> >
>> > The patches on top of RC1 are:
>> >
>> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
>> > https://github.com/apache/spark/pull/5397
>> >
>> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
>> > https://github.com/apache/spark/pull/5302
>> >
>> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
>> > NoClassDefFoundError
>> > https://github.com/apache/spark/pull/4933
>> >
>> > Please vote on releasing this package as Apache Spark 1.3.1!
>> >
>> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
>> > if a majority of at least 3 +1 PMC votes are cast.
>> >
>> > [ ] +1 Release this package as Apache Spark 1.3.1
>> > [ ] -1 Do not release this package because ...
>> >
>> > To learn more about Apache Spark, please see
>> > http://spark.apache.org/
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> > For additional commands, e-mail: dev-help@spark.apache.org
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>>
>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Denny Lee <de...@gmail.com>.
The RC2 bits are lacking Hadoop 2.4 and Hadoop 2.6 - was that intended
(they were included in RC1)?
On Wed, Apr 8, 2015 at 9:01 AM Tom Graves <tg...@yahoo.com.invalid>
wrote:
> +1. Tested spark on yarn against hadoop 2.6.
> Tom
>
>
> On Wednesday, April 8, 2015 6:15 AM, Sean Owen <so...@cloudera.com>
> wrote:
>
>
> Still a +1 from me; same result (except that now of course the
> UISeleniumSuite test does not fail)
>
> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com>
> wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> 1.3.1!
> >
> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> >
> > The list of fixes present in this release can be found at:
> > http://bit.ly/1C2nVPY
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1083/
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> >
> > The patches on top of RC1 are:
> >
> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> > https://github.com/apache/spark/pull/5397
> >
> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> > https://github.com/apache/spark/pull/5302
> >
> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> > NoClassDefFoundError
> > https://github.com/apache/spark/pull/4933
> >
> > Please vote on releasing this package as Apache Spark 1.3.1!
> >
> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> > if a majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.3.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>
>
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Tom Graves <tg...@yahoo.com.INVALID>.
+1. Tested spark on yarn against hadoop 2.6.
Tom
On Wednesday, April 8, 2015 6:15 AM, Sean Owen <so...@cloudera.com> wrote:
Still a +1 from me; same result (except that now of course the
UISeleniumSuite test does not fail)
On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com> wrote:
> Please vote on releasing the following candidate as Apache Spark version 1.3.1!
>
> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>
> The list of fixes present in this release can be found at:
> http://bit.ly/1C2nVPY
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1083/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>
> The patches on top of RC1 are:
>
> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> https://github.com/apache/spark/pull/5397
>
> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> https://github.com/apache/spark/pull/5302
>
> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> NoClassDefFoundError
> https://github.com/apache/spark/pull/4933
>
> Please vote on releasing this package as Apache Spark 1.3.1!
>
> The vote is open until Saturday, April 11, at 07:00 UTC and passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Matei Zaharia <ma...@gmail.com>.
+1. Tested on Mac OS X and verified that some of the bugs were fixed.
Matei
> On Apr 8, 2015, at 7:13 AM, Sean Owen <so...@cloudera.com> wrote:
>
> Still a +1 from me; same result (except that now of course the
> UISeleniumSuite test does not fail)
>
> On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com> wrote:
>> Please vote on releasing the following candidate as Apache Spark version 1.3.1!
>>
>> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>>
>> The list of fixes present in this release can be found at:
>> http://bit.ly/1C2nVPY
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1083/
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>>
>> The patches on top of RC1 are:
>>
>> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
>> https://github.com/apache/spark/pull/5397
>>
>> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
>> https://github.com/apache/spark/pull/5302
>>
>> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
>> NoClassDefFoundError
>> https://github.com/apache/spark/pull/4933
>>
>> Please vote on releasing this package as Apache Spark 1.3.1!
>>
>> The vote is open until Saturday, April 11, at 07:00 UTC and passes
>> if a majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.3.1
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Sean Owen <so...@cloudera.com>.
Still a +1 from me; same result (except that now of course the
UISeleniumSuite test does not fail)
On Wed, Apr 8, 2015 at 1:46 AM, Patrick Wendell <pw...@gmail.com> wrote:
> Please vote on releasing the following candidate as Apache Spark version 1.3.1!
>
> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>
> The list of fixes present in this release can be found at:
> http://bit.ly/1C2nVPY
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1083/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>
> The patches on top of RC1 are:
>
> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> https://github.com/apache/spark/pull/5397
>
> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> https://github.com/apache/spark/pull/5302
>
> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> NoClassDefFoundError
> https://github.com/apache/spark/pull/4933
>
> Please vote on releasing this package as Apache Spark 1.3.1!
>
> The vote is open until Saturday, April 11, at 07:00 UTC and passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by "York, Brennon" <Br...@capitalone.com>.
+1 (non-binding)
Still +1 for me
On 4/9/15, 8:43 AM, "Sean McNamara" <Se...@Webtrends.com> wrote:
>+1 tested on OS X
>
>Sean
>
>> On Apr 7, 2015, at 11:46 PM, Patrick Wendell <pw...@gmail.com> wrote:
>>
>> Please vote on releasing the following candidate as Apache Spark
>>version 1.3.1!
>>
>> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>>
>>https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a
>>7f5de0323394aaedeefbf9738e8eb5
>>
>> The list of fixes present in this release can be found at:
>> http://bit.ly/1C2nVPY
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1083/
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>>
>> The patches on top of RC1 are:
>>
>> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
>> https://github.com/apache/spark/pull/5397
>>
>> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
>> https://github.com/apache/spark/pull/5302
>>
>> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
>> NoClassDefFoundError
>> https://github.com/apache/spark/pull/4933
>>
>> Please vote on releasing this package as Apache Spark 1.3.1!
>>
>> The vote is open until Saturday, April 11, at 07:00 UTC and passes
>> if a majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.3.1
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>> For additional commands, e-mail: dev-help@spark.apache.org
>>
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
>For additional commands, e-mail: dev-help@spark.apache.org
>
________________________________________________________
The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Sean McNamara <Se...@Webtrends.com>.
+1 tested on OS X
Sean
> On Apr 7, 2015, at 11:46 PM, Patrick Wendell <pw...@gmail.com> wrote:
>
> Please vote on releasing the following candidate as Apache Spark version 1.3.1!
>
> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>
> The list of fixes present in this release can be found at:
> http://bit.ly/1C2nVPY
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1083/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>
> The patches on top of RC1 are:
>
> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> https://github.com/apache/spark/pull/5397
>
> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> https://github.com/apache/spark/pull/5302
>
> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> NoClassDefFoundError
> https://github.com/apache/spark/pull/4933
>
> Please vote on releasing this package as Apache Spark 1.3.1!
>
> The vote is open until Saturday, April 11, at 07:00 UTC and passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Prashant Sharma <sc...@gmail.com>.
+1 tested locally on linux.
Prashant Sharma
On Fri, Apr 10, 2015 at 7:51 AM, GuoQiang Li <wi...@qq.com> wrote:
> +1 (non-binding)
>
>
>
>
> ------------------ Original ------------------
> From: "Patrick Wendell";<pw...@gmail.com>;
> Date: Wed, Apr 8, 2015 01:46 PM
> To: "dev@spark.apache.org"<de...@spark.apache.org>;
>
> Subject: [VOTE] Release Apache Spark 1.3.1 (RC2)
>
>
>
> Please vote on releasing the following candidate as Apache Spark version
> 1.3.1!
>
> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>
> The list of fixes present in this release can be found at:
> http://bit.ly/1C2nVPY
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1083/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>
> The patches on top of RC1 are:
>
> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> https://github.com/apache/spark/pull/5397
>
> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> https://github.com/apache/spark/pull/5302
>
> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> NoClassDefFoundError
> https://github.com/apache/spark/pull/4933
>
> Please vote on releasing this package as Apache Spark 1.3.1!
>
> The vote is open until Saturday, April 11, at 07:00 UTC and passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by GuoQiang Li <wi...@qq.com>.
+1 (non-binding)
------------------ Original ------------------
From: "Patrick Wendell";<pw...@gmail.com>;
Date: Wed, Apr 8, 2015 01:46 PM
To: "dev@spark.apache.org"<de...@spark.apache.org>;
Subject: [VOTE] Release Apache Spark 1.3.1 (RC2)
Please vote on releasing the following candidate as Apache Spark version 1.3.1!
The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
The list of fixes present in this release can be found at:
http://bit.ly/1C2nVPY
The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-1.3.1-rc2/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1083/
The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
The patches on top of RC1 are:
[SPARK-6737] Fix memory leak in OutputCommitCoordinator
https://github.com/apache/spark/pull/5397
[SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
https://github.com/apache/spark/pull/5302
[SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
NoClassDefFoundError
https://github.com/apache/spark/pull/4933
Please vote on releasing this package as Apache Spark 1.3.1!
The vote is open until Saturday, April 11, at 07:00 UTC and passes
if a majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 1.3.1
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see
http://spark.apache.org/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Michael Armbrust <mi...@databricks.com>.
-1 (binding)
We just were alerted to a pretty serious regression since 1.3.0 (
https://issues.apache.org/jira/browse/SPARK-6851). Should have a fix
shortly.
Michael
On Fri, Apr 10, 2015 at 6:10 AM, Corey Nolet <cj...@gmail.com> wrote:
> +1 (non-binding)
>
> - Verified signatures
> - built on Mac OSX
> - built on Fedora 21
>
> All builds were done using profiles: hive, hive-thriftserver, hadoop-2.4,
> yarn
>
> +1 tested ML-related items on Mac OS X
>
> On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar <ks...@gmail.com>
> wrote:
>
> > +1 (non-binding, of course)
> >
> > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min
> > mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4
> > -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11
> > 2. Tested pyspark, mlib - running as well as compare results with 1.3.0
> > pyspark works well with the new iPython 3.0.0 release
> > 2.1. statistics (min,max,mean,Pearson,Spearman) OK
> > 2.2. Linear/Ridge/Laso Regression OK
> > 2.3. Decision Tree, Naive Bayes OK
> > 2.4. KMeans OK
> > Center And Scale OK
> > 2.5. RDD operations OK
> > State of the Union Texts - MapReduce, Filter,sortByKey (word count)
> > 2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
> > Model evaluation/optimization (rank, numIter, lambda) with
> itertools
> > OK
> > 3. Scala - MLlib
> > 3.1. statistics (min,max,mean,Pearson,Spearman) OK
> > 3.2. LinearRegressionWithSGD OK
> > 3.3. Decision Tree OK
> > 3.4. KMeans OK
> > 3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
> > 4.0. Spark SQL from Python OK
> > 4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'")
> OK
> >
> > On Tue, Apr 7, 2015 at 10:46 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> >
> > > Please vote on releasing the following candidate as Apache Spark
> version
> > > 1.3.1!
> > >
> > > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> > >
> > >
> >
>
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> > >
> > > The list of fixes present in this release can be found at:
> > > http://bit.ly/1C2nVPY
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/pwendell.asc
> > >
> > > The staging repository for this release can be found at:
> > >
> https://repository.apache.org/content/repositories/orgapachespark-1083/
> > >
> > > The documentation corresponding to this release can be found at:
> > > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> > >
> > > The patches on top of RC1 are:
> > >
> > > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> > > https://github.com/apache/spark/pull/5397
> > >
> > > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> > > https://github.com/apache/spark/pull/5302
> > >
> > > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> > > NoClassDefFoundError
> > > https://github.com/apache/spark/pull/4933
> > >
> > > Please vote on releasing this package as Apache Spark 1.3.1!
> > >
> > > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> > > if a majority of at least 3 +1 PMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Spark 1.3.1
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see
> > > http://spark.apache.org/
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > > For additional commands, e-mail: dev-help@spark.apache.org
> > >
> > >
> >
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Corey Nolet <cj...@gmail.com>.
+1 (non-binding)
- Verified signatures
- built on Mac OSX
- built on Fedora 21
All builds were done using profiles: hive, hive-thriftserver, hadoop-2.4,
yarn
+1 tested ML-related items on Mac OS X
On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar <ks...@gmail.com> wrote:
> +1 (non-binding, of course)
>
> 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min
> mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4
> -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11
> 2. Tested pyspark, mlib - running as well as compare results with 1.3.0
> pyspark works well with the new iPython 3.0.0 release
> 2.1. statistics (min,max,mean,Pearson,Spearman) OK
> 2.2. Linear/Ridge/Laso Regression OK
> 2.3. Decision Tree, Naive Bayes OK
> 2.4. KMeans OK
> Center And Scale OK
> 2.5. RDD operations OK
> State of the Union Texts - MapReduce, Filter,sortByKey (word count)
> 2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
> Model evaluation/optimization (rank, numIter, lambda) with
itertools
> OK
> 3. Scala - MLlib
> 3.1. statistics (min,max,mean,Pearson,Spearman) OK
> 3.2. LinearRegressionWithSGD OK
> 3.3. Decision Tree OK
> 3.4. KMeans OK
> 3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
> 4.0. Spark SQL from Python OK
> 4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'") OK
>
> On Tue, Apr 7, 2015 at 10:46 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > Please vote on releasing the following candidate as Apache Spark version
> > 1.3.1!
> >
> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> >
> >
>
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> >
> > The list of fixes present in this release can be found at:
> > http://bit.ly/1C2nVPY
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1083/
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> >
> > The patches on top of RC1 are:
> >
> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> > https://github.com/apache/spark/pull/5397
> >
> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> > https://github.com/apache/spark/pull/5302
> >
> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> > NoClassDefFoundError
> > https://github.com/apache/spark/pull/4933
> >
> > Please vote on releasing this package as Apache Spark 1.3.1!
> >
> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> > if a majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.3.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
> >
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Denny Lee <de...@gmail.com>.
+1 (non-binding)
Tested Scala, SparkSQL, and MLLib on OSX against Hadoop 2.6
On Wed, Apr 8, 2015 at 5:35 PM Joseph Bradley <jo...@databricks.com> wrote:
> +1 tested ML-related items on Mac OS X
>
> On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar <ks...@gmail.com>
> wrote:
>
> > +1 (non-binding, of course)
> >
> > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min
> > mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4
> > -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11
> > 2. Tested pyspark, mlib - running as well as compare results with 1.3.0
> > pyspark works well with the new iPython 3.0.0 release
> > 2.1. statistics (min,max,mean,Pearson,Spearman) OK
> > 2.2. Linear/Ridge/Laso Regression OK
> > 2.3. Decision Tree, Naive Bayes OK
> > 2.4. KMeans OK
> > Center And Scale OK
> > 2.5. RDD operations OK
> > State of the Union Texts - MapReduce, Filter,sortByKey (word count)
> > 2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
> > Model evaluation/optimization (rank, numIter, lambda) with
> itertools
> > OK
> > 3. Scala - MLlib
> > 3.1. statistics (min,max,mean,Pearson,Spearman) OK
> > 3.2. LinearRegressionWithSGD OK
> > 3.3. Decision Tree OK
> > 3.4. KMeans OK
> > 3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
> > 4.0. Spark SQL from Python OK
> > 4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'")
> OK
> >
> > On Tue, Apr 7, 2015 at 10:46 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> >
> > > Please vote on releasing the following candidate as Apache Spark
> version
> > > 1.3.1!
> > >
> > > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> > >
> > >
> > https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=
> 7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> > >
> > > The list of fixes present in this release can be found at:
> > > http://bit.ly/1C2nVPY
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/pwendell.asc
> > >
> > > The staging repository for this release can be found at:
> > > https://repository.apache.org/content/repositories/
> orgapachespark-1083/
> > >
> > > The documentation corresponding to this release can be found at:
> > > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> > >
> > > The patches on top of RC1 are:
> > >
> > > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> > > https://github.com/apache/spark/pull/5397
> > >
> > > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> > > https://github.com/apache/spark/pull/5302
> > >
> > > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> > > NoClassDefFoundError
> > > https://github.com/apache/spark/pull/4933
> > >
> > > Please vote on releasing this package as Apache Spark 1.3.1!
> > >
> > > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> > > if a majority of at least 3 +1 PMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Spark 1.3.1
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see
> > > http://spark.apache.org/
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > > For additional commands, e-mail: dev-help@spark.apache.org
> > >
> > >
> >
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Joseph Bradley <jo...@databricks.com>.
+1 tested ML-related items on Mac OS X
On Wed, Apr 8, 2015 at 7:59 PM, Krishna Sankar <ks...@gmail.com> wrote:
> +1 (non-binding, of course)
>
> 1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min
> mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4
> -Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11
> 2. Tested pyspark, mlib - running as well as compare results with 1.3.0
> pyspark works well with the new iPython 3.0.0 release
> 2.1. statistics (min,max,mean,Pearson,Spearman) OK
> 2.2. Linear/Ridge/Laso Regression OK
> 2.3. Decision Tree, Naive Bayes OK
> 2.4. KMeans OK
> Center And Scale OK
> 2.5. RDD operations OK
> State of the Union Texts - MapReduce, Filter,sortByKey (word count)
> 2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
> Model evaluation/optimization (rank, numIter, lambda) with itertools
> OK
> 3. Scala - MLlib
> 3.1. statistics (min,max,mean,Pearson,Spearman) OK
> 3.2. LinearRegressionWithSGD OK
> 3.3. Decision Tree OK
> 3.4. KMeans OK
> 3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
> 4.0. Spark SQL from Python OK
> 4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'") OK
>
> On Tue, Apr 7, 2015 at 10:46 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > Please vote on releasing the following candidate as Apache Spark version
> > 1.3.1!
> >
> > The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
> >
> > The list of fixes present in this release can be found at:
> > http://bit.ly/1C2nVPY
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1083/
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
> >
> > The patches on top of RC1 are:
> >
> > [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> > https://github.com/apache/spark/pull/5397
> >
> > [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> > https://github.com/apache/spark/pull/5302
> >
> > [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> > NoClassDefFoundError
> > https://github.com/apache/spark/pull/4933
> >
> > Please vote on releasing this package as Apache Spark 1.3.1!
> >
> > The vote is open until Saturday, April 11, at 07:00 UTC and passes
> > if a majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.3.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> > For additional commands, e-mail: dev-help@spark.apache.org
> >
> >
>
Re: [VOTE] Release Apache Spark 1.3.1 (RC2)
Posted by Krishna Sankar <ks...@gmail.com>.
+1 (non-binding, of course)
1. Compiled OSX 10.10 (Yosemite) OK Total time: 14:16 min
mvn clean package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4
-Dhadoop.version=2.6.0 -Phive -DskipTests -Dscala-2.11
2. Tested pyspark, mlib - running as well as compare results with 1.3.0
pyspark works well with the new iPython 3.0.0 release
2.1. statistics (min,max,mean,Pearson,Spearman) OK
2.2. Linear/Ridge/Laso Regression OK
2.3. Decision Tree, Naive Bayes OK
2.4. KMeans OK
Center And Scale OK
2.5. RDD operations OK
State of the Union Texts - MapReduce, Filter,sortByKey (word count)
2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK
Model evaluation/optimization (rank, numIter, lambda) with itertools
OK
3. Scala - MLlib
3.1. statistics (min,max,mean,Pearson,Spearman) OK
3.2. LinearRegressionWithSGD OK
3.3. Decision Tree OK
3.4. KMeans OK
3.5. Recommendation (Movielens medium dataset ~1 M ratings) OK
4.0. Spark SQL from Python OK
4.1. result = sqlContext.sql("SELECT * from people WHERE State = 'WA'") OK
On Tue, Apr 7, 2015 at 10:46 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.3.1!
>
> The tag to be voted on is v1.3.1-rc2 (commit 7c4473a):
>
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7c4473aa5a7f5de0323394aaedeefbf9738e8eb5
>
> The list of fixes present in this release can be found at:
> http://bit.ly/1C2nVPY
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1083/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.3.1-rc2-docs/
>
> The patches on top of RC1 are:
>
> [SPARK-6737] Fix memory leak in OutputCommitCoordinator
> https://github.com/apache/spark/pull/5397
>
> [SPARK-6636] Use public DNS hostname everywhere in spark_ec2.py
> https://github.com/apache/spark/pull/5302
>
> [SPARK-6205] [CORE] UISeleniumSuite fails for Hadoop 2.x test with
> NoClassDefFoundError
> https://github.com/apache/spark/pull/4933
>
> Please vote on releasing this package as Apache Spark 1.3.1!
>
> The vote is open until Saturday, April 11, at 07:00 UTC and passes
> if a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.3.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>