You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Patrick Wendell <pw...@gmail.com> on 2014/07/04 21:39:14 UTC
[VOTE] Release Apache Spark 1.0.1 (RC2)
Please vote on releasing the following candidate as Apache Spark version 1.0.1!
The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-1.0.1-rc2/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1021/
The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
Please vote on releasing this package as Apache Spark 1.0.1!
The vote is open until Monday, July 07, at 20:45 UTC and passes if
a majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 1.0.1
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see
http://spark.apache.org/
=== Differences from RC1 ===
This release includes only one "blocking" patch from rc1:
https://github.com/apache/spark/pull/1255
There are also smaller fixes which came in over the last week.
=== About this release ===
This release fixes a few high-priority bugs in 1.0 and has a variety
of smaller fixes. The full list is here: http://s.apache.org/b45. Some
of the more visible patches are:
SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
SPARK-1790: Support r3 instance types on EC2.
This is the first maintenance release on the 1.0 line. We plan to make
additional maintenance releases as new fixes come in.
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Xiangrui Meng <me...@gmail.com>.
+1
Ran mllib examples.
On Sun, Jul 6, 2014 at 1:21 PM, Matei Zaharia <ma...@gmail.com> wrote:
> +1
>
> Tested on Mac OS X.
>
> Matei
>
> On Jul 6, 2014, at 1:54 AM, Andrew Or <an...@databricks.com> wrote:
>
>> +1, verified that the UI bug is in fact fixed in
>> https://github.com/apache/spark/pull/1255.
>>
>>
>> 2014-07-05 20:01 GMT-07:00 Soren Macbeth <so...@yieldbot.com>:
>>
>>> +1
>>>
>>>
>>> On Sat, Jul 5, 2014 at 7:41 PM, Krishna Sankar <ks...@gmail.com>
>>> wrote:
>>>
>>>> +1
>>>>
>>>> - Compiled rc2 w/ CentOS 6.5, Yarn,Hadoop 2.2.0 - successful
>>>> - Smoke Test (scala,python) (distributed cluster) - successful
>>>> - We had ran Java/SparkSQL (count, distinct et al) ~250M records RDD
>>>> over HBase 0.98.3 over last build (rc1) - successful
>>>> - Stand alone multi-node cluster is working better for us than Yarn
>>>>
>>>> Cheers
>>>> <k/>
>>>>
>>>>
>>>> On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
>>>> wrote:
>>>>
>>>>> I'll start the voting with a +1 - ran tests on the release candidate
>>>>> and ran some basic programs. RC1 passed our performance regression
>>>>> suite, and there are no major changes from that RC.
>>>>>
>>>>> On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
>>>>> wrote:
>>>>>> Please vote on releasing the following candidate as Apache Spark
>>>> version
>>>>> 1.0.1!
>>>>>>
>>>>>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>>>>>
>>>>>
>>>>
>>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>>>>>
>>>>>> The release files, including signatures, digests, etc. can be found
>>> at:
>>>>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>>>>>
>>>>>> Release artifacts are signed with the following key:
>>>>>> https://people.apache.org/keys/committer/pwendell.asc
>>>>>>
>>>>>> The staging repository for this release can be found at:
>>>>>>
>>>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>>>>>
>>>>>> The documentation corresponding to this release can be found at:
>>>>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>>>>>
>>>>>> Please vote on releasing this package as Apache Spark 1.0.1!
>>>>>>
>>>>>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>>>>>> a majority of at least 3 +1 PMC votes are cast.
>>>>>>
>>>>>> [ ] +1 Release this package as Apache Spark 1.0.1
>>>>>> [ ] -1 Do not release this package because ...
>>>>>>
>>>>>> To learn more about Apache Spark, please see
>>>>>> http://spark.apache.org/
>>>>>>
>>>>>> === Differences from RC1 ===
>>>>>> This release includes only one "blocking" patch from rc1:
>>>>>> https://github.com/apache/spark/pull/1255
>>>>>>
>>>>>> There are also smaller fixes which came in over the last week.
>>>>>>
>>>>>> === About this release ===
>>>>>> This release fixes a few high-priority bugs in 1.0 and has a variety
>>>>>> of smaller fixes. The full list is here: http://s.apache.org/b45.
>>> Some
>>>>>> of the more visible patches are:
>>>>>>
>>>>>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>>>>>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
>>>>> size.
>>>>>> SPARK-1790: Support r3 instance types on EC2.
>>>>>>
>>>>>> This is the first maintenance release on the 1.0 line. We plan to
>>> make
>>>>>> additional maintenance releases as new fixes come in.
>>>>>
>>>>
>>>
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Matei Zaharia <ma...@gmail.com>.
+1
Tested on Mac OS X.
Matei
On Jul 6, 2014, at 1:54 AM, Andrew Or <an...@databricks.com> wrote:
> +1, verified that the UI bug is in fact fixed in
> https://github.com/apache/spark/pull/1255.
>
>
> 2014-07-05 20:01 GMT-07:00 Soren Macbeth <so...@yieldbot.com>:
>
>> +1
>>
>>
>> On Sat, Jul 5, 2014 at 7:41 PM, Krishna Sankar <ks...@gmail.com>
>> wrote:
>>
>>> +1
>>>
>>> - Compiled rc2 w/ CentOS 6.5, Yarn,Hadoop 2.2.0 - successful
>>> - Smoke Test (scala,python) (distributed cluster) - successful
>>> - We had ran Java/SparkSQL (count, distinct et al) ~250M records RDD
>>> over HBase 0.98.3 over last build (rc1) - successful
>>> - Stand alone multi-node cluster is working better for us than Yarn
>>>
>>> Cheers
>>> <k/>
>>>
>>>
>>> On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>>
>>>> I'll start the voting with a +1 - ran tests on the release candidate
>>>> and ran some basic programs. RC1 passed our performance regression
>>>> suite, and there are no major changes from that RC.
>>>>
>>>> On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
>>>> wrote:
>>>>> Please vote on releasing the following candidate as Apache Spark
>>> version
>>>> 1.0.1!
>>>>>
>>>>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>>>>
>>>>
>>>
>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>>>>
>>>>> The release files, including signatures, digests, etc. can be found
>> at:
>>>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>>>>
>>>>> Release artifacts are signed with the following key:
>>>>> https://people.apache.org/keys/committer/pwendell.asc
>>>>>
>>>>> The staging repository for this release can be found at:
>>>>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>>>>
>>>>> The documentation corresponding to this release can be found at:
>>>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>>>>
>>>>> Please vote on releasing this package as Apache Spark 1.0.1!
>>>>>
>>>>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>>>>> a majority of at least 3 +1 PMC votes are cast.
>>>>>
>>>>> [ ] +1 Release this package as Apache Spark 1.0.1
>>>>> [ ] -1 Do not release this package because ...
>>>>>
>>>>> To learn more about Apache Spark, please see
>>>>> http://spark.apache.org/
>>>>>
>>>>> === Differences from RC1 ===
>>>>> This release includes only one "blocking" patch from rc1:
>>>>> https://github.com/apache/spark/pull/1255
>>>>>
>>>>> There are also smaller fixes which came in over the last week.
>>>>>
>>>>> === About this release ===
>>>>> This release fixes a few high-priority bugs in 1.0 and has a variety
>>>>> of smaller fixes. The full list is here: http://s.apache.org/b45.
>> Some
>>>>> of the more visible patches are:
>>>>>
>>>>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>>>>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
>>>> size.
>>>>> SPARK-1790: Support r3 instance types on EC2.
>>>>>
>>>>> This is the first maintenance release on the 1.0 line. We plan to
>> make
>>>>> additional maintenance releases as new fixes come in.
>>>>
>>>
>>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Andrew Or <an...@databricks.com>.
+1, verified that the UI bug is in fact fixed in
https://github.com/apache/spark/pull/1255.
2014-07-05 20:01 GMT-07:00 Soren Macbeth <so...@yieldbot.com>:
> +1
>
>
> On Sat, Jul 5, 2014 at 7:41 PM, Krishna Sankar <ks...@gmail.com>
> wrote:
>
> > +1
> >
> > - Compiled rc2 w/ CentOS 6.5, Yarn,Hadoop 2.2.0 - successful
> > - Smoke Test (scala,python) (distributed cluster) - successful
> > - We had ran Java/SparkSQL (count, distinct et al) ~250M records RDD
> > over HBase 0.98.3 over last build (rc1) - successful
> > - Stand alone multi-node cluster is working better for us than Yarn
> >
> > Cheers
> > <k/>
> >
> >
> > On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> >
> > > I'll start the voting with a +1 - ran tests on the release candidate
> > > and ran some basic programs. RC1 passed our performance regression
> > > suite, and there are no major changes from that RC.
> > >
> > > On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> > > wrote:
> > > > Please vote on releasing the following candidate as Apache Spark
> > version
> > > 1.0.1!
> > > >
> > > > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> > > >
> > > > The release files, including signatures, digests, etc. can be found
> at:
> > > > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> > > >
> > > > Release artifacts are signed with the following key:
> > > > https://people.apache.org/keys/committer/pwendell.asc
> > > >
> > > > The staging repository for this release can be found at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachespark-1021/
> > > >
> > > > The documentation corresponding to this release can be found at:
> > > > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> > > >
> > > > Please vote on releasing this package as Apache Spark 1.0.1!
> > > >
> > > > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > > > a majority of at least 3 +1 PMC votes are cast.
> > > >
> > > > [ ] +1 Release this package as Apache Spark 1.0.1
> > > > [ ] -1 Do not release this package because ...
> > > >
> > > > To learn more about Apache Spark, please see
> > > > http://spark.apache.org/
> > > >
> > > > === Differences from RC1 ===
> > > > This release includes only one "blocking" patch from rc1:
> > > > https://github.com/apache/spark/pull/1255
> > > >
> > > > There are also smaller fixes which came in over the last week.
> > > >
> > > > === About this release ===
> > > > This release fixes a few high-priority bugs in 1.0 and has a variety
> > > > of smaller fixes. The full list is here: http://s.apache.org/b45.
> Some
> > > > of the more visible patches are:
> > > >
> > > > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > > > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> > > size.
> > > > SPARK-1790: Support r3 instance types on EC2.
> > > >
> > > > This is the first maintenance release on the 1.0 line. We plan to
> make
> > > > additional maintenance releases as new fixes come in.
> > >
> >
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Soren Macbeth <so...@yieldbot.com>.
+1
On Sat, Jul 5, 2014 at 7:41 PM, Krishna Sankar <ks...@gmail.com> wrote:
> +1
>
> - Compiled rc2 w/ CentOS 6.5, Yarn,Hadoop 2.2.0 - successful
> - Smoke Test (scala,python) (distributed cluster) - successful
> - We had ran Java/SparkSQL (count, distinct et al) ~250M records RDD
> over HBase 0.98.3 over last build (rc1) - successful
> - Stand alone multi-node cluster is working better for us than Yarn
>
> Cheers
> <k/>
>
>
> On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > I'll start the voting with a +1 - ran tests on the release candidate
> > and ran some basic programs. RC1 passed our performance regression
> > suite, and there are no major changes from that RC.
> >
> > On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> > > Please vote on releasing the following candidate as Apache Spark
> version
> > 1.0.1!
> > >
> > > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/pwendell.asc
> > >
> > > The staging repository for this release can be found at:
> > >
> https://repository.apache.org/content/repositories/orgapachespark-1021/
> > >
> > > The documentation corresponding to this release can be found at:
> > > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> > >
> > > Please vote on releasing this package as Apache Spark 1.0.1!
> > >
> > > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > > a majority of at least 3 +1 PMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Spark 1.0.1
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see
> > > http://spark.apache.org/
> > >
> > > === Differences from RC1 ===
> > > This release includes only one "blocking" patch from rc1:
> > > https://github.com/apache/spark/pull/1255
> > >
> > > There are also smaller fixes which came in over the last week.
> > >
> > > === About this release ===
> > > This release fixes a few high-priority bugs in 1.0 and has a variety
> > > of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> > > of the more visible patches are:
> > >
> > > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> > size.
> > > SPARK-1790: Support r3 instance types on EC2.
> > >
> > > This is the first maintenance release on the 1.0 line. We plan to make
> > > additional maintenance releases as new fixes come in.
> >
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Krishna Sankar <ks...@gmail.com>.
+1
- Compiled rc2 w/ CentOS 6.5, Yarn,Hadoop 2.2.0 - successful
- Smoke Test (scala,python) (distributed cluster) - successful
- We had ran Java/SparkSQL (count, distinct et al) ~250M records RDD
over HBase 0.98.3 over last build (rc1) - successful
- Stand alone multi-node cluster is working better for us than Yarn
Cheers
<k/>
On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
> I'll start the voting with a +1 - ran tests on the release candidate
> and ran some basic programs. RC1 passed our performance regression
> suite, and there are no major changes from that RC.
>
> On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> 1.0.1!
> >
> > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1021/
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> >
> > Please vote on releasing this package as Apache Spark 1.0.1!
> >
> > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > a majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.0.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
> >
> > === Differences from RC1 ===
> > This release includes only one "blocking" patch from rc1:
> > https://github.com/apache/spark/pull/1255
> >
> > There are also smaller fixes which came in over the last week.
> >
> > === About this release ===
> > This release fixes a few high-priority bugs in 1.0 and has a variety
> > of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> > of the more visible patches are:
> >
> > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> size.
> > SPARK-1790: Support r3 instance types on EC2.
> >
> > This is the first maintenance release on the 1.0 line. We plan to make
> > additional maintenance releases as new fixes come in.
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by DB Tsai <db...@dbtsai.com>.
+1
On Jul 5, 2014 1:39 PM, "Michael Armbrust" <mi...@databricks.com> wrote:
> +1
>
> I tested sql/hive functionality.
>
>
> On Sat, Jul 5, 2014 at 9:30 AM, Mark Hamstra <ma...@clearstorydata.com>
> wrote:
>
> > +1
> >
> >
> > On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> >
> > > I'll start the voting with a +1 - ran tests on the release candidate
> > > and ran some basic programs. RC1 passed our performance regression
> > > suite, and there are no major changes from that RC.
> > >
> > > On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> > > wrote:
> > > > Please vote on releasing the following candidate as Apache Spark
> > version
> > > 1.0.1!
> > > >
> > > > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> > > >
> > > > The release files, including signatures, digests, etc. can be found
> at:
> > > > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> > > >
> > > > Release artifacts are signed with the following key:
> > > > https://people.apache.org/keys/committer/pwendell.asc
> > > >
> > > > The staging repository for this release can be found at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachespark-1021/
> > > >
> > > > The documentation corresponding to this release can be found at:
> > > > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> > > >
> > > > Please vote on releasing this package as Apache Spark 1.0.1!
> > > >
> > > > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > > > a majority of at least 3 +1 PMC votes are cast.
> > > >
> > > > [ ] +1 Release this package as Apache Spark 1.0.1
> > > > [ ] -1 Do not release this package because ...
> > > >
> > > > To learn more about Apache Spark, please see
> > > > http://spark.apache.org/
> > > >
> > > > === Differences from RC1 ===
> > > > This release includes only one "blocking" patch from rc1:
> > > > https://github.com/apache/spark/pull/1255
> > > >
> > > > There are also smaller fixes which came in over the last week.
> > > >
> > > > === About this release ===
> > > > This release fixes a few high-priority bugs in 1.0 and has a variety
> > > > of smaller fixes. The full list is here: http://s.apache.org/b45.
> Some
> > > > of the more visible patches are:
> > > >
> > > > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > > > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> > > size.
> > > > SPARK-1790: Support r3 instance types on EC2.
> > > >
> > > > This is the first maintenance release on the 1.0 line. We plan to
> make
> > > > additional maintenance releases as new fixes come in.
> > >
> >
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Michael Armbrust <mi...@databricks.com>.
+1
I tested sql/hive functionality.
On Sat, Jul 5, 2014 at 9:30 AM, Mark Hamstra <ma...@clearstorydata.com>
wrote:
> +1
>
>
> On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
> > I'll start the voting with a +1 - ran tests on the release candidate
> > and ran some basic programs. RC1 passed our performance regression
> > suite, and there are no major changes from that RC.
> >
> > On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> > wrote:
> > > Please vote on releasing the following candidate as Apache Spark
> version
> > 1.0.1!
> > >
> > > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> > >
> > > The release files, including signatures, digests, etc. can be found at:
> > > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/pwendell.asc
> > >
> > > The staging repository for this release can be found at:
> > >
> https://repository.apache.org/content/repositories/orgapachespark-1021/
> > >
> > > The documentation corresponding to this release can be found at:
> > > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> > >
> > > Please vote on releasing this package as Apache Spark 1.0.1!
> > >
> > > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > > a majority of at least 3 +1 PMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Spark 1.0.1
> > > [ ] -1 Do not release this package because ...
> > >
> > > To learn more about Apache Spark, please see
> > > http://spark.apache.org/
> > >
> > > === Differences from RC1 ===
> > > This release includes only one "blocking" patch from rc1:
> > > https://github.com/apache/spark/pull/1255
> > >
> > > There are also smaller fixes which came in over the last week.
> > >
> > > === About this release ===
> > > This release fixes a few high-priority bugs in 1.0 and has a variety
> > > of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> > > of the more visible patches are:
> > >
> > > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> > size.
> > > SPARK-1790: Support r3 instance types on EC2.
> > >
> > > This is the first maintenance release on the 1.0 line. We plan to make
> > > additional maintenance releases as new fixes come in.
> >
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Mark Hamstra <ma...@clearstorydata.com>.
+1
On Fri, Jul 4, 2014 at 12:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
> I'll start the voting with a +1 - ran tests on the release candidate
> and ran some basic programs. RC1 passed our performance regression
> suite, and there are no major changes from that RC.
>
> On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> 1.0.1!
> >
> > The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> >
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> >
> > The release files, including signatures, digests, etc. can be found at:
> > http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1021/
> >
> > The documentation corresponding to this release can be found at:
> > http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> >
> > Please vote on releasing this package as Apache Spark 1.0.1!
> >
> > The vote is open until Monday, July 07, at 20:45 UTC and passes if
> > a majority of at least 3 +1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.0.1
> > [ ] -1 Do not release this package because ...
> >
> > To learn more about Apache Spark, please see
> > http://spark.apache.org/
> >
> > === Differences from RC1 ===
> > This release includes only one "blocking" patch from rc1:
> > https://github.com/apache/spark/pull/1255
> >
> > There are also smaller fixes which came in over the last week.
> >
> > === About this release ===
> > This release fixes a few high-priority bugs in 1.0 and has a variety
> > of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> > of the more visible patches are:
> >
> > SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> > SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> size.
> > SPARK-1790: Support r3 instance types on EC2.
> >
> > This is the first maintenance release on the 1.0 line. We plan to make
> > additional maintenance releases as new fixes come in.
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
I'll start the voting with a +1 - ran tests on the release candidate
and ran some basic programs. RC1 passed our performance regression
suite, and there are no major changes from that RC.
On Fri, Jul 4, 2014 at 12:39 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Please vote on releasing the following candidate as Apache Spark version 1.0.1!
>
> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1021/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>
> Please vote on releasing this package as Apache Spark 1.0.1!
>
> The vote is open until Monday, July 07, at 20:45 UTC and passes if
> a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.0.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> === Differences from RC1 ===
> This release includes only one "blocking" patch from rc1:
> https://github.com/apache/spark/pull/1255
>
> There are also smaller fixes which came in over the last week.
>
> === About this release ===
> This release fixes a few high-priority bugs in 1.0 and has a variety
> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> of the more visible patches are:
>
> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
> SPARK-1790: Support r3 instance types on EC2.
>
> This is the first maintenance release on the 1.0 line. We plan to make
> additional maintenance releases as new fixes come in.
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
Okay just FYI - I'm closing this vote since many people are waiting on
the release and I was hoping to package it today. If we find a
reproducible Mesos issue here, we can definitely spin the fix into a
subsequent release.
On Fri, Jul 11, 2014 at 9:37 AM, Patrick Wendell <pw...@gmail.com> wrote:
> Hey Gary,
>
> Why do you think the akka frame size changed? It didn't change - we
> added some fixes for cases where users were setting non-default
> values.
>
> On Fri, Jul 11, 2014 at 9:31 AM, Gary Malouf <ma...@gmail.com> wrote:
>> Hi Matei,
>>
>> We have not had time to re-deploy the rc today, but one thing that jumps
>> out is the shrinking of the default akka frame size from 10MB to around
>> 128KB by default. That is my first suspicion for our issue - could imagine
>> that biting others as well.
>>
>> I'll try to re-test that today - either way, understand moving forward at
>> this point.
>>
>> Gary
>>
>>
>> On Fri, Jul 11, 2014 at 12:08 PM, Matei Zaharia <ma...@gmail.com>
>> wrote:
>>
>>> Unless you can diagnose the problem quickly, Gary, I think we need to go
>>> ahead with this release as is. This release didn't touch the Mesos support
>>> as far as I know, so the problem might be a nondeterministic issue with
>>> your application. But on the other hand the release does fix some critical
>>> bugs that affect all users. We can always do 1.0.2 later if we discover a
>>> problem.
>>>
>>> Matei
>>>
>>> On Jul 10, 2014, at 9:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
>>>
>>> > Hey Gary,
>>> >
>>> > The vote technically doesn't close until I send the vote summary
>>> > e-mail, but I was planning to close and package this tonight. It's too
>>> > bad if there is a regression, it might be worth holding the release
>>> > but it really requires narrowing down the issue to get more
>>> > information about the scope and severity. Could you fork another
>>> > thread for this?
>>> >
>>> > - Patrick
>>> >
>>> > On Thu, Jul 10, 2014 at 6:28 PM, Gary Malouf <ma...@gmail.com>
>>> wrote:
>>> >> -1 I honestly do not know the voting rules for the Spark community, so
>>> >> please excuse me if I am out of line or if Mesos compatibility is not a
>>> >> concern at this point.
>>> >>
>>> >> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
>>> >> 0.18.2. All of our jobs with data above a few gigabytes hung
>>> indefinitely.
>>> >> Downgrading back to the 1.0.0 stable release of Spark built the same way
>>> >> worked for us.
>>> >>
>>> >>
>>> >> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tgraves_cs@yahoo.com.invalid
>>> >
>>> >> wrote:
>>> >>
>>> >>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
>>> >>> authentication on.
>>> >>>
>>> >>> Tom
>>> >>>
>>> >>>
>>> >>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
>>> >>> wrote:
>>> >>>
>>> >>>
>>> >>>
>>> >>> Please vote on releasing the following candidate as Apache Spark
>>> version
>>> >>> 1.0.1!
>>> >>>
>>> >>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>> >>>
>>> >>>
>>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>> >>>
>>> >>> The release files, including signatures, digests, etc. can be found at:
>>> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>> >>>
>>> >>> Release artifacts are signed with the following key:
>>> >>> https://people.apache.org/keys/committer/pwendell.asc
>>> >>>
>>> >>> The staging repository for this release can be found at:
>>> >>>
>>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>> >>>
>>> >>> The documentation corresponding to this release can be found at:
>>> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>> >>>
>>> >>> Please vote on releasing this package as Apache Spark 1.0.1!
>>> >>>
>>> >>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>>> >>> a majority of at least 3 +1 PMC votes are cast.
>>> >>>
>>> >>> [ ] +1 Release this package as Apache Spark 1.0.1
>>> >>> [ ] -1 Do not release this package because ...
>>> >>>
>>> >>> To learn more about Apache Spark, please see
>>> >>> http://spark.apache.org/
>>> >>>
>>> >>> === Differences from RC1 ===
>>> >>> This release includes only one "blocking" patch from rc1:
>>> >>> https://github.com/apache/spark/pull/1255
>>> >>>
>>> >>> There are also smaller fixes which came in over the last week.
>>> >>>
>>> >>> === About this release ===
>>> >>> This release fixes a few high-priority bugs in 1.0 and has a variety
>>> >>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
>>> >>> of the more visible patches are:
>>> >>>
>>> >>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>>> >>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
>>> size.
>>> >>> SPARK-1790: Support r3 instance types on EC2.
>>> >>>
>>> >>> This is the first maintenance release on the 1.0 line. We plan to make
>>> >>> additional maintenance releases as new fixes come in.
>>> >>>
>>>
>>>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
Hey Gary,
Why do you think the akka frame size changed? It didn't change - we
added some fixes for cases where users were setting non-default
values.
On Fri, Jul 11, 2014 at 9:31 AM, Gary Malouf <ma...@gmail.com> wrote:
> Hi Matei,
>
> We have not had time to re-deploy the rc today, but one thing that jumps
> out is the shrinking of the default akka frame size from 10MB to around
> 128KB by default. That is my first suspicion for our issue - could imagine
> that biting others as well.
>
> I'll try to re-test that today - either way, understand moving forward at
> this point.
>
> Gary
>
>
> On Fri, Jul 11, 2014 at 12:08 PM, Matei Zaharia <ma...@gmail.com>
> wrote:
>
>> Unless you can diagnose the problem quickly, Gary, I think we need to go
>> ahead with this release as is. This release didn't touch the Mesos support
>> as far as I know, so the problem might be a nondeterministic issue with
>> your application. But on the other hand the release does fix some critical
>> bugs that affect all users. We can always do 1.0.2 later if we discover a
>> problem.
>>
>> Matei
>>
>> On Jul 10, 2014, at 9:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
>>
>> > Hey Gary,
>> >
>> > The vote technically doesn't close until I send the vote summary
>> > e-mail, but I was planning to close and package this tonight. It's too
>> > bad if there is a regression, it might be worth holding the release
>> > but it really requires narrowing down the issue to get more
>> > information about the scope and severity. Could you fork another
>> > thread for this?
>> >
>> > - Patrick
>> >
>> > On Thu, Jul 10, 2014 at 6:28 PM, Gary Malouf <ma...@gmail.com>
>> wrote:
>> >> -1 I honestly do not know the voting rules for the Spark community, so
>> >> please excuse me if I am out of line or if Mesos compatibility is not a
>> >> concern at this point.
>> >>
>> >> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
>> >> 0.18.2. All of our jobs with data above a few gigabytes hung
>> indefinitely.
>> >> Downgrading back to the 1.0.0 stable release of Spark built the same way
>> >> worked for us.
>> >>
>> >>
>> >> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tgraves_cs@yahoo.com.invalid
>> >
>> >> wrote:
>> >>
>> >>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
>> >>> authentication on.
>> >>>
>> >>> Tom
>> >>>
>> >>>
>> >>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
>> >>> wrote:
>> >>>
>> >>>
>> >>>
>> >>> Please vote on releasing the following candidate as Apache Spark
>> version
>> >>> 1.0.1!
>> >>>
>> >>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>> >>>
>> >>>
>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>> >>>
>> >>> The release files, including signatures, digests, etc. can be found at:
>> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>> >>>
>> >>> Release artifacts are signed with the following key:
>> >>> https://people.apache.org/keys/committer/pwendell.asc
>> >>>
>> >>> The staging repository for this release can be found at:
>> >>>
>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>> >>>
>> >>> The documentation corresponding to this release can be found at:
>> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>> >>>
>> >>> Please vote on releasing this package as Apache Spark 1.0.1!
>> >>>
>> >>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>> >>> a majority of at least 3 +1 PMC votes are cast.
>> >>>
>> >>> [ ] +1 Release this package as Apache Spark 1.0.1
>> >>> [ ] -1 Do not release this package because ...
>> >>>
>> >>> To learn more about Apache Spark, please see
>> >>> http://spark.apache.org/
>> >>>
>> >>> === Differences from RC1 ===
>> >>> This release includes only one "blocking" patch from rc1:
>> >>> https://github.com/apache/spark/pull/1255
>> >>>
>> >>> There are also smaller fixes which came in over the last week.
>> >>>
>> >>> === About this release ===
>> >>> This release fixes a few high-priority bugs in 1.0 and has a variety
>> >>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
>> >>> of the more visible patches are:
>> >>>
>> >>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>> >>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
>> size.
>> >>> SPARK-1790: Support r3 instance types on EC2.
>> >>>
>> >>> This is the first maintenance release on the 1.0 line. We plan to make
>> >>> additional maintenance releases as new fixes come in.
>> >>>
>>
>>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Gary Malouf <ma...@gmail.com>.
Hi Matei,
We have not had time to re-deploy the rc today, but one thing that jumps
out is the shrinking of the default akka frame size from 10MB to around
128KB by default. That is my first suspicion for our issue - could imagine
that biting others as well.
I'll try to re-test that today - either way, understand moving forward at
this point.
Gary
On Fri, Jul 11, 2014 at 12:08 PM, Matei Zaharia <ma...@gmail.com>
wrote:
> Unless you can diagnose the problem quickly, Gary, I think we need to go
> ahead with this release as is. This release didn't touch the Mesos support
> as far as I know, so the problem might be a nondeterministic issue with
> your application. But on the other hand the release does fix some critical
> bugs that affect all users. We can always do 1.0.2 later if we discover a
> problem.
>
> Matei
>
> On Jul 10, 2014, at 9:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
>
> > Hey Gary,
> >
> > The vote technically doesn't close until I send the vote summary
> > e-mail, but I was planning to close and package this tonight. It's too
> > bad if there is a regression, it might be worth holding the release
> > but it really requires narrowing down the issue to get more
> > information about the scope and severity. Could you fork another
> > thread for this?
> >
> > - Patrick
> >
> > On Thu, Jul 10, 2014 at 6:28 PM, Gary Malouf <ma...@gmail.com>
> wrote:
> >> -1 I honestly do not know the voting rules for the Spark community, so
> >> please excuse me if I am out of line or if Mesos compatibility is not a
> >> concern at this point.
> >>
> >> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
> >> 0.18.2. All of our jobs with data above a few gigabytes hung
> indefinitely.
> >> Downgrading back to the 1.0.0 stable release of Spark built the same way
> >> worked for us.
> >>
> >>
> >> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tgraves_cs@yahoo.com.invalid
> >
> >> wrote:
> >>
> >>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
> >>> authentication on.
> >>>
> >>> Tom
> >>>
> >>>
> >>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
> >>> wrote:
> >>>
> >>>
> >>>
> >>> Please vote on releasing the following candidate as Apache Spark
> version
> >>> 1.0.1!
> >>>
> >>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
> >>>
> >>>
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
> >>>
> >>> The release files, including signatures, digests, etc. can be found at:
> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
> >>>
> >>> Release artifacts are signed with the following key:
> >>> https://people.apache.org/keys/committer/pwendell.asc
> >>>
> >>> The staging repository for this release can be found at:
> >>>
> https://repository.apache.org/content/repositories/orgapachespark-1021/
> >>>
> >>> The documentation corresponding to this release can be found at:
> >>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
> >>>
> >>> Please vote on releasing this package as Apache Spark 1.0.1!
> >>>
> >>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
> >>> a majority of at least 3 +1 PMC votes are cast.
> >>>
> >>> [ ] +1 Release this package as Apache Spark 1.0.1
> >>> [ ] -1 Do not release this package because ...
> >>>
> >>> To learn more about Apache Spark, please see
> >>> http://spark.apache.org/
> >>>
> >>> === Differences from RC1 ===
> >>> This release includes only one "blocking" patch from rc1:
> >>> https://github.com/apache/spark/pull/1255
> >>>
> >>> There are also smaller fixes which came in over the last week.
> >>>
> >>> === About this release ===
> >>> This release fixes a few high-priority bugs in 1.0 and has a variety
> >>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> >>> of the more visible patches are:
> >>>
> >>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> >>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
> size.
> >>> SPARK-1790: Support r3 instance types on EC2.
> >>>
> >>> This is the first maintenance release on the 1.0 line. We plan to make
> >>> additional maintenance releases as new fixes come in.
> >>>
>
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Matei Zaharia <ma...@gmail.com>.
Unless you can diagnose the problem quickly, Gary, I think we need to go ahead with this release as is. This release didn't touch the Mesos support as far as I know, so the problem might be a nondeterministic issue with your application. But on the other hand the release does fix some critical bugs that affect all users. We can always do 1.0.2 later if we discover a problem.
Matei
On Jul 10, 2014, at 9:40 PM, Patrick Wendell <pw...@gmail.com> wrote:
> Hey Gary,
>
> The vote technically doesn't close until I send the vote summary
> e-mail, but I was planning to close and package this tonight. It's too
> bad if there is a regression, it might be worth holding the release
> but it really requires narrowing down the issue to get more
> information about the scope and severity. Could you fork another
> thread for this?
>
> - Patrick
>
> On Thu, Jul 10, 2014 at 6:28 PM, Gary Malouf <ma...@gmail.com> wrote:
>> -1 I honestly do not know the voting rules for the Spark community, so
>> please excuse me if I am out of line or if Mesos compatibility is not a
>> concern at this point.
>>
>> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
>> 0.18.2. All of our jobs with data above a few gigabytes hung indefinitely.
>> Downgrading back to the 1.0.0 stable release of Spark built the same way
>> worked for us.
>>
>>
>> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tg...@yahoo.com.invalid>
>> wrote:
>>
>>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
>>> authentication on.
>>>
>>> Tom
>>>
>>>
>>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
>>> wrote:
>>>
>>>
>>>
>>> Please vote on releasing the following candidate as Apache Spark version
>>> 1.0.1!
>>>
>>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>>
>>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>>
>>> The release files, including signatures, digests, etc. can be found at:
>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>>
>>> Release artifacts are signed with the following key:
>>> https://people.apache.org/keys/committer/pwendell.asc
>>>
>>> The staging repository for this release can be found at:
>>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>>
>>> The documentation corresponding to this release can be found at:
>>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>>
>>> Please vote on releasing this package as Apache Spark 1.0.1!
>>>
>>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>>> a majority of at least 3 +1 PMC votes are cast.
>>>
>>> [ ] +1 Release this package as Apache Spark 1.0.1
>>> [ ] -1 Do not release this package because ...
>>>
>>> To learn more about Apache Spark, please see
>>> http://spark.apache.org/
>>>
>>> === Differences from RC1 ===
>>> This release includes only one "blocking" patch from rc1:
>>> https://github.com/apache/spark/pull/1255
>>>
>>> There are also smaller fixes which came in over the last week.
>>>
>>> === About this release ===
>>> This release fixes a few high-priority bugs in 1.0 and has a variety
>>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
>>> of the more visible patches are:
>>>
>>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
>>> SPARK-1790: Support r3 instance types on EC2.
>>>
>>> This is the first maintenance release on the 1.0 line. We plan to make
>>> additional maintenance releases as new fixes come in.
>>>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Patrick Wendell <pw...@gmail.com>.
Hey Gary,
The vote technically doesn't close until I send the vote summary
e-mail, but I was planning to close and package this tonight. It's too
bad if there is a regression, it might be worth holding the release
but it really requires narrowing down the issue to get more
information about the scope and severity. Could you fork another
thread for this?
- Patrick
On Thu, Jul 10, 2014 at 6:28 PM, Gary Malouf <ma...@gmail.com> wrote:
> -1 I honestly do not know the voting rules for the Spark community, so
> please excuse me if I am out of line or if Mesos compatibility is not a
> concern at this point.
>
> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
> 0.18.2. All of our jobs with data above a few gigabytes hung indefinitely.
> Downgrading back to the 1.0.0 stable release of Spark built the same way
> worked for us.
>
>
> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tg...@yahoo.com.invalid>
> wrote:
>
>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
>> authentication on.
>>
>> Tom
>>
>>
>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
>> wrote:
>>
>>
>>
>> Please vote on releasing the following candidate as Apache Spark version
>> 1.0.1!
>>
>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>
>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>
>> Please vote on releasing this package as Apache Spark 1.0.1!
>>
>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>> a majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.0.1
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>
>> === Differences from RC1 ===
>> This release includes only one "blocking" patch from rc1:
>> https://github.com/apache/spark/pull/1255
>>
>> There are also smaller fixes which came in over the last week.
>>
>> === About this release ===
>> This release fixes a few high-priority bugs in 1.0 and has a variety
>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
>> of the more visible patches are:
>>
>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
>> SPARK-1790: Support r3 instance types on EC2.
>>
>> This is the first maintenance release on the 1.0 line. We plan to make
>> additional maintenance releases as new fixes come in.
>>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Gary Malouf <ma...@gmail.com>.
Just realized the deadline was Monday, my apologies. The issue
nevertheless stands.
On Thu, Jul 10, 2014 at 9:28 PM, Gary Malouf <ma...@gmail.com> wrote:
> -1 I honestly do not know the voting rules for the Spark community, so
> please excuse me if I am out of line or if Mesos compatibility is not a
> concern at this point.
>
> We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
> 0.18.2. All of our jobs with data above a few gigabytes hung indefinitely.
> Downgrading back to the 1.0.0 stable release of Spark built the same way
> worked for us.
>
>
> On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tg...@yahoo.com.invalid>
> wrote:
>
>> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
>> authentication on.
>>
>> Tom
>>
>>
>> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
>> wrote:
>>
>>
>>
>> Please vote on releasing the following candidate as Apache Spark version
>> 1.0.1!
>>
>> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>>
>> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>>
>> The release files, including signatures, digests, etc. can be found at:
>> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>>
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/pwendell.asc
>>
>> The staging repository for this release can be found at:
>> https://repository.apache.org/content/repositories/orgapachespark-1021/
>>
>> The documentation corresponding to this release can be found at:
>> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>>
>> Please vote on releasing this package as Apache Spark 1.0.1!
>>
>> The vote is open until Monday, July 07, at 20:45 UTC and passes if
>> a majority of at least 3 +1 PMC votes are cast.
>>
>> [ ] +1 Release this package as Apache Spark 1.0.1
>> [ ] -1 Do not release this package because ...
>>
>> To learn more about Apache Spark, please see
>> http://spark.apache.org/
>>
>> === Differences from RC1 ===
>> This release includes only one "blocking" patch from rc1:
>> https://github.com/apache/spark/pull/1255
>>
>> There are also smaller fixes which came in over the last week.
>>
>> === About this release ===
>> This release fixes a few high-priority bugs in 1.0 and has a variety
>> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
>> of the more visible patches are:
>>
>> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
>> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame
>> size.
>> SPARK-1790: Support r3 instance types on EC2.
>>
>> This is the first maintenance release on the 1.0 line. We plan to make
>> additional maintenance releases as new fixes come in.
>>
>
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Gary Malouf <ma...@gmail.com>.
-1 I honestly do not know the voting rules for the Spark community, so
please excuse me if I am out of line or if Mesos compatibility is not a
concern at this point.
We just tried to run this version built against 2.3.0-cdh5.0.2 on mesos
0.18.2. All of our jobs with data above a few gigabytes hung indefinitely.
Downgrading back to the 1.0.0 stable release of Spark built the same way
worked for us.
On Mon, Jul 7, 2014 at 5:17 PM, Tom Graves <tg...@yahoo.com.invalid>
wrote:
> +1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with
> authentication on.
>
> Tom
>
>
> On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com>
> wrote:
>
>
>
> Please vote on releasing the following candidate as Apache Spark version
> 1.0.1!
>
> The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
>
> https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
>
> The release files, including signatures, digests, etc. can be found at:
> http://people.apache.org/~pwendell/spark-1.0.1-rc2/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1021/
>
> The documentation corresponding to this release can be found at:
> http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
>
> Please vote on releasing this package as Apache Spark 1.0.1!
>
> The vote is open until Monday, July 07, at 20:45 UTC and passes if
> a majority of at least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.0.1
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache Spark, please see
> http://spark.apache.org/
>
> === Differences from RC1 ===
> This release includes only one "blocking" patch from rc1:
> https://github.com/apache/spark/pull/1255
>
> There are also smaller fixes which came in over the last week.
>
> === About this release ===
> This release fixes a few high-priority bugs in 1.0 and has a variety
> of smaller fixes. The full list is here: http://s.apache.org/b45. Some
> of the more visible patches are:
>
> SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
> SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
> SPARK-1790: Support r3 instance types on EC2.
>
> This is the first maintenance release on the 1.0 line. We plan to make
> additional maintenance releases as new fixes come in.
>
Re: [VOTE] Release Apache Spark 1.0.1 (RC2)
Posted by Tom Graves <tg...@yahoo.com.INVALID>.
+1. Ran some Spark on yarn jobs on a hadoop 2.4 cluster with authentication on.
Tom
On Friday, July 4, 2014 2:39 PM, Patrick Wendell <pw...@gmail.com> wrote:
Please vote on releasing the following candidate as Apache Spark version 1.0.1!
The tag to be voted on is v1.0.1-rc1 (commit 7d1043c):
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=7d1043c99303b87aef8ee19873629c2bfba4cc78
The release files, including signatures, digests, etc. can be found at:
http://people.apache.org/~pwendell/spark-1.0.1-rc2/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1021/
The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-1.0.1-rc2-docs/
Please vote on releasing this package as Apache Spark 1.0.1!
The vote is open until Monday, July 07, at 20:45 UTC and passes if
a majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 1.0.1
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see
http://spark.apache.org/
=== Differences from RC1 ===
This release includes only one "blocking" patch from rc1:
https://github.com/apache/spark/pull/1255
There are also smaller fixes which came in over the last week.
=== About this release ===
This release fixes a few high-priority bugs in 1.0 and has a variety
of smaller fixes. The full list is here: http://s.apache.org/b45. Some
of the more visible patches are:
SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
SPARK-2156 and SPARK-1112: Issues with jobs hanging due to akka frame size.
SPARK-1790: Support r3 instance types on EC2.
This is the first maintenance release on the 1.0 line. We plan to make
additional maintenance releases as new fixes come in.