You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Robert Evans <ev...@yahoo-inc.com> on 2012/09/29 17:35:34 UTC
[VOTE] 0.23.4 release
I have built a 0.23.4-rc0 and am calling a release vote on it. As per the bylaws this vote will be open for 1 week, and will close next Saturday October 6th.
You can access the release through the apache maven staging repo, with the 0.23.4-rc0 tag in subversion, and at http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
This release is a sustaining release with several important bug fixes in it. Most notably upgrading of a 1.0 cluster with append/sync enabled should now work (HDFS-3731). There are no known blockers against this release, there are only two critical issues.
HADOOP-8811
Compile hadoop native library in FreeBSD
HDFS-3990
NN's health report has severe performance problems
HDFS-3990 only really has a significant impact on large clusters, and can be mitigated by enabling DNS caching.
I have run several manual tests on this release on a small insecure cluster and all of them pass I am a +1 (binding) for this release.
On a side note I am happy to announce that the 0.23 line is being rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000 node cluster and have only seen a few issues (HDFS-3990 is the biggest of them). I expect to do a 0.23.5 release in the coming weeks/months as we find more issues running on large clusters.
--Bobby Evans
Re: [VOTE] 0.23.4 release
Posted by Siddharth Seth <se...@gmail.com>.
+1.
Verified signatures and checksums.
Built from source, and successfully ran a couple of simple jobs on a single
node non-secure cluster.
Thanks
- Sid
On Mon, Oct 8, 2012 at 12:12 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Thanks for catching that. There was a bug in my script that I used to
> build everything for the release. It rebuilt the src tag ball after I had
> signed the original. The contents are the same, but the date/time stamps
> were off. I uploaded a new version of the offending tar.gz with the
> corresponding signature and mds files.
>
> Thanks again,
>
> Bobby
>
> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>
> >Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
> >
> >Thanks
> >- Sid
> >
> >On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> >
> >> Thanks for the help everyone on this. I have re-spun the release. You
> >> can get it at
> >>
> >> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
> >> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
> >>
> >> And through the apache maven staging repository.
> >>
> >> The only difference is some debugging code removed. The vote now goes
> >> until Monday 15th. I am a +1 for the release.
> >>
> >> --Bobby Evans
> >>
> >> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
> >>
> >> >Arun, if you could re-spin it I would be happy to let you. If not I
> >>can
> >> >do it myself on Monday. My box that is set up to do the builds is
> >>offline
> >> >until Monday. There are some workman fixing some things in my cube
> >>this
> >> >weekend.
> >> >
> >> >Thanks for your help,
> >> >
> >> >Bobby
> >> >
> >> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
> >> >
> >> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
> >> >>
> >> >>Arun
> >> >>
> >> >>Sent from my iPhone
> >> >>
> >> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
> wrote:
> >> >>
> >> >>> Bobby,
> >> >>> It looks like some debugging code got committed and rolled into the
> >> >>> release. I think we'll need to re-spin the rc after fixing it, so
> >>-1.
> >> >>>
> >> >>> Thanks,
> >> >>> Owen
> >> >
> >>
> >>
>
>
Re: [VOTE] 0.23.4 release
Posted by "Aaron T. Myers" <at...@cloudera.com>.
+1 (binding)
I verified the checksum and signature of the source artifact, built the
source artifact, started HDFS and YARN, and ran some simple jobs on a
pseudo cluster. Everything worked as expected.
--
Aaron T. Myers
Software Engineer, Cloudera
On Mon, Oct 8, 2012 at 12:12 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Thanks for catching that. There was a bug in my script that I used to
> build everything for the release. It rebuilt the src tag ball after I had
> signed the original. The contents are the same, but the date/time stamps
> were off. I uploaded a new version of the offending tar.gz with the
> corresponding signature and mds files.
>
> Thanks again,
>
> Bobby
>
> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>
> >Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
> >
> >Thanks
> >- Sid
> >
> >On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> >
> >> Thanks for the help everyone on this. I have re-spun the release. You
> >> can get it at
> >>
> >> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
> >> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
> >>
> >> And through the apache maven staging repository.
> >>
> >> The only difference is some debugging code removed. The vote now goes
> >> until Monday 15th. I am a +1 for the release.
> >>
> >> --Bobby Evans
> >>
> >> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
> >>
> >> >Arun, if you could re-spin it I would be happy to let you. If not I
> >>can
> >> >do it myself on Monday. My box that is set up to do the builds is
> >>offline
> >> >until Monday. There are some workman fixing some things in my cube
> >>this
> >> >weekend.
> >> >
> >> >Thanks for your help,
> >> >
> >> >Bobby
> >> >
> >> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
> >> >
> >> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
> >> >>
> >> >>Arun
> >> >>
> >> >>Sent from my iPhone
> >> >>
> >> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
> wrote:
> >> >>
> >> >>> Bobby,
> >> >>> It looks like some debugging code got committed and rolled into the
> >> >>> release. I think we'll need to re-spin the rc after fixing it, so
> >>-1.
> >> >>>
> >> >>> Thanks,
> >> >>> Owen
> >> >
> >>
> >>
>
>
Re: [VOTE] 0.23.4 release
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Great news! Thanks for the update, Bobby!
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Oct 15, 2012, at 12:55 PM, Robert Evans wrote:
> From my count we have 5 binding +1 votes and no -1s so it passes. I will upgrade nexus and move the tag to its final value.
>
> Thanks for the help from everyone.
>
> On a related note I am happy to say that 0.23.3 has moved to an even larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node cluster, still with no new issues beyond those we saw on the previous 2000 node cluster. There is still some polishing to do, but YARN is looking fairly good so far. Which is great because this cluster has a few production jobs running on it :).
>
> --Bobby
>
> -----Original Message-----
> From: Robert Evans [mailto:evans@yahoo-inc.com]
> Sent: Monday, October 08, 2012 12:12 PM
> To: general@hadoop.apache.org
> Subject: Re: [VOTE] 0.23.4 release
>
> Thanks for catching that. There was a bug in my script that I used to
> build everything for the release. It rebuilt the src tag ball after I had
> signed the original. The contents are the same, but the date/time stamps
> were off. I uploaded a new version of the offending tar.gz with the
> corresponding signature and mds files.
>
> Thanks again,
>
> Bobby
>
> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>
>> Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>
>> Thanks
>> - Sid
>>
>> On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>>
>>> Thanks for the help everyone on this. I have re-spun the release. You
>>> can get it at
>>>
>>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>
>>> And through the apache maven staging repository.
>>>
>>> The only difference is some debugging code removed. The vote now goes
>>> until Monday 15th. I am a +1 for the release.
>>>
>>> --Bobby Evans
>>>
>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>
>>>> Arun, if you could re-spin it I would be happy to let you. If not I
>>> can
>>>> do it myself on Monday. My box that is set up to do the builds is
>>> offline
>>>> until Monday. There are some workman fixing some things in my cube
>>> this
>>>> weekend.
>>>>
>>>> Thanks for your help,
>>>>
>>>> Bobby
>>>>
>>>> On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>
>>>>> I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>>
>>>>> Arun
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>> On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>>>>
>>>>>> Bobby,
>>>>>> It looks like some debugging code got committed and rolled into the
>>>>>> release. I think we'll need to re-spin the rc after fixing it, so
>>> -1.
>>>>>>
>>>>>> Thanks,
>>>>>> Owen
>>>>
>>>
>>>
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
I just wanted to be sure. I have update the files on people.apache.org.
Thanks for catching that.
--Bobby
On 10/22/12 8:17 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>On Oct 22, 2012, at 5:04 PM, Konstantin Shvachko wrote:
>
>> I believe the binary release is just a convenience that we provide to
>>users.
>> The actual release is the source. So I am not sure a new vote is needed.
>> But the tar file should be replaced in the official place somehow.
>> Otherwise people will be confused.
>>
>
>+1 to what Konstantin says.
>
>Arun
>
>> Thanks,
>> --Konstantin
>>
>> On Mon, Oct 22, 2012 at 11:19 AM, Robert Evans <ev...@yahoo-inc.com>
>>wrote:
>>> I rebuilt the package using the same code and uploaded the new .tar.gz
>>>and
>>> everything that goes with it to
>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2-try-2/ The
>>>only
>>> thing I can think of is that it must have been caused by a bug in my
>>> script that I used to try and build a 64-bit version of the package as
>>> well. I disabled that because it had other problems. I don't know if
>>>you
>>> want to have me call another vote to try and replace the binary
>>>release or
>>> not, but this one has the correct hadoop-auth.jar in it now.
>>>
>>> Sorry about that.
>>>
>>> --Bobby
>>>
>>> On 10/22/12 12:53 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>
>>>> Wow that is very odd, I really don't know what happened there.
>>>>
>>>> It is available through the maven repo at
>>>>
>>>>https://repository.apache.org/content/groups/public/org/apache/hadoop/h
>>>>ado
>>>> o
>>>> p-auth/0.23.4/ but I cannot figure out how it is missing from the
>>>>tar.gz
>>>> file. It is in all of the others that I have created. I will try and
>>>> rebuild it and see if I can figure out what happened.
>>>>
>>>> Sorry about that,
>>>>
>>>> Bobby
>>>>
>>>> On 10/19/12 4:28 PM, "Konstantin Shvachko" <sh...@gmail.com>
>>>>wrote:
>>>>
>>>>> Ok it was not personal. Sorry.
>>>>> --Konst
>>>>>
>>>>> On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
>>>>> <sh...@gmail.com> wrote:
>>>>>> Hi Bobby,
>>>>>>
>>>>>> This is personal email, not on general.
>>>>>> I was wondering where did the hadoop-auth.jar go in that last
>>>>>>release?
>>>>>> Couldn't find it in the binary distro.
>>>>>> I might missed something so will appreciate your comments.
>>>>>>
>>>>>> Thanks,
>>>>>> --Konst
>>>>>>
>>>>>>
>>>>>> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com>
>>>>>> wrote:
>>>>>>> From my count we have 5 binding +1 votes and no -1s so it passes.
>>>>>>>I
>>>>>>> will upgrade nexus and move the tag to its final value.
>>>>>>>
>>>>>>> Thanks for the help from everyone.
>>>>>>>
>>>>>>> On a related note I am happy to say that 0.23.3 has moved to an
>>>>>>>even
>>>>>>> larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600
>>>>>>>node
>>>>>>> cluster, still with no new issues beyond those we saw on the
>>>>>>>previous
>>>>>>> 2000 node cluster. There is still some polishing to do, but YARN
>>>>>>>is
>>>>>>> looking fairly good so far. Which is great because this cluster
>>>>>>>has a
>>>>>>> few production jobs running on it :).
>>>>>>>
>>>>>>> --Bobby
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>>>>>>> Sent: Monday, October 08, 2012 12:12 PM
>>>>>>> To: general@hadoop.apache.org
>>>>>>> Subject: Re: [VOTE] 0.23.4 release
>>>>>>>
>>>>>>> Thanks for catching that. There was a bug in my script that I
>>>>>>>used to
>>>>>>> build everything for the release. It rebuilt the src tag ball
>>>>>>>after I
>>>>>>> had
>>>>>>> signed the original. The contents are the same, but the date/time
>>>>>>> stamps
>>>>>>> were off. I uploaded a new version of the offending tar.gz with
>>>>>>>the
>>>>>>> corresponding signature and mds files.
>>>>>>>
>>>>>>> Thanks again,
>>>>>>>
>>>>>>> Bobby
>>>>>>>
>>>>>>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com>
>>>>>>>wrote:
>>>>>>>
>>>>>>>> Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> - Sid
>>>>>>>>
>>>>>>>> On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Thanks for the help everyone on this. I have re-spun the
>>>>>>>>>release.
>>>>>>>>> You
>>>>>>>>> can get it at
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4
>>>>>>>>>-rc
>>>>>>>>> 2
>>>>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>>>>>>
>>>>>>>>> And through the apache maven staging repository.
>>>>>>>>>
>>>>>>>>> The only difference is some debugging code removed. The vote now
>>>>>>>>> goes
>>>>>>>>> until Monday 15th. I am a +1 for the release.
>>>>>>>>>
>>>>>>>>> --Bobby Evans
>>>>>>>>>
>>>>>>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>>>>>>
>>>>>>>>>> Arun, if you could re-spin it I would be happy to let you. If
>>>>>>>>>>not
>>>>>>>>> I
>>>>>>>>> can
>>>>>>>>>> do it myself on Monday. My box that is set up to do the builds
>>>>>>>>>>is
>>>>>>>>> offline
>>>>>>>>>> until Monday. There are some workman fixing some things in my
>>>>>>>>>>cube
>>>>>>>>> this
>>>>>>>>>> weekend.
>>>>>>>>>>
>>>>>>>>>> Thanks for your help,
>>>>>>>>>>
>>>>>>>>>> Bobby
>>>>>>>>>>
>>>>>>>>>> On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>>>>>>>>
>>>>>>>>>>> Arun
>>>>>>>>>>>
>>>>>>>>>>> Sent from my iPhone
>>>>>>>>>>>
>>>>>>>>>>> On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Bobby,
>>>>>>>>>>>> It looks like some debugging code got committed and rolled
>>>>>>>>>>>>into
>>>>>>>>> the
>>>>>>>>>>>> release. I think we'll need to re-spin the rc after fixing it,
>>>>>>>>> so
>>>>>>>>> -1.
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Owen
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>>
>>>
>
>--
>Arun C. Murthy
>Hortonworks Inc.
>http://hortonworks.com/
>
>
Re: [VOTE] 0.23.4 release
Posted by Arun C Murthy <ac...@hortonworks.com>.
On Oct 22, 2012, at 5:04 PM, Konstantin Shvachko wrote:
> I believe the binary release is just a convenience that we provide to users.
> The actual release is the source. So I am not sure a new vote is needed.
> But the tar file should be replaced in the official place somehow.
> Otherwise people will be confused.
>
+1 to what Konstantin says.
Arun
> Thanks,
> --Konstantin
>
> On Mon, Oct 22, 2012 at 11:19 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>> I rebuilt the package using the same code and uploaded the new .tar.gz and
>> everything that goes with it to
>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2-try-2/ The only
>> thing I can think of is that it must have been caused by a bug in my
>> script that I used to try and build a 64-bit version of the package as
>> well. I disabled that because it had other problems. I don't know if you
>> want to have me call another vote to try and replace the binary release or
>> not, but this one has the correct hadoop-auth.jar in it now.
>>
>> Sorry about that.
>>
>> --Bobby
>>
>> On 10/22/12 12:53 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>
>>> Wow that is very odd, I really don't know what happened there.
>>>
>>> It is available through the maven repo at
>>> https://repository.apache.org/content/groups/public/org/apache/hadoop/hado
>>> o
>>> p-auth/0.23.4/ but I cannot figure out how it is missing from the tar.gz
>>> file. It is in all of the others that I have created. I will try and
>>> rebuild it and see if I can figure out what happened.
>>>
>>> Sorry about that,
>>>
>>> Bobby
>>>
>>> On 10/19/12 4:28 PM, "Konstantin Shvachko" <sh...@gmail.com> wrote:
>>>
>>>> Ok it was not personal. Sorry.
>>>> --Konst
>>>>
>>>> On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
>>>> <sh...@gmail.com> wrote:
>>>>> Hi Bobby,
>>>>>
>>>>> This is personal email, not on general.
>>>>> I was wondering where did the hadoop-auth.jar go in that last release?
>>>>> Couldn't find it in the binary distro.
>>>>> I might missed something so will appreciate your comments.
>>>>>
>>>>> Thanks,
>>>>> --Konst
>>>>>
>>>>>
>>>>> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com>
>>>>> wrote:
>>>>>> From my count we have 5 binding +1 votes and no -1s so it passes. I
>>>>>> will upgrade nexus and move the tag to its final value.
>>>>>>
>>>>>> Thanks for the help from everyone.
>>>>>>
>>>>>> On a related note I am happy to say that 0.23.3 has moved to an even
>>>>>> larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node
>>>>>> cluster, still with no new issues beyond those we saw on the previous
>>>>>> 2000 node cluster. There is still some polishing to do, but YARN is
>>>>>> looking fairly good so far. Which is great because this cluster has a
>>>>>> few production jobs running on it :).
>>>>>>
>>>>>> --Bobby
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>>>>>> Sent: Monday, October 08, 2012 12:12 PM
>>>>>> To: general@hadoop.apache.org
>>>>>> Subject: Re: [VOTE] 0.23.4 release
>>>>>>
>>>>>> Thanks for catching that. There was a bug in my script that I used to
>>>>>> build everything for the release. It rebuilt the src tag ball after I
>>>>>> had
>>>>>> signed the original. The contents are the same, but the date/time
>>>>>> stamps
>>>>>> were off. I uploaded a new version of the offending tar.gz with the
>>>>>> corresponding signature and mds files.
>>>>>>
>>>>>> Thanks again,
>>>>>>
>>>>>> Bobby
>>>>>>
>>>>>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>>>>>>
>>>>>>> Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>>>>>
>>>>>>> Thanks
>>>>>>> - Sid
>>>>>>>
>>>>>>> On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Thanks for the help everyone on this. I have re-spun the release.
>>>>>>>> You
>>>>>>>> can get it at
>>>>>>>>
>>>>>>>>
>>>>>>>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc
>>>>>>>> 2
>>>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>>>>>
>>>>>>>> And through the apache maven staging repository.
>>>>>>>>
>>>>>>>> The only difference is some debugging code removed. The vote now
>>>>>>>> goes
>>>>>>>> until Monday 15th. I am a +1 for the release.
>>>>>>>>
>>>>>>>> --Bobby Evans
>>>>>>>>
>>>>>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>>>>>
>>>>>>>>> Arun, if you could re-spin it I would be happy to let you. If not
>>>>>>>> I
>>>>>>>> can
>>>>>>>>> do it myself on Monday. My box that is set up to do the builds is
>>>>>>>> offline
>>>>>>>>> until Monday. There are some workman fixing some things in my cube
>>>>>>>> this
>>>>>>>>> weekend.
>>>>>>>>>
>>>>>>>>> Thanks for your help,
>>>>>>>>>
>>>>>>>>> Bobby
>>>>>>>>>
>>>>>>>>> On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>>>>>>
>>>>>>>>>> I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>>>>>>>
>>>>>>>>>> Arun
>>>>>>>>>>
>>>>>>>>>> Sent from my iPhone
>>>>>>>>>>
>>>>>>>>>> On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Bobby,
>>>>>>>>>>> It looks like some debugging code got committed and rolled into
>>>>>>>> the
>>>>>>>>>>> release. I think we'll need to re-spin the rc after fixing it,
>>>>>>>> so
>>>>>>>> -1.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Owen
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>
>>>
>>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] 0.23.4 release
Posted by Konstantin Shvachko <sh...@gmail.com>.
I believe the binary release is just a convenience that we provide to users.
The actual release is the source. So I am not sure a new vote is needed.
But the tar file should be replaced in the official place somehow.
Otherwise people will be confused.
Thanks,
--Konstantin
On Mon, Oct 22, 2012 at 11:19 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> I rebuilt the package using the same code and uploaded the new .tar.gz and
> everything that goes with it to
> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2-try-2/ The only
> thing I can think of is that it must have been caused by a bug in my
> script that I used to try and build a 64-bit version of the package as
> well. I disabled that because it had other problems. I don't know if you
> want to have me call another vote to try and replace the binary release or
> not, but this one has the correct hadoop-auth.jar in it now.
>
> Sorry about that.
>
> --Bobby
>
> On 10/22/12 12:53 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>
>>Wow that is very odd, I really don't know what happened there.
>>
>>It is available through the maven repo at
>>https://repository.apache.org/content/groups/public/org/apache/hadoop/hado
>>o
>>p-auth/0.23.4/ but I cannot figure out how it is missing from the tar.gz
>>file. It is in all of the others that I have created. I will try and
>>rebuild it and see if I can figure out what happened.
>>
>>Sorry about that,
>>
>>Bobby
>>
>>On 10/19/12 4:28 PM, "Konstantin Shvachko" <sh...@gmail.com> wrote:
>>
>>>Ok it was not personal. Sorry.
>>>--Konst
>>>
>>>On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
>>><sh...@gmail.com> wrote:
>>>> Hi Bobby,
>>>>
>>>> This is personal email, not on general.
>>>> I was wondering where did the hadoop-auth.jar go in that last release?
>>>> Couldn't find it in the binary distro.
>>>> I might missed something so will appreciate your comments.
>>>>
>>>> Thanks,
>>>> --Konst
>>>>
>>>>
>>>> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com>
>>>>wrote:
>>>>> From my count we have 5 binding +1 votes and no -1s so it passes. I
>>>>>will upgrade nexus and move the tag to its final value.
>>>>>
>>>>> Thanks for the help from everyone.
>>>>>
>>>>> On a related note I am happy to say that 0.23.3 has moved to an even
>>>>>larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node
>>>>>cluster, still with no new issues beyond those we saw on the previous
>>>>>2000 node cluster. There is still some polishing to do, but YARN is
>>>>>looking fairly good so far. Which is great because this cluster has a
>>>>>few production jobs running on it :).
>>>>>
>>>>> --Bobby
>>>>>
>>>>> -----Original Message-----
>>>>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>>>>> Sent: Monday, October 08, 2012 12:12 PM
>>>>> To: general@hadoop.apache.org
>>>>> Subject: Re: [VOTE] 0.23.4 release
>>>>>
>>>>> Thanks for catching that. There was a bug in my script that I used to
>>>>> build everything for the release. It rebuilt the src tag ball after I
>>>>>had
>>>>> signed the original. The contents are the same, but the date/time
>>>>>stamps
>>>>> were off. I uploaded a new version of the offending tar.gz with the
>>>>> corresponding signature and mds files.
>>>>>
>>>>> Thanks again,
>>>>>
>>>>> Bobby
>>>>>
>>>>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>>>>>
>>>>>>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>>>>
>>>>>>Thanks
>>>>>>- Sid
>>>>>>
>>>>>>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com>
>>>>>>wrote:
>>>>>>
>>>>>>> Thanks for the help everyone on this. I have re-spun the release.
>>>>>>>You
>>>>>>> can get it at
>>>>>>>
>>>>>>>
>>>>>>>https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc
>>>>>>>2
>>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>>>>
>>>>>>> And through the apache maven staging repository.
>>>>>>>
>>>>>>> The only difference is some debugging code removed. The vote now
>>>>>>>goes
>>>>>>> until Monday 15th. I am a +1 for the release.
>>>>>>>
>>>>>>> --Bobby Evans
>>>>>>>
>>>>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>>>>
>>>>>>> >Arun, if you could re-spin it I would be happy to let you. If not
>>>>>>>I
>>>>>>>can
>>>>>>> >do it myself on Monday. My box that is set up to do the builds is
>>>>>>>offline
>>>>>>> >until Monday. There are some workman fixing some things in my cube
>>>>>>>this
>>>>>>> >weekend.
>>>>>>> >
>>>>>>> >Thanks for your help,
>>>>>>> >
>>>>>>> >Bobby
>>>>>>> >
>>>>>>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>>>> >
>>>>>>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>>>> >>
>>>>>>> >>Arun
>>>>>>> >>
>>>>>>> >>Sent from my iPhone
>>>>>>> >>
>>>>>>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
>>>>>>>wrote:
>>>>>>> >>
>>>>>>> >>> Bobby,
>>>>>>> >>> It looks like some debugging code got committed and rolled into
>>>>>>>the
>>>>>>> >>> release. I think we'll need to re-spin the rc after fixing it,
>>>>>>>so
>>>>>>>-1.
>>>>>>> >>>
>>>>>>> >>> Thanks,
>>>>>>> >>> Owen
>>>>>>> >
>>>>>>>
>>>>>>>
>>>>>
>>
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
I rebuilt the package using the same code and uploaded the new .tar.gz and
everything that goes with it to
http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2-try-2/ The only
thing I can think of is that it must have been caused by a bug in my
script that I used to try and build a 64-bit version of the package as
well. I disabled that because it had other problems. I don't know if you
want to have me call another vote to try and replace the binary release or
not, but this one has the correct hadoop-auth.jar in it now.
Sorry about that.
--Bobby
On 10/22/12 12:53 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>Wow that is very odd, I really don't know what happened there.
>
>It is available through the maven repo at
>https://repository.apache.org/content/groups/public/org/apache/hadoop/hado
>o
>p-auth/0.23.4/ but I cannot figure out how it is missing from the tar.gz
>file. It is in all of the others that I have created. I will try and
>rebuild it and see if I can figure out what happened.
>
>Sorry about that,
>
>Bobby
>
>On 10/19/12 4:28 PM, "Konstantin Shvachko" <sh...@gmail.com> wrote:
>
>>Ok it was not personal. Sorry.
>>--Konst
>>
>>On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
>><sh...@gmail.com> wrote:
>>> Hi Bobby,
>>>
>>> This is personal email, not on general.
>>> I was wondering where did the hadoop-auth.jar go in that last release?
>>> Couldn't find it in the binary distro.
>>> I might missed something so will appreciate your comments.
>>>
>>> Thanks,
>>> --Konst
>>>
>>>
>>> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com>
>>>wrote:
>>>> From my count we have 5 binding +1 votes and no -1s so it passes. I
>>>>will upgrade nexus and move the tag to its final value.
>>>>
>>>> Thanks for the help from everyone.
>>>>
>>>> On a related note I am happy to say that 0.23.3 has moved to an even
>>>>larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node
>>>>cluster, still with no new issues beyond those we saw on the previous
>>>>2000 node cluster. There is still some polishing to do, but YARN is
>>>>looking fairly good so far. Which is great because this cluster has a
>>>>few production jobs running on it :).
>>>>
>>>> --Bobby
>>>>
>>>> -----Original Message-----
>>>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>>>> Sent: Monday, October 08, 2012 12:12 PM
>>>> To: general@hadoop.apache.org
>>>> Subject: Re: [VOTE] 0.23.4 release
>>>>
>>>> Thanks for catching that. There was a bug in my script that I used to
>>>> build everything for the release. It rebuilt the src tag ball after I
>>>>had
>>>> signed the original. The contents are the same, but the date/time
>>>>stamps
>>>> were off. I uploaded a new version of the offending tar.gz with the
>>>> corresponding signature and mds files.
>>>>
>>>> Thanks again,
>>>>
>>>> Bobby
>>>>
>>>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>>>>
>>>>>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>>>
>>>>>Thanks
>>>>>- Sid
>>>>>
>>>>>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com>
>>>>>wrote:
>>>>>
>>>>>> Thanks for the help everyone on this. I have re-spun the release.
>>>>>>You
>>>>>> can get it at
>>>>>>
>>>>>>
>>>>>>https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc
>>>>>>2
>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>>>
>>>>>> And through the apache maven staging repository.
>>>>>>
>>>>>> The only difference is some debugging code removed. The vote now
>>>>>>goes
>>>>>> until Monday 15th. I am a +1 for the release.
>>>>>>
>>>>>> --Bobby Evans
>>>>>>
>>>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>>>
>>>>>> >Arun, if you could re-spin it I would be happy to let you. If not
>>>>>>I
>>>>>>can
>>>>>> >do it myself on Monday. My box that is set up to do the builds is
>>>>>>offline
>>>>>> >until Monday. There are some workman fixing some things in my cube
>>>>>>this
>>>>>> >weekend.
>>>>>> >
>>>>>> >Thanks for your help,
>>>>>> >
>>>>>> >Bobby
>>>>>> >
>>>>>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>>> >
>>>>>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>>> >>
>>>>>> >>Arun
>>>>>> >>
>>>>>> >>Sent from my iPhone
>>>>>> >>
>>>>>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
>>>>>>wrote:
>>>>>> >>
>>>>>> >>> Bobby,
>>>>>> >>> It looks like some debugging code got committed and rolled into
>>>>>>the
>>>>>> >>> release. I think we'll need to re-spin the rc after fixing it,
>>>>>>so
>>>>>>-1.
>>>>>> >>>
>>>>>> >>> Thanks,
>>>>>> >>> Owen
>>>>>> >
>>>>>>
>>>>>>
>>>>
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
Wow that is very odd, I really don't know what happened there.
It is available through the maven repo at
https://repository.apache.org/content/groups/public/org/apache/hadoop/hadoo
p-auth/0.23.4/ but I cannot figure out how it is missing from the tar.gz
file. It is in all of the others that I have created. I will try and
rebuild it and see if I can figure out what happened.
Sorry about that,
Bobby
On 10/19/12 4:28 PM, "Konstantin Shvachko" <sh...@gmail.com> wrote:
>Ok it was not personal. Sorry.
>--Konst
>
>On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
><sh...@gmail.com> wrote:
>> Hi Bobby,
>>
>> This is personal email, not on general.
>> I was wondering where did the hadoop-auth.jar go in that last release?
>> Couldn't find it in the binary distro.
>> I might missed something so will appreciate your comments.
>>
>> Thanks,
>> --Konst
>>
>>
>> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com>
>>wrote:
>>> From my count we have 5 binding +1 votes and no -1s so it passes. I
>>>will upgrade nexus and move the tag to its final value.
>>>
>>> Thanks for the help from everyone.
>>>
>>> On a related note I am happy to say that 0.23.3 has moved to an even
>>>larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node
>>>cluster, still with no new issues beyond those we saw on the previous
>>>2000 node cluster. There is still some polishing to do, but YARN is
>>>looking fairly good so far. Which is great because this cluster has a
>>>few production jobs running on it :).
>>>
>>> --Bobby
>>>
>>> -----Original Message-----
>>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>>> Sent: Monday, October 08, 2012 12:12 PM
>>> To: general@hadoop.apache.org
>>> Subject: Re: [VOTE] 0.23.4 release
>>>
>>> Thanks for catching that. There was a bug in my script that I used to
>>> build everything for the release. It rebuilt the src tag ball after I
>>>had
>>> signed the original. The contents are the same, but the date/time
>>>stamps
>>> were off. I uploaded a new version of the offending tar.gz with the
>>> corresponding signature and mds files.
>>>
>>> Thanks again,
>>>
>>> Bobby
>>>
>>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>>>
>>>>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>>
>>>>Thanks
>>>>- Sid
>>>>
>>>>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com>
>>>>wrote:
>>>>
>>>>> Thanks for the help everyone on this. I have re-spun the release.
>>>>>You
>>>>> can get it at
>>>>>
>>>>>
>>>>>https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>>
>>>>> And through the apache maven staging repository.
>>>>>
>>>>> The only difference is some debugging code removed. The vote now
>>>>>goes
>>>>> until Monday 15th. I am a +1 for the release.
>>>>>
>>>>> --Bobby Evans
>>>>>
>>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>>
>>>>> >Arun, if you could re-spin it I would be happy to let you. If not I
>>>>>can
>>>>> >do it myself on Monday. My box that is set up to do the builds is
>>>>>offline
>>>>> >until Monday. There are some workman fixing some things in my cube
>>>>>this
>>>>> >weekend.
>>>>> >
>>>>> >Thanks for your help,
>>>>> >
>>>>> >Bobby
>>>>> >
>>>>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>>> >
>>>>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>>> >>
>>>>> >>Arun
>>>>> >>
>>>>> >>Sent from my iPhone
>>>>> >>
>>>>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org>
>>>>>wrote:
>>>>> >>
>>>>> >>> Bobby,
>>>>> >>> It looks like some debugging code got committed and rolled into
>>>>>the
>>>>> >>> release. I think we'll need to re-spin the rc after fixing it, so
>>>>>-1.
>>>>> >>>
>>>>> >>> Thanks,
>>>>> >>> Owen
>>>>> >
>>>>>
>>>>>
>>>
Re: [VOTE] 0.23.4 release
Posted by Konstantin Shvachko <sh...@gmail.com>.
Ok it was not personal. Sorry.
--Konst
On Fri, Oct 19, 2012 at 2:27 PM, Konstantin Shvachko
<sh...@gmail.com> wrote:
> Hi Bobby,
>
> This is personal email, not on general.
> I was wondering where did the hadoop-auth.jar go in that last release?
> Couldn't find it in the binary distro.
> I might missed something so will appreciate your comments.
>
> Thanks,
> --Konst
>
>
> On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
>> From my count we have 5 binding +1 votes and no -1s so it passes. I will upgrade nexus and move the tag to its final value.
>>
>> Thanks for the help from everyone.
>>
>> On a related note I am happy to say that 0.23.3 has moved to an even larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node cluster, still with no new issues beyond those we saw on the previous 2000 node cluster. There is still some polishing to do, but YARN is looking fairly good so far. Which is great because this cluster has a few production jobs running on it :).
>>
>> --Bobby
>>
>> -----Original Message-----
>> From: Robert Evans [mailto:evans@yahoo-inc.com]
>> Sent: Monday, October 08, 2012 12:12 PM
>> To: general@hadoop.apache.org
>> Subject: Re: [VOTE] 0.23.4 release
>>
>> Thanks for catching that. There was a bug in my script that I used to
>> build everything for the release. It rebuilt the src tag ball after I had
>> signed the original. The contents are the same, but the date/time stamps
>> were off. I uploaded a new version of the offending tar.gz with the
>> corresponding signature and mds files.
>>
>> Thanks again,
>>
>> Bobby
>>
>> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>>
>>>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>>
>>>Thanks
>>>- Sid
>>>
>>>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>>>
>>>> Thanks for the help everyone on this. I have re-spun the release. You
>>>> can get it at
>>>>
>>>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>>
>>>> And through the apache maven staging repository.
>>>>
>>>> The only difference is some debugging code removed. The vote now goes
>>>> until Monday 15th. I am a +1 for the release.
>>>>
>>>> --Bobby Evans
>>>>
>>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>>
>>>> >Arun, if you could re-spin it I would be happy to let you. If not I
>>>>can
>>>> >do it myself on Monday. My box that is set up to do the builds is
>>>>offline
>>>> >until Monday. There are some workman fixing some things in my cube
>>>>this
>>>> >weekend.
>>>> >
>>>> >Thanks for your help,
>>>> >
>>>> >Bobby
>>>> >
>>>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>>> >
>>>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>> >>
>>>> >>Arun
>>>> >>
>>>> >>Sent from my iPhone
>>>> >>
>>>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>>> >>
>>>> >>> Bobby,
>>>> >>> It looks like some debugging code got committed and rolled into the
>>>> >>> release. I think we'll need to re-spin the rc after fixing it, so
>>>>-1.
>>>> >>>
>>>> >>> Thanks,
>>>> >>> Owen
>>>> >
>>>>
>>>>
>>
Re: [VOTE] 0.23.4 release
Posted by Konstantin Shvachko <sh...@gmail.com>.
Hi Bobby,
This is personal email, not on general.
I was wondering where did the hadoop-auth.jar go in that last release?
Couldn't find it in the binary distro.
I might missed something so will appreciate your comments.
Thanks,
--Konst
On Mon, Oct 15, 2012 at 12:55 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> From my count we have 5 binding +1 votes and no -1s so it passes. I will upgrade nexus and move the tag to its final value.
>
> Thanks for the help from everyone.
>
> On a related note I am happy to say that 0.23.3 has moved to an even larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node cluster, still with no new issues beyond those we saw on the previous 2000 node cluster. There is still some polishing to do, but YARN is looking fairly good so far. Which is great because this cluster has a few production jobs running on it :).
>
> --Bobby
>
> -----Original Message-----
> From: Robert Evans [mailto:evans@yahoo-inc.com]
> Sent: Monday, October 08, 2012 12:12 PM
> To: general@hadoop.apache.org
> Subject: Re: [VOTE] 0.23.4 release
>
> Thanks for catching that. There was a bug in my script that I used to
> build everything for the release. It rebuilt the src tag ball after I had
> signed the original. The contents are the same, but the date/time stamps
> were off. I uploaded a new version of the offending tar.gz with the
> corresponding signature and mds files.
>
> Thanks again,
>
> Bobby
>
> On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>
>>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>>
>>Thanks
>>- Sid
>>
>>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>>
>>> Thanks for the help everyone on this. I have re-spun the release. You
>>> can get it at
>>>
>>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>>
>>> And through the apache maven staging repository.
>>>
>>> The only difference is some debugging code removed. The vote now goes
>>> until Monday 15th. I am a +1 for the release.
>>>
>>> --Bobby Evans
>>>
>>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>>
>>> >Arun, if you could re-spin it I would be happy to let you. If not I
>>>can
>>> >do it myself on Monday. My box that is set up to do the builds is
>>>offline
>>> >until Monday. There are some workman fixing some things in my cube
>>>this
>>> >weekend.
>>> >
>>> >Thanks for your help,
>>> >
>>> >Bobby
>>> >
>>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>> >
>>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>> >>
>>> >>Arun
>>> >>
>>> >>Sent from my iPhone
>>> >>
>>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>> >>
>>> >>> Bobby,
>>> >>> It looks like some debugging code got committed and rolled into the
>>> >>> release. I think we'll need to re-spin the rc after fixing it, so
>>>-1.
>>> >>>
>>> >>> Thanks,
>>> >>> Owen
>>> >
>>>
>>>
>
RE: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
>From my count we have 5 binding +1 votes and no -1s so it passes. I will upgrade nexus and move the tag to its final value.
Thanks for the help from everyone.
On a related note I am happy to say that 0.23.3 has moved to an even larger grid at Yahoo!. Today we are now running 0.23.3 on a 3,600 node cluster, still with no new issues beyond those we saw on the previous 2000 node cluster. There is still some polishing to do, but YARN is looking fairly good so far. Which is great because this cluster has a few production jobs running on it :).
--Bobby
-----Original Message-----
From: Robert Evans [mailto:evans@yahoo-inc.com]
Sent: Monday, October 08, 2012 12:12 PM
To: general@hadoop.apache.org
Subject: Re: [VOTE] 0.23.4 release
Thanks for catching that. There was a bug in my script that I used to
build everything for the release. It rebuilt the src tag ball after I had
signed the original. The contents are the same, but the date/time stamps
were off. I uploaded a new version of the offending tar.gz with the
corresponding signature and mds files.
Thanks again,
Bobby
On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>
>Thanks
>- Sid
>
>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>
>> Thanks for the help everyone on this. I have re-spun the release. You
>> can get it at
>>
>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>
>> And through the apache maven staging repository.
>>
>> The only difference is some debugging code removed. The vote now goes
>> until Monday 15th. I am a +1 for the release.
>>
>> --Bobby Evans
>>
>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>
>> >Arun, if you could re-spin it I would be happy to let you. If not I
>>can
>> >do it myself on Monday. My box that is set up to do the builds is
>>offline
>> >until Monday. There are some workman fixing some things in my cube
>>this
>> >weekend.
>> >
>> >Thanks for your help,
>> >
>> >Bobby
>> >
>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>> >
>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>> >>
>> >>Arun
>> >>
>> >>Sent from my iPhone
>> >>
>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>> >>
>> >>> Bobby,
>> >>> It looks like some debugging code got committed and rolled into the
>> >>> release. I think we'll need to re-spin the rc after fixing it, so
>>-1.
>> >>>
>> >>> Thanks,
>> >>> Owen
>> >
>>
>>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
Thanks for catching that. There was a bug in my script that I used to
build everything for the release. It rebuilt the src tag ball after I had
signed the original. The contents are the same, but the date/time stamps
were off. I uploaded a new version of the offending tar.gz with the
corresponding signature and mds files.
Thanks again,
Bobby
On 10/8/12 1:51 PM, "Siddharth Seth" <se...@gmail.com> wrote:
>Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
>
>Thanks
>- Sid
>
>On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
>
>> Thanks for the help everyone on this. I have re-spun the release. You
>> can get it at
>>
>> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>>
>> And through the apache maven staging repository.
>>
>> The only difference is some debugging code removed. The vote now goes
>> until Monday 15th. I am a +1 for the release.
>>
>> --Bobby Evans
>>
>> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>>
>> >Arun, if you could re-spin it I would be happy to let you. If not I
>>can
>> >do it myself on Monday. My box that is set up to do the builds is
>>offline
>> >until Monday. There are some workman fixing some things in my cube
>>this
>> >weekend.
>> >
>> >Thanks for your help,
>> >
>> >Bobby
>> >
>> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>> >
>> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>> >>
>> >>Arun
>> >>
>> >>Sent from my iPhone
>> >>
>> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>> >>
>> >>> Bobby,
>> >>> It looks like some debugging code got committed and rolled into the
>> >>> release. I think we'll need to re-spin the rc after fixing it, so
>>-1.
>> >>>
>> >>> Thanks,
>> >>> Owen
>> >
>>
>>
Re: [VOTE] 0.23.4 release
Posted by Siddharth Seth <se...@gmail.com>.
Bobby, the checksums don't match for hadoop-0.23.4-src.tar.tar.gz.
Thanks
- Sid
On Mon, Oct 8, 2012 at 8:06 AM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Thanks for the help everyone on this. I have re-spun the release. You
> can get it at
>
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>
> And through the apache maven staging repository.
>
> The only difference is some debugging code removed. The vote now goes
> until Monday 15th. I am a +1 for the release.
>
> --Bobby Evans
>
> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>
> >Arun, if you could re-spin it I would be happy to let you. If not I can
> >do it myself on Monday. My box that is set up to do the builds is offline
> >until Monday. There are some workman fixing some things in my cube this
> >weekend.
> >
> >Thanks for your help,
> >
> >Bobby
> >
> >On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
> >
> >>I think Bobby is OOO, I can re-spin if Thomas can't step in.
> >>
> >>Arun
> >>
> >>Sent from my iPhone
> >>
> >>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
> >>
> >>> Bobby,
> >>> It looks like some debugging code got committed and rolled into the
> >>> release. I think we'll need to re-spin the rc after fixing it, so -1.
> >>>
> >>> Thanks,
> >>> Owen
> >
>
>
Re: [VOTE] 0.23.4 release
Posted by Arun C Murthy <ac...@hortonworks.com>.
+1
Verified signatures and ran examples on a single-node cluster.
Thanks Bobby!
Arun
On Oct 8, 2012, at 8:06 AM, Robert Evans wrote:
> Thanks for the help everyone on this. I have re-spun the release. You
> can get it at
>
> https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>
> And through the apache maven staging repository.
>
> The only difference is some debugging code removed. The vote now goes
> until Monday 15th. I am a +1 for the release.
>
> --Bobby Evans
>
> On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>
>> Arun, if you could re-spin it I would be happy to let you. If not I can
>> do it myself on Monday. My box that is set up to do the builds is offline
>> until Monday. There are some workman fixing some things in my cube this
>> weekend.
>>
>> Thanks for your help,
>>
>> Bobby
>>
>> On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>
>>> I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>
>>> Arun
>>>
>>> Sent from my iPhone
>>>
>>> On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>>
>>>> Bobby,
>>>> It looks like some debugging code got committed and rolled into the
>>>> release. I think we'll need to re-spin the rc after fixing it, so -1.
>>>>
>>>> Thanks,
>>>> Owen
>>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] 0.23.4 release
Posted by Thomas Graves <tg...@yahoo-inc.com>.
+1. Downloaded, verified signatures, license, read me, and source tar
builds.
On a single node non-secure pseudo distributed cluster, all daemons start
and wordcount,
sleep, teragen, terasort, teravalidate ran and all passed
Tom
On 10/8/12 10:06 AM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>Thanks for the help everyone on this. I have re-spun the release. You
>can get it at
>
>https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
>http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
>
>And through the apache maven staging repository.
>
>The only difference is some debugging code removed. The vote now goes
>until Monday 15th. I am a +1 for the release.
>
>--Bobby Evans
>
>On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>
>>Arun, if you could re-spin it I would be happy to let you. If not I can
>>do it myself on Monday. My box that is set up to do the builds is
>>offline
>>until Monday. There are some workman fixing some things in my cube this
>>weekend.
>>
>>Thanks for your help,
>>
>>Bobby
>>
>>On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>>
>>>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>>
>>>Arun
>>>
>>>Sent from my iPhone
>>>
>>>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>>
>>>> Bobby,
>>>> It looks like some debugging code got committed and rolled into the
>>>> release. I think we'll need to re-spin the rc after fixing it, so -1.
>>>>
>>>> Thanks,
>>>> Owen
>>
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
Thanks for the help everyone on this. I have re-spun the release. You
can get it at
https://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.4-rc2
http://people.apache.org/~bobby/hadoop-0.23.4-candidate-2/
And through the apache maven staging repository.
The only difference is some debugging code removed. The vote now goes
until Monday 15th. I am a +1 for the release.
--Bobby Evans
On 10/5/12 2:41 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>Arun, if you could re-spin it I would be happy to let you. If not I can
>do it myself on Monday. My box that is set up to do the builds is offline
>until Monday. There are some workman fixing some things in my cube this
>weekend.
>
>Thanks for your help,
>
>Bobby
>
>On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>
>>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>>
>>Arun
>>
>>Sent from my iPhone
>>
>>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>>
>>> Bobby,
>>> It looks like some debugging code got committed and rolled into the
>>> release. I think we'll need to re-spin the rc after fixing it, so -1.
>>>
>>> Thanks,
>>> Owen
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
Arun, if you could re-spin it I would be happy to let you. If not I can
do it myself on Monday. My box that is set up to do the builds is offline
until Monday. There are some workman fixing some things in my cube this
weekend.
Thanks for your help,
Bobby
On 10/5/12 1:46 PM, "Arun Murthy" <ac...@hortonworks.com> wrote:
>I think Bobby is OOO, I can re-spin if Thomas can't step in.
>
>Arun
>
>Sent from my iPhone
>
>On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
>
>> Bobby,
>> It looks like some debugging code got committed and rolled into the
>> release. I think we'll need to re-spin the rc after fixing it, so -1.
>>
>> Thanks,
>> Owen
Re: [VOTE] 0.23.4 release
Posted by Arun Murthy <ac...@hortonworks.com>.
I think Bobby is OOO, I can re-spin if Thomas can't step in.
Arun
Sent from my iPhone
On Oct 5, 2012, at 11:44 AM, Owen O'Malley <om...@apache.org> wrote:
> Bobby,
> It looks like some debugging code got committed and rolled into the
> release. I think we'll need to re-spin the rc after fixing it, so -1.
>
> Thanks,
> Owen
Re: [VOTE] 0.23.4 release
Posted by Owen O'Malley <om...@apache.org>.
Bobby,
It looks like some debugging code got committed and rolled into the
release. I think we'll need to re-spin the rc after fixing it, so -1.
Thanks,
Owen
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
OK I have an RC1 that is the same as RC0 but with HADOOP-8310, YARN-137,
and YARN-138 added in.
You can access the release through the apache maven staging repo,
With the 0.23.4-rc1 tag in subversion, and at
http://people.apache.org/~bobby/hadoop-0.23.4-candidate-1/
The voting starts over then, and will close Monday Oct 8th.
I have kicked the tires again and I am still a +1
--Bobby
On 10/1/12 4:05 PM, "Robert Evans" <ev...@yahoo-inc.com> wrote:
>OK I'll pull it in once you merge it into branch-0.23
>
>On 10/1/12 3:53 PM, "Jason Lowe" <jl...@yahoo-inc.com> wrote:
>
>>I think HADOOP-8310 should also be added, as we've seen issues with the
>>AM's web UI related to FileContext#checkPath.
>>
>>Jason
>>
>>On 10/01/2012 03:42 PM, Robert Evans wrote:
>>> OK, I'll spin an RC with those changes in it.
>>>
>>> On 10/1/12 3:35 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>>
>>>> If you think 0.23.5 is a month or so away, I'd encourage you to pull
>>>>it
>>>> in right-away... this will ensure anyone external using this will get
>>>>a
>>>> good out-of-box experience.
>>>>
>>>> thanks,
>>>> Arun
>>>>
>>>> On Oct 1, 2012, at 6:48 AM, Robert Evans wrote:
>>>>
>>>>> I think I would prefer to merge them onto branch-0.23 and have them
>>>>>come
>>>>> out as part of 0.23.5. It will probably show up in a month or so, as
>>>>>we
>>>>> expect to find more issues as Yahoo! deploys this to more and larger
>>>>> clusters. If you really feel strongly about it I am OK with merging
>>>>>it
>>>>> in, I just don't see a critical need for it right now.
>>>>>
>>>>> --Bobby
>>>>>
>>>>> On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>>>>
>>>>>> Hey Bobby,
>>>>>>
>>>>>> Thanks for getting this RC out.
>>>>>>
>>>>>> You might want to pull in YARN-137 and YARN-138 into this too.
>>>>>>
>>>>>> thanks,
>>>>>> Arun
>>>>>>
>>>>>> On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>>>>>>
>>>>>>> I have built a 0.23.4-rc0 and am calling a release vote on it. As
>>>>>>>per
>>>>>>> the bylaws this vote will be open for 1 week, and will close next
>>>>>>> Saturday October 6th.
>>>>>>>
>>>>>>> You can access the release through the apache maven staging repo,
>>>>>>>with
>>>>>>> the 0.23.4-rc0 tag in subversion, and at
>>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>>>>>>
>>>>>>> This release is a sustaining release with several important bug
>>>>>>>fixes
>>>>>>> in it. Most notably upgrading of a 1.0 cluster with append/sync
>>>>>>> enabled
>>>>>>> should now work (HDFS-3731). There are no known blockers against
>>>>>>>this
>>>>>>> release, there are only two critical issues.
>>>>>>>
>>>>>>> HADOOP-8811
>>>>>>> Compile hadoop native library in FreeBSD
>>>>>>>
>>>>>>> HDFS-3990
>>>>>>> NN's health report has severe performance problems
>>>>>>>
>>>>>>> HDFS-3990 only really has a significant impact on large clusters,
>>>>>>>and
>>>>>>> can be mitigated by enabling DNS caching.
>>>>>>>
>>>>>>> I have run several manual tests on this release on a small insecure
>>>>>>> cluster and all of them pass I am a +1 (binding) for this release.
>>>>>>>
>>>>>>> On a side note I am happy to announce that the 0.23 line is being
>>>>>>> rolled out more widely at Yahoo!. We just installed 0.23.3 on a
>>>>>>>2000
>>>>>>> node cluster and have only seen a few issues (HDFS-3990 is the
>>>>>>>biggest
>>>>>>> of them). I expect to do a 0.23.5 release in the coming
>>>>>>>weeks/months
>>>>>>> as we find more issues running on large clusters.
>>>>>>>
>>>>>>> --Bobby Evans
>>>>>>>
>>>>>>>
>>>>>> --
>>>>>> Arun C. Murthy
>>>>>> Hortonworks Inc.
>>>>>> http://hortonworks.com/
>>>>>>
>>>>>>
>>>> --
>>>> Arun C. Murthy
>>>> Hortonworks Inc.
>>>> http://hortonworks.com/
>>>>
>>>>
>>
>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
OK I'll pull it in once you merge it into branch-0.23
On 10/1/12 3:53 PM, "Jason Lowe" <jl...@yahoo-inc.com> wrote:
>I think HADOOP-8310 should also be added, as we've seen issues with the
>AM's web UI related to FileContext#checkPath.
>
>Jason
>
>On 10/01/2012 03:42 PM, Robert Evans wrote:
>> OK, I'll spin an RC with those changes in it.
>>
>> On 10/1/12 3:35 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>
>>> If you think 0.23.5 is a month or so away, I'd encourage you to pull it
>>> in right-away... this will ensure anyone external using this will get a
>>> good out-of-box experience.
>>>
>>> thanks,
>>> Arun
>>>
>>> On Oct 1, 2012, at 6:48 AM, Robert Evans wrote:
>>>
>>>> I think I would prefer to merge them onto branch-0.23 and have them
>>>>come
>>>> out as part of 0.23.5. It will probably show up in a month or so, as
>>>>we
>>>> expect to find more issues as Yahoo! deploys this to more and larger
>>>> clusters. If you really feel strongly about it I am OK with merging
>>>>it
>>>> in, I just don't see a critical need for it right now.
>>>>
>>>> --Bobby
>>>>
>>>> On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>>>
>>>>> Hey Bobby,
>>>>>
>>>>> Thanks for getting this RC out.
>>>>>
>>>>> You might want to pull in YARN-137 and YARN-138 into this too.
>>>>>
>>>>> thanks,
>>>>> Arun
>>>>>
>>>>> On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>>>>>
>>>>>> I have built a 0.23.4-rc0 and am calling a release vote on it. As
>>>>>>per
>>>>>> the bylaws this vote will be open for 1 week, and will close next
>>>>>> Saturday October 6th.
>>>>>>
>>>>>> You can access the release through the apache maven staging repo,
>>>>>>with
>>>>>> the 0.23.4-rc0 tag in subversion, and at
>>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>>>>>
>>>>>> This release is a sustaining release with several important bug
>>>>>>fixes
>>>>>> in it. Most notably upgrading of a 1.0 cluster with append/sync
>>>>>> enabled
>>>>>> should now work (HDFS-3731). There are no known blockers against
>>>>>>this
>>>>>> release, there are only two critical issues.
>>>>>>
>>>>>> HADOOP-8811
>>>>>> Compile hadoop native library in FreeBSD
>>>>>>
>>>>>> HDFS-3990
>>>>>> NN's health report has severe performance problems
>>>>>>
>>>>>> HDFS-3990 only really has a significant impact on large clusters,
>>>>>>and
>>>>>> can be mitigated by enabling DNS caching.
>>>>>>
>>>>>> I have run several manual tests on this release on a small insecure
>>>>>> cluster and all of them pass I am a +1 (binding) for this release.
>>>>>>
>>>>>> On a side note I am happy to announce that the 0.23 line is being
>>>>>> rolled out more widely at Yahoo!. We just installed 0.23.3 on a
>>>>>>2000
>>>>>> node cluster and have only seen a few issues (HDFS-3990 is the
>>>>>>biggest
>>>>>> of them). I expect to do a 0.23.5 release in the coming
>>>>>>weeks/months
>>>>>> as we find more issues running on large clusters.
>>>>>>
>>>>>> --Bobby Evans
>>>>>>
>>>>>>
>>>>> --
>>>>> Arun C. Murthy
>>>>> Hortonworks Inc.
>>>>> http://hortonworks.com/
>>>>>
>>>>>
>>> --
>>> Arun C. Murthy
>>> Hortonworks Inc.
>>> http://hortonworks.com/
>>>
>>>
>
Re: [VOTE] 0.23.4 release
Posted by Jason Lowe <jl...@yahoo-inc.com>.
I think HADOOP-8310 should also be added, as we've seen issues with the
AM's web UI related to FileContext#checkPath.
Jason
On 10/01/2012 03:42 PM, Robert Evans wrote:
> OK, I'll spin an RC with those changes in it.
>
> On 10/1/12 3:35 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> If you think 0.23.5 is a month or so away, I'd encourage you to pull it
>> in right-away... this will ensure anyone external using this will get a
>> good out-of-box experience.
>>
>> thanks,
>> Arun
>>
>> On Oct 1, 2012, at 6:48 AM, Robert Evans wrote:
>>
>>> I think I would prefer to merge them onto branch-0.23 and have them come
>>> out as part of 0.23.5. It will probably show up in a month or so, as we
>>> expect to find more issues as Yahoo! deploys this to more and larger
>>> clusters. If you really feel strongly about it I am OK with merging it
>>> in, I just don't see a critical need for it right now.
>>>
>>> --Bobby
>>>
>>> On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>>
>>>> Hey Bobby,
>>>>
>>>> Thanks for getting this RC out.
>>>>
>>>> You might want to pull in YARN-137 and YARN-138 into this too.
>>>>
>>>> thanks,
>>>> Arun
>>>>
>>>> On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>>>>
>>>>> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
>>>>> the bylaws this vote will be open for 1 week, and will close next
>>>>> Saturday October 6th.
>>>>>
>>>>> You can access the release through the apache maven staging repo, with
>>>>> the 0.23.4-rc0 tag in subversion, and at
>>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>>>>
>>>>> This release is a sustaining release with several important bug fixes
>>>>> in it. Most notably upgrading of a 1.0 cluster with append/sync
>>>>> enabled
>>>>> should now work (HDFS-3731). There are no known blockers against this
>>>>> release, there are only two critical issues.
>>>>>
>>>>> HADOOP-8811
>>>>> Compile hadoop native library in FreeBSD
>>>>>
>>>>> HDFS-3990
>>>>> NN's health report has severe performance problems
>>>>>
>>>>> HDFS-3990 only really has a significant impact on large clusters, and
>>>>> can be mitigated by enabling DNS caching.
>>>>>
>>>>> I have run several manual tests on this release on a small insecure
>>>>> cluster and all of them pass I am a +1 (binding) for this release.
>>>>>
>>>>> On a side note I am happy to announce that the 0.23 line is being
>>>>> rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
>>>>> node cluster and have only seen a few issues (HDFS-3990 is the biggest
>>>>> of them). I expect to do a 0.23.5 release in the coming weeks/months
>>>>> as we find more issues running on large clusters.
>>>>>
>>>>> --Bobby Evans
>>>>>
>>>>>
>>>> --
>>>> Arun C. Murthy
>>>> Hortonworks Inc.
>>>> http://hortonworks.com/
>>>>
>>>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
OK, I'll spin an RC with those changes in it.
On 10/1/12 3:35 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>If you think 0.23.5 is a month or so away, I'd encourage you to pull it
>in right-away... this will ensure anyone external using this will get a
>good out-of-box experience.
>
>thanks,
>Arun
>
>On Oct 1, 2012, at 6:48 AM, Robert Evans wrote:
>
>> I think I would prefer to merge them onto branch-0.23 and have them come
>> out as part of 0.23.5. It will probably show up in a month or so, as we
>> expect to find more issues as Yahoo! deploys this to more and larger
>> clusters. If you really feel strongly about it I am OK with merging it
>> in, I just don't see a critical need for it right now.
>>
>> --Bobby
>>
>> On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>>
>>> Hey Bobby,
>>>
>>> Thanks for getting this RC out.
>>>
>>> You might want to pull in YARN-137 and YARN-138 into this too.
>>>
>>> thanks,
>>> Arun
>>>
>>> On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>>>
>>>> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
>>>> the bylaws this vote will be open for 1 week, and will close next
>>>> Saturday October 6th.
>>>>
>>>> You can access the release through the apache maven staging repo, with
>>>> the 0.23.4-rc0 tag in subversion, and at
>>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>>>
>>>> This release is a sustaining release with several important bug fixes
>>>> in it. Most notably upgrading of a 1.0 cluster with append/sync
>>>>enabled
>>>> should now work (HDFS-3731). There are no known blockers against this
>>>> release, there are only two critical issues.
>>>>
>>>> HADOOP-8811
>>>> Compile hadoop native library in FreeBSD
>>>>
>>>> HDFS-3990
>>>> NN's health report has severe performance problems
>>>>
>>>> HDFS-3990 only really has a significant impact on large clusters, and
>>>> can be mitigated by enabling DNS caching.
>>>>
>>>> I have run several manual tests on this release on a small insecure
>>>> cluster and all of them pass I am a +1 (binding) for this release.
>>>>
>>>> On a side note I am happy to announce that the 0.23 line is being
>>>> rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
>>>> node cluster and have only seen a few issues (HDFS-3990 is the biggest
>>>> of them). I expect to do a 0.23.5 release in the coming weeks/months
>>>> as we find more issues running on large clusters.
>>>>
>>>> --Bobby Evans
>>>>
>>>>
>>>
>>> --
>>> Arun C. Murthy
>>> Hortonworks Inc.
>>> http://hortonworks.com/
>>>
>>>
>>
>
>--
>Arun C. Murthy
>Hortonworks Inc.
>http://hortonworks.com/
>
>
Re: [VOTE] 0.23.4 release
Posted by Arun C Murthy <ac...@hortonworks.com>.
If you think 0.23.5 is a month or so away, I'd encourage you to pull it in right-away... this will ensure anyone external using this will get a good out-of-box experience.
thanks,
Arun
On Oct 1, 2012, at 6:48 AM, Robert Evans wrote:
> I think I would prefer to merge them onto branch-0.23 and have them come
> out as part of 0.23.5. It will probably show up in a month or so, as we
> expect to find more issues as Yahoo! deploys this to more and larger
> clusters. If you really feel strongly about it I am OK with merging it
> in, I just don't see a critical need for it right now.
>
> --Bobby
>
> On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>
>> Hey Bobby,
>>
>> Thanks for getting this RC out.
>>
>> You might want to pull in YARN-137 and YARN-138 into this too.
>>
>> thanks,
>> Arun
>>
>> On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>>
>>> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
>>> the bylaws this vote will be open for 1 week, and will close next
>>> Saturday October 6th.
>>>
>>> You can access the release through the apache maven staging repo, with
>>> the 0.23.4-rc0 tag in subversion, and at
>>> http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>>
>>> This release is a sustaining release with several important bug fixes
>>> in it. Most notably upgrading of a 1.0 cluster with append/sync enabled
>>> should now work (HDFS-3731). There are no known blockers against this
>>> release, there are only two critical issues.
>>>
>>> HADOOP-8811
>>> Compile hadoop native library in FreeBSD
>>>
>>> HDFS-3990
>>> NN's health report has severe performance problems
>>>
>>> HDFS-3990 only really has a significant impact on large clusters, and
>>> can be mitigated by enabling DNS caching.
>>>
>>> I have run several manual tests on this release on a small insecure
>>> cluster and all of them pass I am a +1 (binding) for this release.
>>>
>>> On a side note I am happy to announce that the 0.23 line is being
>>> rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
>>> node cluster and have only seen a few issues (HDFS-3990 is the biggest
>>> of them). I expect to do a 0.23.5 release in the coming weeks/months
>>> as we find more issues running on large clusters.
>>>
>>> --Bobby Evans
>>>
>>>
>>
>> --
>> Arun C. Murthy
>> Hortonworks Inc.
>> http://hortonworks.com/
>>
>>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
I think I would prefer to merge them onto branch-0.23 and have them come
out as part of 0.23.5. It will probably show up in a month or so, as we
expect to find more issues as Yahoo! deploys this to more and larger
clusters. If you really feel strongly about it I am OK with merging it
in, I just don't see a critical need for it right now.
--Bobby
On 9/30/12 4:28 PM, "Arun C Murthy" <ac...@hortonworks.com> wrote:
>Hey Bobby,
>
> Thanks for getting this RC out.
>
> You might want to pull in YARN-137 and YARN-138 into this too.
>
>thanks,
>Arun
>
>On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
>
>> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
>>the bylaws this vote will be open for 1 week, and will close next
>>Saturday October 6th.
>>
>> You can access the release through the apache maven staging repo, with
>>the 0.23.4-rc0 tag in subversion, and at
>>http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>
>> This release is a sustaining release with several important bug fixes
>>in it. Most notably upgrading of a 1.0 cluster with append/sync enabled
>>should now work (HDFS-3731). There are no known blockers against this
>>release, there are only two critical issues.
>>
>> HADOOP-8811
>> Compile hadoop native library in FreeBSD
>>
>> HDFS-3990
>> NN's health report has severe performance problems
>>
>> HDFS-3990 only really has a significant impact on large clusters, and
>>can be mitigated by enabling DNS caching.
>>
>> I have run several manual tests on this release on a small insecure
>>cluster and all of them pass I am a +1 (binding) for this release.
>>
>> On a side note I am happy to announce that the 0.23 line is being
>>rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
>>node cluster and have only seen a few issues (HDFS-3990 is the biggest
>>of them). I expect to do a 0.23.5 release in the coming weeks/months
>>as we find more issues running on large clusters.
>>
>> --Bobby Evans
>>
>>
>
>--
>Arun C. Murthy
>Hortonworks Inc.
>http://hortonworks.com/
>
>
Re: [VOTE] 0.23.4 release
Posted by Arun C Murthy <ac...@hortonworks.com>.
Hey Bobby,
Thanks for getting this RC out.
You might want to pull in YARN-137 and YARN-138 into this too.
thanks,
Arun
On Sep 29, 2012, at 8:35 AM, Robert Evans wrote:
> I have built a 0.23.4-rc0 and am calling a release vote on it. As per the bylaws this vote will be open for 1 week, and will close next Saturday October 6th.
>
> You can access the release through the apache maven staging repo, with the 0.23.4-rc0 tag in subversion, and at http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>
> This release is a sustaining release with several important bug fixes in it. Most notably upgrading of a 1.0 cluster with append/sync enabled should now work (HDFS-3731). There are no known blockers against this release, there are only two critical issues.
>
> HADOOP-8811
> Compile hadoop native library in FreeBSD
>
> HDFS-3990
> NN's health report has severe performance problems
>
> HDFS-3990 only really has a significant impact on large clusters, and can be mitigated by enabling DNS caching.
>
> I have run several manual tests on this release on a small insecure cluster and all of them pass I am a +1 (binding) for this release.
>
> On a side note I am happy to announce that the 0.23 line is being rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000 node cluster and have only seen a few issues (HDFS-3990 is the biggest of them). I expect to do a 0.23.5 release in the coming weeks/months as we find more issues running on large clusters.
>
> --Bobby Evans
>
>
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
Re: [VOTE] 0.23.4 release
Posted by Harsh J <ha...@cloudera.com>.
Thanks Robert. My +1 (non-binding) stands - I verified the source tarball
in addition as well.
On Mon, Oct 1, 2012 at 7:12 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> Sorry I thought I had done that. I have added them. No code changes
> needed, not even a recompile in fact, just missed running the final scp.
>
> Thanks for pointing that out.
>
> Bobby
>
> On 9/29/12 6:00 PM, "Harsh J" <ha...@cloudera.com> wrote:
>
> >Hi Robert,
> >
> >Source artifacts are missing. Could you please upload those as a
> >separate tarball like the last time?
> >
> >+1 from me (non-binding) for the binaries otherwise.
> >
> >Verified the signature.
> >
> >? gpg --verify hadoop-0.23.4.tar.gz.asc hadoop-0.23.4.tar.gz
> >gpg: Good signature from "Robert Joseph Evans (Bobby)
> ><bobby[at]apache[dot]org>"
> >
> >Ran a single machine cluster and ran a couple of MR jobs and the
> >distributed shell YARN app (needed extra configuring, check
> >https://issues.apache.org/jira/browse/MAPREDUCE-3869 for your next
> >release, if you perhaps want to make the experience better?). Seems to
> >work alright.
> >
> >? bin/yarn jar
> >share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.4.jar pi
> >-Dmapreduce.framework.name=yarn 10 10
> >…
> >Estimated value of Pi is 3.20000000000000000000
> >
> >On Sat, Sep 29, 2012 at 9:05 PM, Robert Evans <ev...@yahoo-inc.com>
> wrote:
> >> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
> >>the bylaws this vote will be open for 1 week, and will close next
> >>Saturday October 6th.
> >>
> >> You can access the release through the apache maven staging repo, with
> >>the 0.23.4-rc0 tag in subversion, and at
> >>http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
> >>
> >> This release is a sustaining release with several important bug fixes
> >>in it. Most notably upgrading of a 1.0 cluster with append/sync enabled
> >>should now work (HDFS-3731). There are no known blockers against this
> >>release, there are only two critical issues.
> >>
> >> HADOOP-8811
> >> Compile hadoop native library in FreeBSD
> >>
> >> HDFS-3990
> >> NN's health report has severe performance problems
> >>
> >> HDFS-3990 only really has a significant impact on large clusters, and
> >>can be mitigated by enabling DNS caching.
> >>
> >> I have run several manual tests on this release on a small insecure
> >>cluster and all of them pass I am a +1 (binding) for this release.
> >>
> >> On a side note I am happy to announce that the 0.23 line is being
> >>rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
> >>node cluster and have only seen a few issues (HDFS-3990 is the biggest
> >>of them). I expect to do a 0.23.5 release in the coming weeks/months
> >>as we find more issues running on large clusters.
> >>
> >> --Bobby Evans
> >>
> >>
> >
> >
> >
> >--
> >Harsh J
>
>
--
Harsh J
Re: [VOTE] 0.23.4 release
Posted by Robert Evans <ev...@yahoo-inc.com>.
Sorry I thought I had done that. I have added them. No code changes
needed, not even a recompile in fact, just missed running the final scp.
Thanks for pointing that out.
Bobby
On 9/29/12 6:00 PM, "Harsh J" <ha...@cloudera.com> wrote:
>Hi Robert,
>
>Source artifacts are missing. Could you please upload those as a
>separate tarball like the last time?
>
>+1 from me (non-binding) for the binaries otherwise.
>
>Verified the signature.
>
>? gpg --verify hadoop-0.23.4.tar.gz.asc hadoop-0.23.4.tar.gz
>gpg: Good signature from "Robert Joseph Evans (Bobby)
><bobby[at]apache[dot]org>"
>
>Ran a single machine cluster and ran a couple of MR jobs and the
>distributed shell YARN app (needed extra configuring, check
>https://issues.apache.org/jira/browse/MAPREDUCE-3869 for your next
>release, if you perhaps want to make the experience better?). Seems to
>work alright.
>
>? bin/yarn jar
>share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.4.jar pi
>-Dmapreduce.framework.name=yarn 10 10
>…
>Estimated value of Pi is 3.20000000000000000000
>
>On Sat, Sep 29, 2012 at 9:05 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
>> I have built a 0.23.4-rc0 and am calling a release vote on it. As per
>>the bylaws this vote will be open for 1 week, and will close next
>>Saturday October 6th.
>>
>> You can access the release through the apache maven staging repo, with
>>the 0.23.4-rc0 tag in subversion, and at
>>http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>>
>> This release is a sustaining release with several important bug fixes
>>in it. Most notably upgrading of a 1.0 cluster with append/sync enabled
>>should now work (HDFS-3731). There are no known blockers against this
>>release, there are only two critical issues.
>>
>> HADOOP-8811
>> Compile hadoop native library in FreeBSD
>>
>> HDFS-3990
>> NN's health report has severe performance problems
>>
>> HDFS-3990 only really has a significant impact on large clusters, and
>>can be mitigated by enabling DNS caching.
>>
>> I have run several manual tests on this release on a small insecure
>>cluster and all of them pass I am a +1 (binding) for this release.
>>
>> On a side note I am happy to announce that the 0.23 line is being
>>rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000
>>node cluster and have only seen a few issues (HDFS-3990 is the biggest
>>of them). I expect to do a 0.23.5 release in the coming weeks/months
>>as we find more issues running on large clusters.
>>
>> --Bobby Evans
>>
>>
>
>
>
>--
>Harsh J
Re: [VOTE] 0.23.4 release
Posted by Harsh J <ha...@cloudera.com>.
Hi Robert,
Source artifacts are missing. Could you please upload those as a
separate tarball like the last time?
+1 from me (non-binding) for the binaries otherwise.
Verified the signature.
➜ gpg --verify hadoop-0.23.4.tar.gz.asc hadoop-0.23.4.tar.gz
gpg: Good signature from "Robert Joseph Evans (Bobby) <bobby[at]apache[dot]org>"
Ran a single machine cluster and ran a couple of MR jobs and the
distributed shell YARN app (needed extra configuring, check
https://issues.apache.org/jira/browse/MAPREDUCE-3869 for your next
release, if you perhaps want to make the experience better?). Seems to
work alright.
➜ bin/yarn jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-0.23.4.jar pi
-Dmapreduce.framework.name=yarn 10 10
…
Estimated value of Pi is 3.20000000000000000000
On Sat, Sep 29, 2012 at 9:05 PM, Robert Evans <ev...@yahoo-inc.com> wrote:
> I have built a 0.23.4-rc0 and am calling a release vote on it. As per the bylaws this vote will be open for 1 week, and will close next Saturday October 6th.
>
> You can access the release through the apache maven staging repo, with the 0.23.4-rc0 tag in subversion, and at http://people.apache.org/~bobby/hadoop-0.23.4-candidate-0/
>
> This release is a sustaining release with several important bug fixes in it. Most notably upgrading of a 1.0 cluster with append/sync enabled should now work (HDFS-3731). There are no known blockers against this release, there are only two critical issues.
>
> HADOOP-8811
> Compile hadoop native library in FreeBSD
>
> HDFS-3990
> NN's health report has severe performance problems
>
> HDFS-3990 only really has a significant impact on large clusters, and can be mitigated by enabling DNS caching.
>
> I have run several manual tests on this release on a small insecure cluster and all of them pass I am a +1 (binding) for this release.
>
> On a side note I am happy to announce that the 0.23 line is being rolled out more widely at Yahoo!. We just installed 0.23.3 on a 2000 node cluster and have only seen a few issues (HDFS-3990 is the biggest of them). I expect to do a 0.23.5 release in the coming weeks/months as we find more issues running on large clusters.
>
> --Bobby Evans
>
>
--
Harsh J