[VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <as...@apache.org>]

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

Thank you Subru and Arun for driving this, to everyone who tested the
release, and the many more who contributed code and reviews to make this
possible.

Even if we have been at this for a while it is kind of magical to see OSS
development happening.

Cheers,
Carlo


On Nov 17, 2017 1:57 PM, "Subru Krishnan" <su...@apache.org> wrote:

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New
Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.
apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta
is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline
for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

Thank you Subru and Arun for driving this, to everyone who tested the
release, and the many more who contributed code and reviews to make this
possible.

Even if we have been at this for a while it is kind of magical to see OSS
development happening.

Cheers,
Carlo


On Nov 17, 2017 1:57 PM, "Subru Krishnan" <su...@apache.org> wrote:

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New
Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.
apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta
is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline
for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Thanks for the links, Arun. I see I missed this part.
Glad the decision was conscious.
Thanks for the release.
--Konstantin

On Wed, Nov 22, 2017 at 11:39 AM, Arun Suresh <ar...@gmail.com> wrote:

> Hello Konstantin
>
> We actually did discuss a bit about this:
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html
>
> We finally decided to add the following disclaimer on the release page (
> https://hadoop.apache.org/releases.html):
> "Please note: Although this release has been tested on fairly large
> clusters, production users can wait for a subsequent point release which
> will contain fixes from further stabilization and downstream adoption."
>
> Hope this suffices.
>
>
>
>
> On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <
> shv.hadoop@gmail.com> wrote:
>
>> Hey guys,
>>
>> I don't think this has been discussed, pardon if it was.
>> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
>> deceptive for users?
>> Not to diminish the quality and not to understate the effort, which was
>> huge and very much appreciated.
>> But it is the first in the series, with quite a few experimental features,
>> and big delta from the last stable, ...
>>
>> Thanks,
>> --Konstantin
>>
>>
>> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>>
>> > Wrapping up the vote with my +1.
>> >
>> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
>> > - ran multiple sample jobs
>> > - enabled opportunistic containers and submitted more samples
>> > - configured HDFS federation and reran jobs.
>> >
>> >
>> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
>> announce
>> > the vote is passed successfully.
>> >
>> > Thanks to the many of you who contributed to the release and made this
>> > possible and to everyone in this thread who took the time/effort to
>> > validate and vote!
>> >
>> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
>> >
>> > Cheers,
>> > Subru
>> >
>> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
>> > wrote:
>> >
>> > > Thanks Arun and Subru for the hard work on this release.
>> > >
>> > > +1 (binding)
>> > >
>> > > Built from source and stood up a pseudo cluster with 4 NMs
>> > >
>> > > Tested the following:
>> > >
>> > > o User limits are honored during In-queue preemption
>> > >
>> > > o Priorities are honored during In-queue preemption
>> > >
>> > > o Can kill applications from the command line
>> > >
>> > > o Users with different weights are assigned resources proportional to
>> > > their weights.
>> > >
>> > > Thanks,
>> > > -Eric Payne
>> > >
>> > >
>> > > ------------------------------
>> > > *From:* Arun Suresh <as...@apache.org>
>> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
>> > Hadoop
>> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > hdfs-dev@hadoop.apache.org>
>> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
>> > > *Sent:* Monday, November 13, 2017 6:10 PM
>> > >
>> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>> > >
>> > > Hi Folks,
>> > >
>> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
>> be
>> > the
>> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> > Features
>> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
>> > since
>> > > 2.8.2.
>> > >
>> > > More information about the 2.9.0 release plan can be found here:
>> > > *
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > <
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > >*
>> > >
>> > > New RC is available at: *
>> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
>> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>> > >
>> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
>> > >
>> > > The maven artifacts are available via repository.apache.org at:
>> > > <
>> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
>> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
>> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
>> > > >*https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > <https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > >*
>> > >
>> > > We are carrying over the votes from the previous RC given that the
>> delta
>> > is
>> > > the license fix.
>> > >
>> > > Given the above - we are also going to stick with the original
>> deadline
>> > for
>> > > the vote : ending on Friday 17th November 2017 2pm PT time.
>> > >
>> > > Thanks,
>> > > -Arun/Subru
>> > >
>> > >
>> > >
>> >
>>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Thanks for the links, Arun. I see I missed this part.
Glad the decision was conscious.
Thanks for the release.
--Konstantin

On Wed, Nov 22, 2017 at 11:39 AM, Arun Suresh <ar...@gmail.com> wrote:

> Hello Konstantin
>
> We actually did discuss a bit about this:
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html
>
> We finally decided to add the following disclaimer on the release page (
> https://hadoop.apache.org/releases.html):
> "Please note: Although this release has been tested on fairly large
> clusters, production users can wait for a subsequent point release which
> will contain fixes from further stabilization and downstream adoption."
>
> Hope this suffices.
>
>
>
>
> On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <
> shv.hadoop@gmail.com> wrote:
>
>> Hey guys,
>>
>> I don't think this has been discussed, pardon if it was.
>> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
>> deceptive for users?
>> Not to diminish the quality and not to understate the effort, which was
>> huge and very much appreciated.
>> But it is the first in the series, with quite a few experimental features,
>> and big delta from the last stable, ...
>>
>> Thanks,
>> --Konstantin
>>
>>
>> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>>
>> > Wrapping up the vote with my +1.
>> >
>> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
>> > - ran multiple sample jobs
>> > - enabled opportunistic containers and submitted more samples
>> > - configured HDFS federation and reran jobs.
>> >
>> >
>> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
>> announce
>> > the vote is passed successfully.
>> >
>> > Thanks to the many of you who contributed to the release and made this
>> > possible and to everyone in this thread who took the time/effort to
>> > validate and vote!
>> >
>> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
>> >
>> > Cheers,
>> > Subru
>> >
>> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
>> > wrote:
>> >
>> > > Thanks Arun and Subru for the hard work on this release.
>> > >
>> > > +1 (binding)
>> > >
>> > > Built from source and stood up a pseudo cluster with 4 NMs
>> > >
>> > > Tested the following:
>> > >
>> > > o User limits are honored during In-queue preemption
>> > >
>> > > o Priorities are honored during In-queue preemption
>> > >
>> > > o Can kill applications from the command line
>> > >
>> > > o Users with different weights are assigned resources proportional to
>> > > their weights.
>> > >
>> > > Thanks,
>> > > -Eric Payne
>> > >
>> > >
>> > > ------------------------------
>> > > *From:* Arun Suresh <as...@apache.org>
>> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
>> > Hadoop
>> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > hdfs-dev@hadoop.apache.org>
>> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
>> > > *Sent:* Monday, November 13, 2017 6:10 PM
>> > >
>> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>> > >
>> > > Hi Folks,
>> > >
>> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
>> be
>> > the
>> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> > Features
>> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
>> > since
>> > > 2.8.2.
>> > >
>> > > More information about the 2.9.0 release plan can be found here:
>> > > *
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > <
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > >*
>> > >
>> > > New RC is available at: *
>> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
>> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>> > >
>> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
>> > >
>> > > The maven artifacts are available via repository.apache.org at:
>> > > <
>> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
>> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
>> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
>> > > >*https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > <https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > >*
>> > >
>> > > We are carrying over the votes from the previous RC given that the
>> delta
>> > is
>> > > the license fix.
>> > >
>> > > Given the above - we are also going to stick with the original
>> deadline
>> > for
>> > > the vote : ending on Friday 17th November 2017 2pm PT time.
>> > >
>> > > Thanks,
>> > > -Arun/Subru
>> > >
>> > >
>> > >
>> >
>>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Thanks for the links, Arun. I see I missed this part.
Glad the decision was conscious.
Thanks for the release.
--Konstantin

On Wed, Nov 22, 2017 at 11:39 AM, Arun Suresh <ar...@gmail.com> wrote:

> Hello Konstantin
>
> We actually did discuss a bit about this:
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html
>
> We finally decided to add the following disclaimer on the release page (
> https://hadoop.apache.org/releases.html):
> "Please note: Although this release has been tested on fairly large
> clusters, production users can wait for a subsequent point release which
> will contain fixes from further stabilization and downstream adoption."
>
> Hope this suffices.
>
>
>
>
> On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <
> shv.hadoop@gmail.com> wrote:
>
>> Hey guys,
>>
>> I don't think this has been discussed, pardon if it was.
>> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
>> deceptive for users?
>> Not to diminish the quality and not to understate the effort, which was
>> huge and very much appreciated.
>> But it is the first in the series, with quite a few experimental features,
>> and big delta from the last stable, ...
>>
>> Thanks,
>> --Konstantin
>>
>>
>> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>>
>> > Wrapping up the vote with my +1.
>> >
>> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
>> > - ran multiple sample jobs
>> > - enabled opportunistic containers and submitted more samples
>> > - configured HDFS federation and reran jobs.
>> >
>> >
>> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
>> announce
>> > the vote is passed successfully.
>> >
>> > Thanks to the many of you who contributed to the release and made this
>> > possible and to everyone in this thread who took the time/effort to
>> > validate and vote!
>> >
>> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
>> >
>> > Cheers,
>> > Subru
>> >
>> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
>> > wrote:
>> >
>> > > Thanks Arun and Subru for the hard work on this release.
>> > >
>> > > +1 (binding)
>> > >
>> > > Built from source and stood up a pseudo cluster with 4 NMs
>> > >
>> > > Tested the following:
>> > >
>> > > o User limits are honored during In-queue preemption
>> > >
>> > > o Priorities are honored during In-queue preemption
>> > >
>> > > o Can kill applications from the command line
>> > >
>> > > o Users with different weights are assigned resources proportional to
>> > > their weights.
>> > >
>> > > Thanks,
>> > > -Eric Payne
>> > >
>> > >
>> > > ------------------------------
>> > > *From:* Arun Suresh <as...@apache.org>
>> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
>> > Hadoop
>> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > hdfs-dev@hadoop.apache.org>
>> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
>> > > *Sent:* Monday, November 13, 2017 6:10 PM
>> > >
>> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>> > >
>> > > Hi Folks,
>> > >
>> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
>> be
>> > the
>> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> > Features
>> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
>> > since
>> > > 2.8.2.
>> > >
>> > > More information about the 2.9.0 release plan can be found here:
>> > > *
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > <
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > >*
>> > >
>> > > New RC is available at: *
>> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
>> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>> > >
>> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
>> > >
>> > > The maven artifacts are available via repository.apache.org at:
>> > > <
>> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
>> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
>> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
>> > > >*https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > <https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > >*
>> > >
>> > > We are carrying over the votes from the previous RC given that the
>> delta
>> > is
>> > > the license fix.
>> > >
>> > > Given the above - we are also going to stick with the original
>> deadline
>> > for
>> > > the vote : ending on Friday 17th November 2017 2pm PT time.
>> > >
>> > > Thanks,
>> > > -Arun/Subru
>> > >
>> > >
>> > >
>> >
>>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Thanks for the links, Arun. I see I missed this part.
Glad the decision was conscious.
Thanks for the release.
--Konstantin

On Wed, Nov 22, 2017 at 11:39 AM, Arun Suresh <ar...@gmail.com> wrote:

> Hello Konstantin
>
> We actually did discuss a bit about this:
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
> https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html
>
> We finally decided to add the following disclaimer on the release page (
> https://hadoop.apache.org/releases.html):
> "Please note: Although this release has been tested on fairly large
> clusters, production users can wait for a subsequent point release which
> will contain fixes from further stabilization and downstream adoption."
>
> Hope this suffices.
>
>
>
>
> On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <
> shv.hadoop@gmail.com> wrote:
>
>> Hey guys,
>>
>> I don't think this has been discussed, pardon if it was.
>> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
>> deceptive for users?
>> Not to diminish the quality and not to understate the effort, which was
>> huge and very much appreciated.
>> But it is the first in the series, with quite a few experimental features,
>> and big delta from the last stable, ...
>>
>> Thanks,
>> --Konstantin
>>
>>
>> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>>
>> > Wrapping up the vote with my +1.
>> >
>> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
>> > - ran multiple sample jobs
>> > - enabled opportunistic containers and submitted more samples
>> > - configured HDFS federation and reran jobs.
>> >
>> >
>> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
>> announce
>> > the vote is passed successfully.
>> >
>> > Thanks to the many of you who contributed to the release and made this
>> > possible and to everyone in this thread who took the time/effort to
>> > validate and vote!
>> >
>> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
>> >
>> > Cheers,
>> > Subru
>> >
>> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
>> > wrote:
>> >
>> > > Thanks Arun and Subru for the hard work on this release.
>> > >
>> > > +1 (binding)
>> > >
>> > > Built from source and stood up a pseudo cluster with 4 NMs
>> > >
>> > > Tested the following:
>> > >
>> > > o User limits are honored during In-queue preemption
>> > >
>> > > o Priorities are honored during In-queue preemption
>> > >
>> > > o Can kill applications from the command line
>> > >
>> > > o Users with different weights are assigned resources proportional to
>> > > their weights.
>> > >
>> > > Thanks,
>> > > -Eric Payne
>> > >
>> > >
>> > > ------------------------------
>> > > *From:* Arun Suresh <as...@apache.org>
>> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
>> > Hadoop
>> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > hdfs-dev@hadoop.apache.org>
>> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
>> > > *Sent:* Monday, November 13, 2017 6:10 PM
>> > >
>> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>> > >
>> > > Hi Folks,
>> > >
>> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
>> be
>> > the
>> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> > Features
>> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
>> > since
>> > > 2.8.2.
>> > >
>> > > More information about the 2.9.0 release plan can be found here:
>> > > *
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > <
>> > > https://cwiki.apache.org/confluence/display/HADOOP/
>> > Roadmap#Roadmap-Version2.9
>> > > >*
>> > >
>> > > New RC is available at: *
>> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
>> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>> > >
>> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
>> > >
>> > > The maven artifacts are available via repository.apache.org at:
>> > > <
>> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
>> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
>> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
>> > > >*https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > <https://repository.apache.org/content/repositories/
>> > orgapachehadoop-1068/
>> > > >*
>> > >
>> > > We are carrying over the votes from the previous RC given that the
>> delta
>> > is
>> > > the license fix.
>> > >
>> > > Given the above - we are also going to stick with the original
>> deadline
>> > for
>> > > the vote : ending on Friday 17th November 2017 2pm PT time.
>> > >
>> > > Thanks,
>> > > -Arun/Subru
>> > >
>> > >
>> > >
>> >
>>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <ar...@gmail.com>]

Hello Konstantin

We actually did discuss a bit about this:
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html

We finally decided to add the following disclaimer on the release page (
https://hadoop.apache.org/releases.html):
"Please note: Although this release has been tested on fairly large
clusters, production users can wait for a subsequent point release which
will contain fixes from further stabilization and downstream adoption."

Hope this suffices.




On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <sh...@gmail.com>
wrote:

> Hey guys,
>
> I don't think this has been discussed, pardon if it was.
> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
> deceptive for users?
> Not to diminish the quality and not to understate the effort, which was
> huge and very much appreciated.
> But it is the first in the series, with quite a few experimental features,
> and big delta from the last stable, ...
>
> Thanks,
> --Konstantin
>
>
> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>
> > Wrapping up the vote with my +1.
> >
> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> > - ran multiple sample jobs
> > - enabled opportunistic containers and submitted more samples
> > - configured HDFS federation and reran jobs.
> >
> >
> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
> announce
> > the vote is passed successfully.
> >
> > Thanks to the many of you who contributed to the release and made this
> > possible and to everyone in this thread who took the time/effort to
> > validate and vote!
> >
> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
> >
> > Cheers,
> > Subru
> >
> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> > wrote:
> >
> > > Thanks Arun and Subru for the hard work on this release.
> > >
> > > +1 (binding)
> > >
> > > Built from source and stood up a pseudo cluster with 4 NMs
> > >
> > > Tested the following:
> > >
> > > o User limits are honored during In-queue preemption
> > >
> > > o Priorities are honored during In-queue preemption
> > >
> > > o Can kill applications from the command line
> > >
> > > o Users with different weights are assigned resources proportional to
> > > their weights.
> > >
> > > Thanks,
> > > -Eric Payne
> > >
> > >
> > > ------------------------------
> > > *From:* Arun Suresh <as...@apache.org>
> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> > Hadoop
> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > hdfs-dev@hadoop.apache.org>
> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > > *Sent:* Monday, November 13, 2017 6:10 PM
> > >
> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > >*
> > >
> > > New RC is available at: *
> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <
> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > > >*https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > >*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> > >
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <ar...@gmail.com>]

Hello Konstantin

We actually did discuss a bit about this:
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html

We finally decided to add the following disclaimer on the release page (
https://hadoop.apache.org/releases.html):
"Please note: Although this release has been tested on fairly large
clusters, production users can wait for a subsequent point release which
will contain fixes from further stabilization and downstream adoption."

Hope this suffices.




On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <sh...@gmail.com>
wrote:

> Hey guys,
>
> I don't think this has been discussed, pardon if it was.
> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
> deceptive for users?
> Not to diminish the quality and not to understate the effort, which was
> huge and very much appreciated.
> But it is the first in the series, with quite a few experimental features,
> and big delta from the last stable, ...
>
> Thanks,
> --Konstantin
>
>
> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>
> > Wrapping up the vote with my +1.
> >
> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> > - ran multiple sample jobs
> > - enabled opportunistic containers and submitted more samples
> > - configured HDFS federation and reran jobs.
> >
> >
> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
> announce
> > the vote is passed successfully.
> >
> > Thanks to the many of you who contributed to the release and made this
> > possible and to everyone in this thread who took the time/effort to
> > validate and vote!
> >
> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
> >
> > Cheers,
> > Subru
> >
> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> > wrote:
> >
> > > Thanks Arun and Subru for the hard work on this release.
> > >
> > > +1 (binding)
> > >
> > > Built from source and stood up a pseudo cluster with 4 NMs
> > >
> > > Tested the following:
> > >
> > > o User limits are honored during In-queue preemption
> > >
> > > o Priorities are honored during In-queue preemption
> > >
> > > o Can kill applications from the command line
> > >
> > > o Users with different weights are assigned resources proportional to
> > > their weights.
> > >
> > > Thanks,
> > > -Eric Payne
> > >
> > >
> > > ------------------------------
> > > *From:* Arun Suresh <as...@apache.org>
> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> > Hadoop
> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > hdfs-dev@hadoop.apache.org>
> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > > *Sent:* Monday, November 13, 2017 6:10 PM
> > >
> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > >*
> > >
> > > New RC is available at: *
> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <
> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > > >*https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > >*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> > >
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <ar...@gmail.com>]

Hello Konstantin

We actually did discuss a bit about this:
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html

We finally decided to add the following disclaimer on the release page (
https://hadoop.apache.org/releases.html):
"Please note: Although this release has been tested on fairly large
clusters, production users can wait for a subsequent point release which
will contain fixes from further stabilization and downstream adoption."

Hope this suffices.




On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <sh...@gmail.com>
wrote:

> Hey guys,
>
> I don't think this has been discussed, pardon if it was.
> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
> deceptive for users?
> Not to diminish the quality and not to understate the effort, which was
> huge and very much appreciated.
> But it is the first in the series, with quite a few experimental features,
> and big delta from the last stable, ...
>
> Thanks,
> --Konstantin
>
>
> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>
> > Wrapping up the vote with my +1.
> >
> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> > - ran multiple sample jobs
> > - enabled opportunistic containers and submitted more samples
> > - configured HDFS federation and reran jobs.
> >
> >
> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
> announce
> > the vote is passed successfully.
> >
> > Thanks to the many of you who contributed to the release and made this
> > possible and to everyone in this thread who took the time/effort to
> > validate and vote!
> >
> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
> >
> > Cheers,
> > Subru
> >
> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> > wrote:
> >
> > > Thanks Arun and Subru for the hard work on this release.
> > >
> > > +1 (binding)
> > >
> > > Built from source and stood up a pseudo cluster with 4 NMs
> > >
> > > Tested the following:
> > >
> > > o User limits are honored during In-queue preemption
> > >
> > > o Priorities are honored during In-queue preemption
> > >
> > > o Can kill applications from the command line
> > >
> > > o Users with different weights are assigned resources proportional to
> > > their weights.
> > >
> > > Thanks,
> > > -Eric Payne
> > >
> > >
> > > ------------------------------
> > > *From:* Arun Suresh <as...@apache.org>
> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> > Hadoop
> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > hdfs-dev@hadoop.apache.org>
> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > > *Sent:* Monday, November 13, 2017 6:10 PM
> > >
> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > >*
> > >
> > > New RC is available at: *
> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <
> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > > >*https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > >*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> > >
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <ar...@gmail.com>]

Hello Konstantin

We actually did discuss a bit about this:
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html
https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html

We finally decided to add the following disclaimer on the release page (
https://hadoop.apache.org/releases.html):
"Please note: Although this release has been tested on fairly large
clusters, production users can wait for a subsequent point release which
will contain fixes from further stabilization and downstream adoption."

Hope this suffices.




On Wed, Nov 22, 2017 at 10:30 AM, Konstantin Shvachko <sh...@gmail.com>
wrote:

> Hey guys,
>
> I don't think this has been discussed, pardon if it was.
> As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
> deceptive for users?
> Not to diminish the quality and not to understate the effort, which was
> huge and very much appreciated.
> But it is the first in the series, with quite a few experimental features,
> and big delta from the last stable, ...
>
> Thanks,
> --Konstantin
>
>
> On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:
>
> > Wrapping up the vote with my +1.
> >
> > Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> > - ran multiple sample jobs
> > - enabled opportunistic containers and submitted more samples
> > - configured HDFS federation and reran jobs.
> >
> >
> > With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to
> announce
> > the vote is passed successfully.
> >
> > Thanks to the many of you who contributed to the release and made this
> > possible and to everyone in this thread who took the time/effort to
> > validate and vote!
> >
> > We’ll push the release bits and send out an announcement for 2.9.0 soon.
> >
> > Cheers,
> > Subru
> >
> > On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> > wrote:
> >
> > > Thanks Arun and Subru for the hard work on this release.
> > >
> > > +1 (binding)
> > >
> > > Built from source and stood up a pseudo cluster with 4 NMs
> > >
> > > Tested the following:
> > >
> > > o User limits are honored during In-queue preemption
> > >
> > > o Priorities are honored during In-queue preemption
> > >
> > > o Can kill applications from the command line
> > >
> > > o Users with different weights are assigned resources proportional to
> > > their weights.
> > >
> > > Thanks,
> > > -Eric Payne
> > >
> > >
> > > ------------------------------
> > > *From:* Arun Suresh <as...@apache.org>
> > > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> > Hadoop
> > > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > hdfs-dev@hadoop.apache.org>
> > > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > > *Sent:* Monday, November 13, 2017 6:10 PM
> > >
> > > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <
> > > https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > >*
> > >
> > > New RC is available at: *
> > > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <
> > > https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > > >*https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/
> > > >*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> > >
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Hey guys,

I don't think this has been discussed, pardon if it was.
As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
deceptive for users?
Not to diminish the quality and not to understate the effort, which was
huge and very much appreciated.
But it is the first in the series, with quite a few experimental features,
and big delta from the last stable, ...

Thanks,
--Konstantin


On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:

> Wrapping up the vote with my +1.
>
> Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> - ran multiple sample jobs
> - enabled opportunistic containers and submitted more samples
> - configured HDFS federation and reran jobs.
>
>
> With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
> the vote is passed successfully.
>
> Thanks to the many of you who contributed to the release and made this
> possible and to everyone in this thread who took the time/effort to
> validate and vote!
>
> We’ll push the release bits and send out an announcement for 2.9.0 soon.
>
> Cheers,
> Subru
>
> On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> wrote:
>
> > Thanks Arun and Subru for the hard work on this release.
> >
> > +1 (binding)
> >
> > Built from source and stood up a pseudo cluster with 4 NMs
> >
> > Tested the following:
> >
> > o User limits are honored during In-queue preemption
> >
> > o Priorities are honored during In-queue preemption
> >
> > o Can kill applications from the command line
> >
> > o Users with different weights are assigned resources proportional to
> > their weights.
> >
> > Thanks,
> > -Eric Payne
> >
> >
> > ------------------------------
> > *From:* Arun Suresh <as...@apache.org>
> > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> Hadoop
> > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>
> > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > *Sent:* Monday, November 13, 2017 6:10 PM
> >
> > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > >*
> >
> > New RC is available at: *
> > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <
> > https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > >*https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

Thank you Subru and Arun for driving this, to everyone who tested the
release, and the many more who contributed code and reviews to make this
possible.

Even if we have been at this for a while it is kind of magical to see OSS
development happening.

Cheers,
Carlo


On Nov 17, 2017 1:57 PM, "Subru Krishnan" <su...@apache.org> wrote:

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New
Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.
apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta
is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline
for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

Thank you Subru and Arun for driving this, to everyone who tested the
release, and the many more who contributed code and reviews to make this
possible.

Even if we have been at this for a while it is kind of magical to see OSS
development happening.

Cheers,
Carlo


On Nov 17, 2017 1:57 PM, "Subru Krishnan" <su...@apache.org> wrote:

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New
Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/
Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.
apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta
is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline
for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Hey guys,

I don't think this has been discussed, pardon if it was.
As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
deceptive for users?
Not to diminish the quality and not to understate the effort, which was
huge and very much appreciated.
But it is the first in the series, with quite a few experimental features,
and big delta from the last stable, ...

Thanks,
--Konstantin


On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:

> Wrapping up the vote with my +1.
>
> Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> - ran multiple sample jobs
> - enabled opportunistic containers and submitted more samples
> - configured HDFS federation and reran jobs.
>
>
> With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
> the vote is passed successfully.
>
> Thanks to the many of you who contributed to the release and made this
> possible and to everyone in this thread who took the time/effort to
> validate and vote!
>
> We’ll push the release bits and send out an announcement for 2.9.0 soon.
>
> Cheers,
> Subru
>
> On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> wrote:
>
> > Thanks Arun and Subru for the hard work on this release.
> >
> > +1 (binding)
> >
> > Built from source and stood up a pseudo cluster with 4 NMs
> >
> > Tested the following:
> >
> > o User limits are honored during In-queue preemption
> >
> > o Priorities are honored during In-queue preemption
> >
> > o Can kill applications from the command line
> >
> > o Users with different weights are assigned resources proportional to
> > their weights.
> >
> > Thanks,
> > -Eric Payne
> >
> >
> > ------------------------------
> > *From:* Arun Suresh <as...@apache.org>
> > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> Hadoop
> > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>
> > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > *Sent:* Monday, November 13, 2017 6:10 PM
> >
> > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > >*
> >
> > New RC is available at: *
> > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <
> > https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > >*https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Hey guys,

I don't think this has been discussed, pardon if it was.
As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
deceptive for users?
Not to diminish the quality and not to understate the effort, which was
huge and very much appreciated.
But it is the first in the series, with quite a few experimental features,
and big delta from the last stable, ...

Thanks,
--Konstantin


On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:

> Wrapping up the vote with my +1.
>
> Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> - ran multiple sample jobs
> - enabled opportunistic containers and submitted more samples
> - configured HDFS federation and reran jobs.
>
>
> With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
> the vote is passed successfully.
>
> Thanks to the many of you who contributed to the release and made this
> possible and to everyone in this thread who took the time/effort to
> validate and vote!
>
> We’ll push the release bits and send out an announcement for 2.9.0 soon.
>
> Cheers,
> Subru
>
> On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> wrote:
>
> > Thanks Arun and Subru for the hard work on this release.
> >
> > +1 (binding)
> >
> > Built from source and stood up a pseudo cluster with 4 NMs
> >
> > Tested the following:
> >
> > o User limits are honored during In-queue preemption
> >
> > o Priorities are honored during In-queue preemption
> >
> > o Can kill applications from the command line
> >
> > o Users with different weights are assigned resources proportional to
> > their weights.
> >
> > Thanks,
> > -Eric Payne
> >
> >
> > ------------------------------
> > *From:* Arun Suresh <as...@apache.org>
> > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> Hadoop
> > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>
> > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > *Sent:* Monday, November 13, 2017 6:10 PM
> >
> > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > >*
> >
> > New RC is available at: *
> > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <
> > https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > >*https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantin Shvachko <sh...@gmail.com>]

Hey guys,

I don't think this has been discussed, pardon if it was.
As it stands today hadoop 2.9.0 is marked as stable release. Isn't that
deceptive for users?
Not to diminish the quality and not to understate the effort, which was
huge and very much appreciated.
But it is the first in the series, with quite a few experimental features,
and big delta from the last stable, ...

Thanks,
--Konstantin


On Fri, Nov 17, 2017 at 1:56 PM, Subru Krishnan <su...@apache.org> wrote:

> Wrapping up the vote with my +1.
>
> Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
> - ran multiple sample jobs
> - enabled opportunistic containers and submitted more samples
> - configured HDFS federation and reran jobs.
>
>
> With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
> the vote is passed successfully.
>
> Thanks to the many of you who contributed to the release and made this
> possible and to everyone in this thread who took the time/effort to
> validate and vote!
>
> We’ll push the release bits and send out an announcement for 2.9.0 soon.
>
> Cheers,
> Subru
>
> On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
> wrote:
>
> > Thanks Arun and Subru for the hard work on this release.
> >
> > +1 (binding)
> >
> > Built from source and stood up a pseudo cluster with 4 NMs
> >
> > Tested the following:
> >
> > o User limits are honored during In-queue preemption
> >
> > o Priorities are honored during In-queue preemption
> >
> > o Can kill applications from the command line
> >
> > o Users with different weights are assigned resources proportional to
> > their weights.
> >
> > Thanks,
> > -Eric Payne
> >
> >
> > ------------------------------
> > *From:* Arun Suresh <as...@apache.org>
> > *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org;
> Hadoop
> > Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>
> > *Cc:* Subramaniam Krishnan <su...@apache.org>
> > *Sent:* Monday, November 13, 2017 6:10 PM
> >
> > *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <
> > https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > >*
> >
> > New RC is available at: *
> > https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <
> > https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> > >*https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Subru Krishnan <su...@apache.org>]

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Subru Krishnan <su...@apache.org>]

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Subru Krishnan <su...@apache.org>]

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Subru Krishnan <su...@apache.org>]

Wrapping up the vote with my +1.

Deployed RC3 on a federated YARN cluster with 6 sub-clusters:
- ran multiple sample jobs
- enabled opportunistic containers and submitted more samples
- configured HDFS federation and reran jobs.


With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to announce
the vote is passed successfully.

Thanks to the many of you who contributed to the release and made this
possible and to everyone in this thread who took the time/effort to
validate and vote!

We’ll push the release bits and send out an announcement for 2.9.0 soon.

Cheers,
Subru

On Fri, Nov 17, 2017 at 12:41 PM Eric Payne <er...@yahoo.com>
wrote:

> Thanks Arun and Subru for the hard work on this release.
>
> +1 (binding)
>
> Built from source and stood up a pseudo cluster with 4 NMs
>
> Tested the following:
>
> o User limits are honored during In-queue preemption
>
> o Priorities are honored during In-queue preemption
>
> o Can kill applications from the command line
>
> o Users with different weights are assigned resources proportional to
> their weights.
>
> Thanks,
> -Eric Payne
>
>
> ------------------------------
> *From:* Arun Suresh <as...@apache.org>
> *To:* yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>
> *Cc:* Subramaniam Krishnan <su...@apache.org>
> *Sent:* Monday, November 13, 2017 6:10 PM
>
> *Subject:* [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Payne <er...@yahoo.com.INVALID>]

Thanks Arun and Subru for the hard work on this release.

+1 (binding)

Built from source and stood up a pseudo cluster with 4 NMs
Tested the following:
o User limits are honored during In-queue preemption 

o Priorities are honored during In-queue preemption
o Can kill applications from the command line
o Users with different weights are assigned resources proportional to their weights.
Thanks,-Eric Payne


      From: Arun Suresh <as...@apache.org>
 To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org> 
Cc: Subramaniam Krishnan <su...@apache.org>
 Sent: Monday, November 13, 2017 6:10 PM
 Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
   
Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


   

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Steve Loughran <st...@hortonworks.com>]

On 14 Nov 2017, at 00:10, Arun Suresh <as...@apache.org>> wrote:

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org<http://repository.apache.org> at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru

I hadn't finished my testing yet; I'd been assuming that it was 5 days from thw new RC. I believe every RC should (must?) still have that 5 day test period. I have done all my core tests, but haven't done the final tests of the S3Guard CLI tests. I did have to actually put in an afternoon making my spark cloud integration tests work against branch-2, so it wasn't like I could just D/L and test in half an hour


As it was, I had filed one minor bug, but didnt' consider that an issue as it was only with the new  FileSystem.create(path)" Builder. I was going to go vote +! unless those CLI tests were completly broken.


What I do want is  release notes to highlight which things we think unstable/experimental features to use with caution

  1.  Filesystem.create(Path)
  2.  S3Guard
  3.  AlyiunOSS (it hasn't been out long enough to be trusted)

We ourselves know what's still stabilising, other should too


Download:

D/L tar file, & .asc, check signature

pg2 --verify hadoop-2.9.0.tar.gz.asc
gpg: assuming signed data in 'hadoop-2.9.0.tar.gz'
gpg: Signature made Mon 13 Nov 23:45:49 2017 GMT
gpg:                using RSA key 0x7ECDEEEA64ECB6E6
gpg: Good signature from "Arun Suresh <as...@apache.org>>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 412B BFB1 27CB 48DA 6BA2  E3EE 7ECD EEEA 64EC B6E6


This is a valid signature; Arun is listed in KEYS. He's not trusted though: at the time of checking his public key hadn't been signed by anyone I trust
 though it shows we need more cross-trust between them. (Since then Andrew Wang has authenticated him, so he is now transitively trusted).


Downstream build

Clean build of Spark through the staged artifacts (must remember to rm the local copies when the release ships). This verifies artifacts and source code compatibility.

mvn clean install -Pyarn,hadoop-2.7,hadoop-cloud,snapshots-and-staging  -Dhadoop.version=2.9.0

Everything compiled fine. I did not do a full test run; I didn't have the time and without knowing whether everything worked locally on the 2.8.1 release, could have been a distraction on a failure.


Downstream tests:

Ran all my spark cloud integration tests: s3 (S3 ireland + S3Guard) , azure (Azure ireland(, swift (RAX US);

https://github.com/hortonworks-spark/cloud-integration/tree/branch-2

there were 3 failures of SparkSQL & ORC in test setup, but I think that's related to the latest spark code & my injected-into-org.apache.spark-namespace tests; they're a bit brittle to changes in spark-master.

All the work used the "legacy" FileOutputCommitter; with s3guard turned on. This delivers the consistency needed for Job and task commit to be correct, though without the performance needed for it to be usable in production. That's dependent on HADOOP-13786, which I don't propose to backport. (it loves its Java 8 & targets 3.1)


hadoop cloud module object store tests

Checked out the relevant git commit & did a local run of hadoop-aws, hadoop-azure and hadoop-openstack


hadoop-amazon
* s3a happy, including s3guard
* All the s3n & s3:// tests skipped/failed because I didn't have the test bindings for those set up: untested.

Azure wasb: happy; one transient failure which

ADLs: Not set up test this
OSS: not set up to test this

Swift:

Found one test failure due to swift not supporting FileSystem.createNonRecursive(); this means the new builder based FileSystem.create(Path) mechanism doesn't work for it. Nothing that serious, given its an experimental API, but it does show that we are undertesting this stuff.

https://issues.apache.org/jira/browse/HADOOP-15050

Note: the swift tests I ran downstream with spark did work. This is only the new API call which fails.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jason Lowe <jl...@oath.com.INVALID>]

Thanks for putting this release together!

+1 (binding)

- Verified signatures and digests
- Successfully built from source including native
- Deployed to single-node cluster and ran some test jobs

Jason


On Mon, Nov 13, 2017 at 6:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Sunil G <su...@apache.org>]

+1 (binding)

Built from source.



   - Tested few cases in an HA cluster and tried to do failover by using
   rmadmin commands etc. This seems works fine including submitting apps.
   - I also tested many MR apps and all are running fine w/o any issues.
   - Majorly tested below feature sanity too (works fine)
      - Application priority
      - Application timeout
   - Tested basic NodeLabel scenarios.
      - Added some labels to couple of nodes
      - Verified old UI for labels
      - Submitted apps to labelled cluster and it works fine.
      - Also performed few cli commands related to nodelabel
   - Verified new YARN UI and accessed various pages when cluster was in
   use. It seems fine to me.

- Sunil


On Tue, Nov 14, 2017 at 5:40 AM Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Wangda Tan <wh...@gmail.com>]

+1 (Binding).

Built from source, deployed pseudo cluster, ran sample jobs.

Thanks,
Wangda

On Wed, Nov 15, 2017 at 8:34 PM, Brahma Reddy Battula <br...@apache.org>
wrote:

> +1 ( non-binding)
>
> -Built from the source
> -Installed 3 Node HA cluster and a pseudo cluster
> -Verified through hdfs shell commands
> -Verified HDFS router federation
> -Ran sample jobs like pi,Slive
>
>
>
> --Brahma Reddy
>
>
> On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
>
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Wangda Tan <wh...@gmail.com>]

+1 (Binding).

Built from source, deployed pseudo cluster, ran sample jobs.

Thanks,
Wangda

On Wed, Nov 15, 2017 at 8:34 PM, Brahma Reddy Battula <br...@apache.org>
wrote:

> +1 ( non-binding)
>
> -Built from the source
> -Installed 3 Node HA cluster and a pseudo cluster
> -Verified through hdfs shell commands
> -Verified HDFS router federation
> -Ran sample jobs like pi,Slive
>
>
>
> --Brahma Reddy
>
>
> On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
>
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Wangda Tan <wh...@gmail.com>]

+1 (Binding).

Built from source, deployed pseudo cluster, ran sample jobs.

Thanks,
Wangda

On Wed, Nov 15, 2017 at 8:34 PM, Brahma Reddy Battula <br...@apache.org>
wrote:

> +1 ( non-binding)
>
> -Built from the source
> -Installed 3 Node HA cluster and a pseudo cluster
> -Verified through hdfs shell commands
> -Verified HDFS router federation
> -Ran sample jobs like pi,Slive
>
>
>
> --Brahma Reddy
>
>
> On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
>
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Wangda Tan <wh...@gmail.com>]

+1 (Binding).

Built from source, deployed pseudo cluster, ran sample jobs.

Thanks,
Wangda

On Wed, Nov 15, 2017 at 8:34 PM, Brahma Reddy Battula <br...@apache.org>
wrote:

> +1 ( non-binding)
>
> -Built from the source
> -Installed 3 Node HA cluster and a pseudo cluster
> -Verified through hdfs shell commands
> -Verified HDFS router federation
> -Ran sample jobs like pi,Slive
>
>
>
> --Brahma Reddy
>
>
> On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
>
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/
> > >*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
> >
>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Brahma Reddy Battula <br...@apache.org>]

+1 ( non-binding)

-Built from the source
-Installed 3 Node HA cluster and a pseudo cluster
-Verified through hdfs shell commands
-Verified HDFS router federation
-Ran sample jobs like pi,Slive



--Brahma Reddy


On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>



-- 



--Brahma Reddy Battula

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Kuhu Shukla <ks...@oath.com.INVALID>]

+1 (non-binding)
1.  Built from source.
2. Deployed to pseudo node cluster
3. Ran sample jobs.

Regards,
Kuhu


On Wed, Nov 15, 2017 at 1:07 PM, Eric Badger <eb...@oath.com.invalid>
wrote:

> +1 (non-binding)
>
> - Verified all hashes and checksums
> - Built from source on macOS 10.12.6, Java 1.8.0u65
> - Deployed a pseudo cluster
> - Ran some example jobs
>
> Thanks,
>
> Eric
>
> On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <
> carlo.curino@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> > >
> > > - Deployed on a single node cluster.
> > > - Deployed a ViewFS cluster with two hdfs mount points.
> > > - Performed basic sanity checks.
> > > - Performed DFS operations(put, ls, mkdir, touch)
> > >
> > > Thanks,
> > > Mukul
> > >
> > >
> > > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > > >
> > > > Hi Folks,
> > > >
> > > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
> be
> > > the
> > > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > > Features
> > > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > > since
> > > > 2.8.2.
> > > >
> > > > More information about the 2.9.0 release plan can be found here:
> > > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9
> > > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9>*
> > > >
> > > > New RC is available at: *https://home.apache.org/~
> > > asuresh/hadoop-2.9.0-RC3/
> > > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > > >
> > > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > > >
> > > > The maven artifacts are available via repository.apache.org at:
> > > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > > <https://repository.apache.org/content/repositories/
> > > orgapachehadoop-1068/>*
> > > >
> > > > We are carrying over the votes from the previous RC given that the
> > delta
> > > is
> > > > the license fix.
> > > >
> > > > Given the above - we are also going to stick with the original
> deadline
> > > for
> > > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > > >
> > > > Thanks,
> > > > -Arun/Subru
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Kuhu Shukla <ks...@oath.com.INVALID>]

+1 (non-binding)
1.  Built from source.
2. Deployed to pseudo node cluster
3. Ran sample jobs.

Regards,
Kuhu


On Wed, Nov 15, 2017 at 1:07 PM, Eric Badger <eb...@oath.com.invalid>
wrote:

> +1 (non-binding)
>
> - Verified all hashes and checksums
> - Built from source on macOS 10.12.6, Java 1.8.0u65
> - Deployed a pseudo cluster
> - Ran some example jobs
>
> Thanks,
>
> Eric
>
> On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <
> carlo.curino@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> > >
> > > - Deployed on a single node cluster.
> > > - Deployed a ViewFS cluster with two hdfs mount points.
> > > - Performed basic sanity checks.
> > > - Performed DFS operations(put, ls, mkdir, touch)
> > >
> > > Thanks,
> > > Mukul
> > >
> > >
> > > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > > >
> > > > Hi Folks,
> > > >
> > > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
> be
> > > the
> > > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > > Features
> > > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > > since
> > > > 2.8.2.
> > > >
> > > > More information about the 2.9.0 release plan can be found here:
> > > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9
> > > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9>*
> > > >
> > > > New RC is available at: *https://home.apache.org/~
> > > asuresh/hadoop-2.9.0-RC3/
> > > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > > >
> > > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > > >
> > > > The maven artifacts are available via repository.apache.org at:
> > > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > > <https://repository.apache.org/content/repositories/
> > > orgapachehadoop-1068/>*
> > > >
> > > > We are carrying over the votes from the previous RC given that the
> > delta
> > > is
> > > > the license fix.
> > > >
> > > > Given the above - we are also going to stick with the original
> deadline
> > > for
> > > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > > >
> > > > Thanks,
> > > > -Arun/Subru
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Kuhu Shukla <ks...@oath.com.INVALID>]

+1 (non-binding)
1.  Built from source.
2. Deployed to pseudo node cluster
3. Ran sample jobs.

Regards,
Kuhu


On Wed, Nov 15, 2017 at 1:07 PM, Eric Badger <eb...@oath.com.invalid>
wrote:

> +1 (non-binding)
>
> - Verified all hashes and checksums
> - Built from source on macOS 10.12.6, Java 1.8.0u65
> - Deployed a pseudo cluster
> - Ran some example jobs
>
> Thanks,
>
> Eric
>
> On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <
> carlo.curino@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> > >
> > > - Deployed on a single node cluster.
> > > - Deployed a ViewFS cluster with two hdfs mount points.
> > > - Performed basic sanity checks.
> > > - Performed DFS operations(put, ls, mkdir, touch)
> > >
> > > Thanks,
> > > Mukul
> > >
> > >
> > > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > > >
> > > > Hi Folks,
> > > >
> > > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
> be
> > > the
> > > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > > Features
> > > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > > since
> > > > 2.8.2.
> > > >
> > > > More information about the 2.9.0 release plan can be found here:
> > > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9
> > > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9>*
> > > >
> > > > New RC is available at: *https://home.apache.org/~
> > > asuresh/hadoop-2.9.0-RC3/
> > > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > > >
> > > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > > >
> > > > The maven artifacts are available via repository.apache.org at:
> > > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > > <https://repository.apache.org/content/repositories/
> > > orgapachehadoop-1068/>*
> > > >
> > > > We are carrying over the votes from the previous RC given that the
> > delta
> > > is
> > > > the license fix.
> > > >
> > > > Given the above - we are also going to stick with the original
> deadline
> > > for
> > > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > > >
> > > > Thanks,
> > > > -Arun/Subru
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Kuhu Shukla <ks...@oath.com.INVALID>]

+1 (non-binding)
1.  Built from source.
2. Deployed to pseudo node cluster
3. Ran sample jobs.

Regards,
Kuhu


On Wed, Nov 15, 2017 at 1:07 PM, Eric Badger <eb...@oath.com.invalid>
wrote:

> +1 (non-binding)
>
> - Verified all hashes and checksums
> - Built from source on macOS 10.12.6, Java 1.8.0u65
> - Deployed a pseudo cluster
> - Ran some example jobs
>
> Thanks,
>
> Eric
>
> On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <
> carlo.curino@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> > >
> > > - Deployed on a single node cluster.
> > > - Deployed a ViewFS cluster with two hdfs mount points.
> > > - Performed basic sanity checks.
> > > - Performed DFS operations(put, ls, mkdir, touch)
> > >
> > > Thanks,
> > > Mukul
> > >
> > >
> > > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > > >
> > > > Hi Folks,
> > > >
> > > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will
> be
> > > the
> > > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > > Features
> > > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > > since
> > > > 2.8.2.
> > > >
> > > > More information about the 2.9.0 release plan can be found here:
> > > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9
> > > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > > Roadmap#Roadmap-Version2.9>*
> > > >
> > > > New RC is available at: *https://home.apache.org/~
> > > asuresh/hadoop-2.9.0-RC3/
> > > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > > >
> > > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > > >
> > > > The maven artifacts are available via repository.apache.org at:
> > > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > > <https://repository.apache.org/content/repositories/
> > > orgapachehadoop-1068/>*
> > > >
> > > > We are carrying over the votes from the previous RC given that the
> > delta
> > > is
> > > > the license fix.
> > > >
> > > > Given the above - we are also going to stick with the original
> deadline
> > > for
> > > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > > >
> > > > Thanks,
> > > > -Arun/Subru
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Badger <eb...@oath.com.INVALID>]

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.12.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs

Thanks,

Eric

On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <ca...@gmail.com>
wrote:

> +1 (binding)
>
> On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> wrote:
>
> > +1 (non-binding)
> >
> > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> >
> > - Deployed on a single node cluster.
> > - Deployed a ViewFS cluster with two hdfs mount points.
> > - Performed basic sanity checks.
> > - Performed DFS operations(put, ls, mkdir, touch)
> >
> > Thanks,
> > Mukul
> >
> >
> > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> > >
> > > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/>*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Badger <eb...@oath.com.INVALID>]

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.12.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs

Thanks,

Eric

On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <ca...@gmail.com>
wrote:

> +1 (binding)
>
> On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> wrote:
>
> > +1 (non-binding)
> >
> > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> >
> > - Deployed on a single node cluster.
> > - Deployed a ViewFS cluster with two hdfs mount points.
> > - Performed basic sanity checks.
> > - Performed DFS operations(put, ls, mkdir, touch)
> >
> > Thanks,
> > Mukul
> >
> >
> > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> > >
> > > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/>*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Badger <eb...@oath.com.INVALID>]

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.12.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs

Thanks,

Eric

On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <ca...@gmail.com>
wrote:

> +1 (binding)
>
> On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> wrote:
>
> > +1 (non-binding)
> >
> > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> >
> > - Deployed on a single node cluster.
> > - Deployed a ViewFS cluster with two hdfs mount points.
> > - Performed basic sanity checks.
> > - Performed DFS operations(put, ls, mkdir, touch)
> >
> > Thanks,
> > Mukul
> >
> >
> > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> > >
> > > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/>*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Badger <eb...@oath.com.INVALID>]

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.12.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs

Thanks,

Eric

On Wed, Nov 15, 2017 at 10:24 AM, Carlo Aldo Curino <ca...@gmail.com>
wrote:

> +1 (binding)
>
> On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com>
> wrote:
>
> > +1 (non-binding)
> >
> > I built from source on Mac OS X 10.13.1 Java 1.8.0_111
> >
> > - Deployed on a single node cluster.
> > - Deployed a ViewFS cluster with two hdfs mount points.
> > - Performed basic sanity checks.
> > - Performed DFS operations(put, ls, mkdir, touch)
> >
> > Thanks,
> > Mukul
> >
> >
> > > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> > >
> > > Hi Folks,
> > >
> > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> > the
> > > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> > Features
> > > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> > since
> > > 2.8.2.
> > >
> > > More information about the 2.9.0 release plan can be found here:
> > > *https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9
> > > <https://cwiki.apache.org/confluence/display/HADOOP/
> > Roadmap#Roadmap-Version2.9>*
> > >
> > > New RC is available at: *https://home.apache.org/~
> > asuresh/hadoop-2.9.0-RC3/
> > > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> > >
> > > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> > >
> > > The maven artifacts are available via repository.apache.org at:
> > > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> > apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> > sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> > repository.apache.org/content/repositories/orgapachehadoop-1068/
> > > <https://repository.apache.org/content/repositories/
> > orgapachehadoop-1068/>*
> > >
> > > We are carrying over the votes from the previous RC given that the
> delta
> > is
> > > the license fix.
> > >
> > > Given the above - we are also going to stick with the original deadline
> > for
> > > the vote : ending on Friday 17th November 2017 2pm PT time.
> > >
> > > Thanks,
> > > -Arun/Subru
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

+1 (binding)

On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com> wrote:

> +1 (non-binding)
>
> I built from source on Mac OS X 10.13.1 Java 1.8.0_111
>
> - Deployed on a single node cluster.
> - Deployed a ViewFS cluster with two hdfs mount points.
> - Performed basic sanity checks.
> - Performed DFS operations(put, ls, mkdir, touch)
>
> Thanks,
> Mukul
>
>
> > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

+1 (binding)

On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com> wrote:

> +1 (non-binding)
>
> I built from source on Mac OS X 10.13.1 Java 1.8.0_111
>
> - Deployed on a single node cluster.
> - Deployed a ViewFS cluster with two hdfs mount points.
> - Performed basic sanity checks.
> - Performed DFS operations(put, ls, mkdir, touch)
>
> Thanks,
> Mukul
>
>
> > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

+1 (binding)

On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com> wrote:

> +1 (non-binding)
>
> I built from source on Mac OS X 10.13.1 Java 1.8.0_111
>
> - Deployed on a single node cluster.
> - Deployed a ViewFS cluster with two hdfs mount points.
> - Performed basic sanity checks.
> - Performed DFS operations(put, ls, mkdir, touch)
>
> Thanks,
> Mukul
>
>
> > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Carlo Aldo Curino <ca...@gmail.com>]

+1 (binding)

On Nov 15, 2017 8:23 AM, "Mukul Kumar Singh" <ms...@hortonworks.com> wrote:

> +1 (non-binding)
>
> I built from source on Mac OS X 10.13.1 Java 1.8.0_111
>
> - Deployed on a single node cluster.
> - Deployed a ViewFS cluster with two hdfs mount points.
> - Performed basic sanity checks.
> - Performed DFS operations(put, ls, mkdir, touch)
>
> Thanks,
> Mukul
>
>
> > On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> >
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Mukul Kumar Singh <ms...@hortonworks.com>]

+1 (non-binding)

I built from source on Mac OS X 10.13.1 Java 1.8.0_111

- Deployed on a single node cluster.
- Deployed a ViewFS cluster with two hdfs mount points.
- Performed basic sanity checks.
- Performed DFS operations(put, ls, mkdir, touch)

Thanks,
Mukul


> On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jonathan Hung <jy...@gmail.com>]

Thanks Arun/Subru for working on this.

+1 (non-binding)
- Deployed RM HA on two nodes
- Tested manual failover
- Tested configuration mutation API with zk and leveldb backing store (also
ensuring configuration updates persisted on failover/restart), with queue
addition/removal/update
- Tested "yarn rmadmin -refreshQueues" enabled when configuration mutation
API disabled (and vice-versa)
- Tested queue admin configuration mutation policy



Jonathan Hung

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantinos Karanasos <kk...@gmail.com>]

+1.

Did the following:
1) set up a 6-node cluster;
2) tried some simple HDFS commands and generated some Gridmix data;
2) ran some Gridmix jobs;
3) ran (2) after enabling opportunistic containers (used a mix of
guaranteed and opportunistic containers for each job);
4) ran (3) but this time enabling distributed scheduling of opportunistic
containers.

All of the above worked with no issues.

Thanks again guys for all the effort!

Konstantinos

On Thu, Nov 16, 2017 at 1:44 PM, Junping Du <jd...@hortonworks.com> wrote:

> I did following verification work:
>
> - build succeed from source
> - verify signature
> - deploy a pseudo cluster and run some simple MR jobs
> - Check HDFS/YARN daemons' UI
> - Verify commit history matching with JIRA's fix version (which will be
> included in site document).
>
> Most works fine, except I found ~200 JIRA are claimed to be included in
> 2.9.0 but actually not show up in commit log for following cases:
> a. commits are missing in 2.9.0
> b. JIRA is marked as resolved but not fixed which shouldn't have fix
> version
> c. JIRA is umbrella which doesn't include particular commits
> d. JIRA commit message is lacking of JIRA number or have wrong number
> e. JIRA commit is included in a whole commit due to branch merge work,
> like ATS v2.
>
> While c,d,e is something we have to live with, but I hope we can enhance
> a. and b. next time.
>
>
> Assume document issue is not a blocker for release, I give my bind +1.
>
>
> Thanks,
>
> Junping
>
> ________________________________________
> From: Arun Suresh <as...@apache.org>
> Sent: Monday, November 13, 2017 4:10 PM
> To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common; Hdfs-dev
> Cc: Subramaniam Krishnan
> Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
-- 
Konstantinos

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantinos Karanasos <kk...@gmail.com>]

+1.

Did the following:
1) set up a 6-node cluster;
2) tried some simple HDFS commands and generated some Gridmix data;
2) ran some Gridmix jobs;
3) ran (2) after enabling opportunistic containers (used a mix of
guaranteed and opportunistic containers for each job);
4) ran (3) but this time enabling distributed scheduling of opportunistic
containers.

All of the above worked with no issues.

Thanks again guys for all the effort!

Konstantinos

On Thu, Nov 16, 2017 at 1:44 PM, Junping Du <jd...@hortonworks.com> wrote:

> I did following verification work:
>
> - build succeed from source
> - verify signature
> - deploy a pseudo cluster and run some simple MR jobs
> - Check HDFS/YARN daemons' UI
> - Verify commit history matching with JIRA's fix version (which will be
> included in site document).
>
> Most works fine, except I found ~200 JIRA are claimed to be included in
> 2.9.0 but actually not show up in commit log for following cases:
> a. commits are missing in 2.9.0
> b. JIRA is marked as resolved but not fixed which shouldn't have fix
> version
> c. JIRA is umbrella which doesn't include particular commits
> d. JIRA commit message is lacking of JIRA number or have wrong number
> e. JIRA commit is included in a whole commit due to branch merge work,
> like ATS v2.
>
> While c,d,e is something we have to live with, but I hope we can enhance
> a. and b. next time.
>
>
> Assume document issue is not a blocker for release, I give my bind +1.
>
>
> Thanks,
>
> Junping
>
> ________________________________________
> From: Arun Suresh <as...@apache.org>
> Sent: Monday, November 13, 2017 4:10 PM
> To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common; Hdfs-dev
> Cc: Subramaniam Krishnan
> Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
-- 
Konstantinos

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantinos Karanasos <kk...@gmail.com>]

+1.

Did the following:
1) set up a 6-node cluster;
2) tried some simple HDFS commands and generated some Gridmix data;
2) ran some Gridmix jobs;
3) ran (2) after enabling opportunistic containers (used a mix of
guaranteed and opportunistic containers for each job);
4) ran (3) but this time enabling distributed scheduling of opportunistic
containers.

All of the above worked with no issues.

Thanks again guys for all the effort!

Konstantinos

On Thu, Nov 16, 2017 at 1:44 PM, Junping Du <jd...@hortonworks.com> wrote:

> I did following verification work:
>
> - build succeed from source
> - verify signature
> - deploy a pseudo cluster and run some simple MR jobs
> - Check HDFS/YARN daemons' UI
> - Verify commit history matching with JIRA's fix version (which will be
> included in site document).
>
> Most works fine, except I found ~200 JIRA are claimed to be included in
> 2.9.0 but actually not show up in commit log for following cases:
> a. commits are missing in 2.9.0
> b. JIRA is marked as resolved but not fixed which shouldn't have fix
> version
> c. JIRA is umbrella which doesn't include particular commits
> d. JIRA commit message is lacking of JIRA number or have wrong number
> e. JIRA commit is included in a whole commit due to branch merge work,
> like ATS v2.
>
> While c,d,e is something we have to live with, but I hope we can enhance
> a. and b. next time.
>
>
> Assume document issue is not a blocker for release, I give my bind +1.
>
>
> Thanks,
>
> Junping
>
> ________________________________________
> From: Arun Suresh <as...@apache.org>
> Sent: Monday, November 13, 2017 4:10 PM
> To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common; Hdfs-dev
> Cc: Subramaniam Krishnan
> Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
-- 
Konstantinos

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Konstantinos Karanasos <kk...@gmail.com>]

+1.

Did the following:
1) set up a 6-node cluster;
2) tried some simple HDFS commands and generated some Gridmix data;
2) ran some Gridmix jobs;
3) ran (2) after enabling opportunistic containers (used a mix of
guaranteed and opportunistic containers for each job);
4) ran (3) but this time enabling distributed scheduling of opportunistic
containers.

All of the above worked with no issues.

Thanks again guys for all the effort!

Konstantinos

On Thu, Nov 16, 2017 at 1:44 PM, Junping Du <jd...@hortonworks.com> wrote:

> I did following verification work:
>
> - build succeed from source
> - verify signature
> - deploy a pseudo cluster and run some simple MR jobs
> - Check HDFS/YARN daemons' UI
> - Verify commit history matching with JIRA's fix version (which will be
> included in site document).
>
> Most works fine, except I found ~200 JIRA are claimed to be included in
> 2.9.0 but actually not show up in commit log for following cases:
> a. commits are missing in 2.9.0
> b. JIRA is marked as resolved but not fixed which shouldn't have fix
> version
> c. JIRA is umbrella which doesn't include particular commits
> d. JIRA commit message is lacking of JIRA number or have wrong number
> e. JIRA commit is included in a whole commit due to branch merge work,
> like ATS v2.
>
> While c,d,e is something we have to live with, but I hope we can enhance
> a. and b. next time.
>
>
> Assume document issue is not a blocker for release, I give my bind +1.
>
>
> Thanks,
>
> Junping
>
> ________________________________________
> From: Arun Suresh <as...@apache.org>
> Sent: Monday, November 13, 2017 4:10 PM
> To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop
> Common; Hdfs-dev
> Cc: Subramaniam Krishnan
> Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
>
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
-- 
Konstantinos

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Junping Du <jd...@hortonworks.com>]

I did following verification work:

- build succeed from source
- verify signature
- deploy a pseudo cluster and run some simple MR jobs
- Check HDFS/YARN daemons' UI
- Verify commit history matching with JIRA's fix version (which will be included in site document).

Most works fine, except I found ~200 JIRA are claimed to be included in 2.9.0 but actually not show up in commit log for following cases:
a. commits are missing in 2.9.0
b. JIRA is marked as resolved but not fixed which shouldn't have fix version
c. JIRA is umbrella which doesn't include particular commits
d. JIRA commit message is lacking of JIRA number or have wrong number
e. JIRA commit is included in a whole commit due to branch merge work, like ATS v2.

While c,d,e is something we have to live with, but I hope we can enhance a. and b. next time.


Assume document issue is not a blocker for release, I give my bind +1.


Thanks,

Junping

________________________________________
From: Arun Suresh <as...@apache.org>
Sent: Monday, November 13, 2017 4:10 PM
To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common; Hdfs-dev
Cc: Subramaniam Krishnan
Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Junping Du <jd...@hortonworks.com>]

I did following verification work:

- build succeed from source
- verify signature
- deploy a pseudo cluster and run some simple MR jobs
- Check HDFS/YARN daemons' UI
- Verify commit history matching with JIRA's fix version (which will be included in site document).

Most works fine, except I found ~200 JIRA are claimed to be included in 2.9.0 but actually not show up in commit log for following cases:
a. commits are missing in 2.9.0
b. JIRA is marked as resolved but not fixed which shouldn't have fix version
c. JIRA is umbrella which doesn't include particular commits
d. JIRA commit message is lacking of JIRA number or have wrong number
e. JIRA commit is included in a whole commit due to branch merge work, like ATS v2.

While c,d,e is something we have to live with, but I hope we can enhance a. and b. next time.


Assume document issue is not a blocker for release, I give my bind +1.


Thanks,

Junping

________________________________________
From: Arun Suresh <as...@apache.org>
Sent: Monday, November 13, 2017 4:10 PM
To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common; Hdfs-dev
Cc: Subramaniam Krishnan
Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Varun Saxena <vs...@gmail.com>]

 +1.

Built from source.

- Deployed a 2-node non-secure cluster.
- Ran a few sample MR jobs with ATSv2 enabled. Also verified job submission
across RM and NM restarts.
- Tested ATSv2 with HBase as backend.Checked few of the REST endpoints.
- Verified new YARN UI and accessed a few pages.

Regards,
Varun.

On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Brahma Reddy Battula <br...@apache.org>]

+1 ( non-binding)

-Built from the source
-Installed 3 Node HA cluster and a pseudo cluster
-Verified through hdfs shell commands
-Verified HDFS router federation
-Ran sample jobs like pi,Slive



--Brahma Reddy


On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>



-- 



--Brahma Reddy Battula

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Sunil G <su...@apache.org>]

+1 (binding)

Built from source.



   - Tested few cases in an HA cluster and tried to do failover by using
   rmadmin commands etc. This seems works fine including submitting apps.
   - I also tested many MR apps and all are running fine w/o any issues.
   - Majorly tested below feature sanity too (works fine)
      - Application priority
      - Application timeout
   - Tested basic NodeLabel scenarios.
      - Added some labels to couple of nodes
      - Verified old UI for labels
      - Submitted apps to labelled cluster and it works fine.
      - Also performed few cli commands related to nodelabel
   - Verified new YARN UI and accessed various pages when cluster was in
   use. It seems fine to me.

- Sunil


On Tue, Nov 14, 2017 at 5:40 AM Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Varun Saxena <vs...@gmail.com>]

 +1.

Built from source.

- Deployed a 2-node non-secure cluster.
- Ran a few sample MR jobs with ATSv2 enabled. Also verified job submission
across RM and NM restarts.
- Tested ATSv2 with HBase as backend.Checked few of the REST endpoints.
- Verified new YARN UI and accessed a few pages.

Regards,
Varun.

On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Junping Du <jd...@hortonworks.com>]

I did following verification work:

- build succeed from source
- verify signature
- deploy a pseudo cluster and run some simple MR jobs
- Check HDFS/YARN daemons' UI
- Verify commit history matching with JIRA's fix version (which will be included in site document).

Most works fine, except I found ~200 JIRA are claimed to be included in 2.9.0 but actually not show up in commit log for following cases:
a. commits are missing in 2.9.0
b. JIRA is marked as resolved but not fixed which shouldn't have fix version
c. JIRA is umbrella which doesn't include particular commits
d. JIRA commit message is lacking of JIRA number or have wrong number
e. JIRA commit is included in a whole commit due to branch merge work, like ATS v2.

While c,d,e is something we have to live with, but I hope we can enhance a. and b. next time.


Assume document issue is not a blocker for release, I give my bind +1.


Thanks,

Junping

________________________________________
From: Arun Suresh <as...@apache.org>
Sent: Monday, November 13, 2017 4:10 PM
To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common; Hdfs-dev
Cc: Subramaniam Krishnan
Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jonathan Hung <jy...@gmail.com>]

Thanks Arun/Subru for working on this.

+1 (non-binding)
- Deployed RM HA on two nodes
- Tested manual failover
- Tested configuration mutation API with zk and leveldb backing store (also
ensuring configuration updates persisted on failover/restart), with queue
addition/removal/update
- Tested "yarn rmadmin -refreshQueues" enabled when configuration mutation
API disabled (and vice-versa)
- Tested queue admin configuration mutation policy



Jonathan Hung

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jonathan Hung <jy...@gmail.com>]

Thanks Arun/Subru for working on this.

+1 (non-binding)
- Deployed RM HA on two nodes
- Tested manual failover
- Tested configuration mutation API with zk and leveldb backing store (also
ensuring configuration updates persisted on failover/restart), with queue
addition/removal/update
- Tested "yarn rmadmin -refreshQueues" enabled when configuration mutation
API disabled (and vice-versa)
- Tested queue admin configuration mutation policy



Jonathan Hung

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Steve Loughran <st...@hortonworks.com>]

On 14 Nov 2017, at 00:10, Arun Suresh <as...@apache.org>> wrote:

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org<http://repository.apache.org> at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru

I hadn't finished my testing yet; I'd been assuming that it was 5 days from thw new RC. I believe every RC should (must?) still have that 5 day test period. I have done all my core tests, but haven't done the final tests of the S3Guard CLI tests. I did have to actually put in an afternoon making my spark cloud integration tests work against branch-2, so it wasn't like I could just D/L and test in half an hour


As it was, I had filed one minor bug, but didnt' consider that an issue as it was only with the new  FileSystem.create(path)" Builder. I was going to go vote +! unless those CLI tests were completly broken.


What I do want is  release notes to highlight which things we think unstable/experimental features to use with caution

  1.  Filesystem.create(Path)
  2.  S3Guard
  3.  AlyiunOSS (it hasn't been out long enough to be trusted)

We ourselves know what's still stabilising, other should too


Download:

D/L tar file, & .asc, check signature

pg2 --verify hadoop-2.9.0.tar.gz.asc
gpg: assuming signed data in 'hadoop-2.9.0.tar.gz'
gpg: Signature made Mon 13 Nov 23:45:49 2017 GMT
gpg:                using RSA key 0x7ECDEEEA64ECB6E6
gpg: Good signature from "Arun Suresh <as...@apache.org>>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 412B BFB1 27CB 48DA 6BA2  E3EE 7ECD EEEA 64EC B6E6


This is a valid signature; Arun is listed in KEYS. He's not trusted though: at the time of checking his public key hadn't been signed by anyone I trust
 though it shows we need more cross-trust between them. (Since then Andrew Wang has authenticated him, so he is now transitively trusted).


Downstream build

Clean build of Spark through the staged artifacts (must remember to rm the local copies when the release ships). This verifies artifacts and source code compatibility.

mvn clean install -Pyarn,hadoop-2.7,hadoop-cloud,snapshots-and-staging  -Dhadoop.version=2.9.0

Everything compiled fine. I did not do a full test run; I didn't have the time and without knowing whether everything worked locally on the 2.8.1 release, could have been a distraction on a failure.


Downstream tests:

Ran all my spark cloud integration tests: s3 (S3 ireland + S3Guard) , azure (Azure ireland(, swift (RAX US);

https://github.com/hortonworks-spark/cloud-integration/tree/branch-2

there were 3 failures of SparkSQL & ORC in test setup, but I think that's related to the latest spark code & my injected-into-org.apache.spark-namespace tests; they're a bit brittle to changes in spark-master.

All the work used the "legacy" FileOutputCommitter; with s3guard turned on. This delivers the consistency needed for Job and task commit to be correct, though without the performance needed for it to be usable in production. That's dependent on HADOOP-13786, which I don't propose to backport. (it loves its Java 8 & targets 3.1)


hadoop cloud module object store tests

Checked out the relevant git commit & did a local run of hadoop-aws, hadoop-azure and hadoop-openstack


hadoop-amazon
* s3a happy, including s3guard
* All the s3n & s3:// tests skipped/failed because I didn't have the test bindings for those set up: untested.

Azure wasb: happy; one transient failure which

ADLs: Not set up test this
OSS: not set up to test this

Swift:

Found one test failure due to swift not supporting FileSystem.createNonRecursive(); this means the new builder based FileSystem.create(Path) mechanism doesn't work for it. Nothing that serious, given its an experimental API, but it does show that we are undertesting this stuff.

https://issues.apache.org/jira/browse/HADOOP-15050

Note: the swift tests I ran downstream with spark did work. This is only the new API call which fails.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Steve Loughran <st...@hortonworks.com>]

On 14 Nov 2017, at 00:10, Arun Suresh <as...@apache.org>> wrote:

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org<http://repository.apache.org> at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru

I hadn't finished my testing yet; I'd been assuming that it was 5 days from thw new RC. I believe every RC should (must?) still have that 5 day test period. I have done all my core tests, but haven't done the final tests of the S3Guard CLI tests. I did have to actually put in an afternoon making my spark cloud integration tests work against branch-2, so it wasn't like I could just D/L and test in half an hour


As it was, I had filed one minor bug, but didnt' consider that an issue as it was only with the new  FileSystem.create(path)" Builder. I was going to go vote +! unless those CLI tests were completly broken.


What I do want is  release notes to highlight which things we think unstable/experimental features to use with caution

  1.  Filesystem.create(Path)
  2.  S3Guard
  3.  AlyiunOSS (it hasn't been out long enough to be trusted)

We ourselves know what's still stabilising, other should too


Download:

D/L tar file, & .asc, check signature

pg2 --verify hadoop-2.9.0.tar.gz.asc
gpg: assuming signed data in 'hadoop-2.9.0.tar.gz'
gpg: Signature made Mon 13 Nov 23:45:49 2017 GMT
gpg:                using RSA key 0x7ECDEEEA64ECB6E6
gpg: Good signature from "Arun Suresh <as...@apache.org>>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 412B BFB1 27CB 48DA 6BA2  E3EE 7ECD EEEA 64EC B6E6


This is a valid signature; Arun is listed in KEYS. He's not trusted though: at the time of checking his public key hadn't been signed by anyone I trust
 though it shows we need more cross-trust between them. (Since then Andrew Wang has authenticated him, so he is now transitively trusted).


Downstream build

Clean build of Spark through the staged artifacts (must remember to rm the local copies when the release ships). This verifies artifacts and source code compatibility.

mvn clean install -Pyarn,hadoop-2.7,hadoop-cloud,snapshots-and-staging  -Dhadoop.version=2.9.0

Everything compiled fine. I did not do a full test run; I didn't have the time and without knowing whether everything worked locally on the 2.8.1 release, could have been a distraction on a failure.


Downstream tests:

Ran all my spark cloud integration tests: s3 (S3 ireland + S3Guard) , azure (Azure ireland(, swift (RAX US);

https://github.com/hortonworks-spark/cloud-integration/tree/branch-2

there were 3 failures of SparkSQL & ORC in test setup, but I think that's related to the latest spark code & my injected-into-org.apache.spark-namespace tests; they're a bit brittle to changes in spark-master.

All the work used the "legacy" FileOutputCommitter; with s3guard turned on. This delivers the consistency needed for Job and task commit to be correct, though without the performance needed for it to be usable in production. That's dependent on HADOOP-13786, which I don't propose to backport. (it loves its Java 8 & targets 3.1)


hadoop cloud module object store tests

Checked out the relevant git commit & did a local run of hadoop-aws, hadoop-azure and hadoop-openstack


hadoop-amazon
* s3a happy, including s3guard
* All the s3n & s3:// tests skipped/failed because I didn't have the test bindings for those set up: untested.

Azure wasb: happy; one transient failure which

ADLs: Not set up test this
OSS: not set up to test this

Swift:

Found one test failure due to swift not supporting FileSystem.createNonRecursive(); this means the new builder based FileSystem.create(Path) mechanism doesn't work for it. Nothing that serious, given its an experimental API, but it does show that we are undertesting this stuff.

https://issues.apache.org/jira/browse/HADOOP-15050

Note: the swift tests I ran downstream with spark did work. This is only the new API call which fails.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <as...@apache.org>]

+1 (binding)

* Built from source
* Set up a 4 node cluster with RM HA enabled
* Performed some basic HDFS commands
* Ran a bunch of pi & sleep jobs - with and without opportunistic containers
* Performed some basic RM failover testing.

Cheers
-Arun

On Thu, Nov 16, 2017 at 11:12 PM, Akira Ajisaka <aa...@apache.org> wrote:

> +1
>
> * Downloaded source tarball and verified checksum and signature
> * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
> * Deployed a pseudo cluster and ran some simple MR jobs
>
> I noticed ISA-L build options are documented in BUILDING.txt
> but the options do not exist in 2.x releases.
> Filed HADOOP-15045 to fix this issue.
> I think this issue doesn't block the release.
>
> Thanks and regards,
> Akira
>
> On 2017/11/14 9:10, Arun Suresh wrote:
>
>> Hi Folks,
>>
>> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
>> the
>> starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> Features
>> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
>> 2.8.2.
>>
>> More information about the 2.9.0 release plan can be found here:
>> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9
>> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9>*
>>
>> New RC is available at: *https://home.apache.org/~asur
>> esh/hadoop-2.9.0-RC3/
>> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>>
>> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>>
>> The maven artifacts are available via repository.apache.org at:
>> <https://www.google.com/url?q=https%3A%2F%2Frepository.apach
>> e.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&s
>> ntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://reposi
>> tory.apache.org/content/repositories/orgapachehadoop-1068/
>> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
>> >*
>>
>> We are carrying over the votes from the previous RC given that the delta
>> is
>> the license fix.
>>
>> Given the above - we are also going to stick with the original deadline
>> for
>> the vote : ending on Friday 17th November 2017 2pm PT time.
>>
>> Thanks,
>> -Arun/Subru
>>
>>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <as...@apache.org>]

+1 (binding)

* Built from source
* Set up a 4 node cluster with RM HA enabled
* Performed some basic HDFS commands
* Ran a bunch of pi & sleep jobs - with and without opportunistic containers
* Performed some basic RM failover testing.

Cheers
-Arun

On Thu, Nov 16, 2017 at 11:12 PM, Akira Ajisaka <aa...@apache.org> wrote:

> +1
>
> * Downloaded source tarball and verified checksum and signature
> * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
> * Deployed a pseudo cluster and ran some simple MR jobs
>
> I noticed ISA-L build options are documented in BUILDING.txt
> but the options do not exist in 2.x releases.
> Filed HADOOP-15045 to fix this issue.
> I think this issue doesn't block the release.
>
> Thanks and regards,
> Akira
>
> On 2017/11/14 9:10, Arun Suresh wrote:
>
>> Hi Folks,
>>
>> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
>> the
>> starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> Features
>> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
>> 2.8.2.
>>
>> More information about the 2.9.0 release plan can be found here:
>> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9
>> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9>*
>>
>> New RC is available at: *https://home.apache.org/~asur
>> esh/hadoop-2.9.0-RC3/
>> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>>
>> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>>
>> The maven artifacts are available via repository.apache.org at:
>> <https://www.google.com/url?q=https%3A%2F%2Frepository.apach
>> e.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&s
>> ntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://reposi
>> tory.apache.org/content/repositories/orgapachehadoop-1068/
>> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
>> >*
>>
>> We are carrying over the votes from the previous RC given that the delta
>> is
>> the license fix.
>>
>> Given the above - we are also going to stick with the original deadline
>> for
>> the vote : ending on Friday 17th November 2017 2pm PT time.
>>
>> Thanks,
>> -Arun/Subru
>>
>>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <as...@apache.org>]

+1 (binding)

* Built from source
* Set up a 4 node cluster with RM HA enabled
* Performed some basic HDFS commands
* Ran a bunch of pi & sleep jobs - with and without opportunistic containers
* Performed some basic RM failover testing.

Cheers
-Arun

On Thu, Nov 16, 2017 at 11:12 PM, Akira Ajisaka <aa...@apache.org> wrote:

> +1
>
> * Downloaded source tarball and verified checksum and signature
> * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
> * Deployed a pseudo cluster and ran some simple MR jobs
>
> I noticed ISA-L build options are documented in BUILDING.txt
> but the options do not exist in 2.x releases.
> Filed HADOOP-15045 to fix this issue.
> I think this issue doesn't block the release.
>
> Thanks and regards,
> Akira
>
> On 2017/11/14 9:10, Arun Suresh wrote:
>
>> Hi Folks,
>>
>> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
>> the
>> starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> Features
>> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
>> 2.8.2.
>>
>> More information about the 2.9.0 release plan can be found here:
>> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9
>> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9>*
>>
>> New RC is available at: *https://home.apache.org/~asur
>> esh/hadoop-2.9.0-RC3/
>> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>>
>> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>>
>> The maven artifacts are available via repository.apache.org at:
>> <https://www.google.com/url?q=https%3A%2F%2Frepository.apach
>> e.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&s
>> ntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://reposi
>> tory.apache.org/content/repositories/orgapachehadoop-1068/
>> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
>> >*
>>
>> We are carrying over the votes from the previous RC given that the delta
>> is
>> the license fix.
>>
>> Given the above - we are also going to stick with the original deadline
>> for
>> the vote : ending on Friday 17th November 2017 2pm PT time.
>>
>> Thanks,
>> -Arun/Subru
>>
>>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Arun Suresh <as...@apache.org>]

+1 (binding)

* Built from source
* Set up a 4 node cluster with RM HA enabled
* Performed some basic HDFS commands
* Ran a bunch of pi & sleep jobs - with and without opportunistic containers
* Performed some basic RM failover testing.

Cheers
-Arun

On Thu, Nov 16, 2017 at 11:12 PM, Akira Ajisaka <aa...@apache.org> wrote:

> +1
>
> * Downloaded source tarball and verified checksum and signature
> * Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
> * Deployed a pseudo cluster and ran some simple MR jobs
>
> I noticed ISA-L build options are documented in BUILDING.txt
> but the options do not exist in 2.x releases.
> Filed HADOOP-15045 to fix this issue.
> I think this issue doesn't block the release.
>
> Thanks and regards,
> Akira
>
> On 2017/11/14 9:10, Arun Suresh wrote:
>
>> Hi Folks,
>>
>> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
>> the
>> starting release for Apache Hadoop 2.9.x line - it includes 30 New
>> Features
>> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
>> 2.8.2.
>>
>> More information about the 2.9.0 release plan can be found here:
>> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9
>> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#
>> Roadmap-Version2.9>*
>>
>> New RC is available at: *https://home.apache.org/~asur
>> esh/hadoop-2.9.0-RC3/
>> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>>
>> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
>> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>>
>> The maven artifacts are available via repository.apache.org at:
>> <https://www.google.com/url?q=https%3A%2F%2Frepository.apach
>> e.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&s
>> ntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://reposi
>> tory.apache.org/content/repositories/orgapachehadoop-1068/
>> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
>> >*
>>
>> We are carrying over the votes from the previous RC given that the delta
>> is
>> the license fix.
>>
>> Given the above - we are also going to stick with the original deadline
>> for
>> the vote : ending on Friday 17th November 2017 2pm PT time.
>>
>> Thanks,
>> -Arun/Subru
>>
>>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Akira Ajisaka <aa...@apache.org>]

+1

* Downloaded source tarball and verified checksum and signature
* Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
* Deployed a pseudo cluster and ran some simple MR jobs

I noticed ISA-L build options are documented in BUILDING.txt
but the options do not exist in 2.x releases.
Filed HADOOP-15045 to fix this issue.
I think this issue doesn't block the release.

Thanks and regards,
Akira

On 2017/11/14 9:10, Arun Suresh wrote:
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Akira Ajisaka <aa...@apache.org>]

+1

* Downloaded source tarball and verified checksum and signature
* Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
* Deployed a pseudo cluster and ran some simple MR jobs

I noticed ISA-L build options are documented in BUILDING.txt
but the options do not exist in 2.x releases.
Filed HADOOP-15045 to fix this issue.
I think this issue doesn't block the release.

Thanks and regards,
Akira

On 2017/11/14 9:10, Arun Suresh wrote:
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Iñigo Goiri <el...@gmail.com>]

+1 (non-binding)

Deployed in a cluster with 48 nodes and 8 subclusters:

   - YARN federation
   - HDFS Router-based federation
   - Yarn UI 2

Executed a few Pi job using both HDFS and YARN federation.
Everything worked correctly.
The YARN UI 2 showed the jobs, etc.

On Wed, Nov 15, 2017 at 2:05 PM, Chris Douglas <cd...@apache.org> wrote:

> +1 (binding)
>
> Verified source tarball. Checksum and signature match, built from
> source, ran some unit tests. Skimmed NOTICE/LICENSE. -C
>
> On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Iñigo Goiri <el...@gmail.com>]

+1 (non-binding)

Deployed in a cluster with 48 nodes and 8 subclusters:

   - YARN federation
   - HDFS Router-based federation
   - Yarn UI 2

Executed a few Pi job using both HDFS and YARN federation.
Everything worked correctly.
The YARN UI 2 showed the jobs, etc.

On Wed, Nov 15, 2017 at 2:05 PM, Chris Douglas <cd...@apache.org> wrote:

> +1 (binding)
>
> Verified source tarball. Checksum and signature match, built from
> source, ran some unit tests. Skimmed NOTICE/LICENSE. -C
>
> On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Iñigo Goiri <el...@gmail.com>]

+1 (non-binding)

Deployed in a cluster with 48 nodes and 8 subclusters:

   - YARN federation
   - HDFS Router-based federation
   - Yarn UI 2

Executed a few Pi job using both HDFS and YARN federation.
Everything worked correctly.
The YARN UI 2 showed the jobs, etc.

On Wed, Nov 15, 2017 at 2:05 PM, Chris Douglas <cd...@apache.org> wrote:

> +1 (binding)
>
> Verified source tarball. Checksum and signature match, built from
> source, ran some unit tests. Skimmed NOTICE/LICENSE. -C
>
> On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Iñigo Goiri <el...@gmail.com>]

+1 (non-binding)

Deployed in a cluster with 48 nodes and 8 subclusters:

   - YARN federation
   - HDFS Router-based federation
   - Yarn UI 2

Executed a few Pi job using both HDFS and YARN federation.
Everything worked correctly.
The YARN UI 2 showed the jobs, etc.

On Wed, Nov 15, 2017 at 2:05 PM, Chris Douglas <cd...@apache.org> wrote:

> +1 (binding)
>
> Verified source tarball. Checksum and signature match, built from
> source, ran some unit tests. Skimmed NOTICE/LICENSE. -C
>
> On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> > Hi Folks,
> >
> > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be
> the
> > starting release for Apache Hadoop 2.9.x line - it includes 30 New
> Features
> > with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues
> since
> > 2.8.2.
> >
> > More information about the 2.9.0 release plan can be found here:
> > *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> > <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
> >
> > New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> > <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> >
> > The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> > 756ebc8394e473ac25feac05fa493f6d612e6c50.
> >
> > The maven artifacts are available via repository.apache.org at:
> > <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> > <https://repository.apache.org/content/repositories/
> orgapachehadoop-1068/>*
> >
> > We are carrying over the votes from the previous RC given that the delta
> is
> > the license fix.
> >
> > Given the above - we are also going to stick with the original deadline
> for
> > the vote : ending on Friday 17th November 2017 2pm PT time.
> >
> > Thanks,
> > -Arun/Subru
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Chris Douglas <cd...@apache.org>]

+1 (binding)

Verified source tarball. Checksum and signature match, built from
source, ran some unit tests. Skimmed NOTICE/LICENSE. -C

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Rohith Sharma K S <ro...@apache.org>]

+1(binding)

* Downloaded source and verified for checksum. Built from source and
deployed RM HA Non-Secure cluster along with Atsv2 and yarn-ui enabled!
* Tested for
          ** RM HA/Restart/Work-preserving restart and NM work preserving
restart scenarios
          ** Application priority and Application Timeout features are
verified
          ** Ran sample MR and Distributed jobs to test HA/work-preserving
restart scenarios/priority/lifetime features
          ** Verified for ATSv2 data using REST queries.
          ** Accessed new yarn-ui for data validations. All the pages and
links are verified.
* Also integrated JCarder tool to verify all above cases to ensure no
deadlock cycles are found in basic scenarios.

-Rohith Sharma K S

On 14 November 2017 at 05:40, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Sunil G <su...@apache.org>]

+1 (binding)

Built from source.



   - Tested few cases in an HA cluster and tried to do failover by using
   rmadmin commands etc. This seems works fine including submitting apps.
   - I also tested many MR apps and all are running fine w/o any issues.
   - Majorly tested below feature sanity too (works fine)
      - Application priority
      - Application timeout
   - Tested basic NodeLabel scenarios.
      - Added some labels to couple of nodes
      - Verified old UI for labels
      - Submitted apps to labelled cluster and it works fine.
      - Also performed few cli commands related to nodelabel
   - Verified new YARN UI and accessed various pages when cluster was in
   use. It seems fine to me.

- Sunil


On Tue, Nov 14, 2017 at 5:40 AM Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Steve Loughran <st...@hortonworks.com>]

On 14 Nov 2017, at 00:10, Arun Suresh <as...@apache.org>> wrote:

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org<http://repository.apache.org> at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru

I hadn't finished my testing yet; I'd been assuming that it was 5 days from thw new RC. I believe every RC should (must?) still have that 5 day test period. I have done all my core tests, but haven't done the final tests of the S3Guard CLI tests. I did have to actually put in an afternoon making my spark cloud integration tests work against branch-2, so it wasn't like I could just D/L and test in half an hour


As it was, I had filed one minor bug, but didnt' consider that an issue as it was only with the new  FileSystem.create(path)" Builder. I was going to go vote +! unless those CLI tests were completly broken.


What I do want is  release notes to highlight which things we think unstable/experimental features to use with caution

  1.  Filesystem.create(Path)
  2.  S3Guard
  3.  AlyiunOSS (it hasn't been out long enough to be trusted)

We ourselves know what's still stabilising, other should too


Download:

D/L tar file, & .asc, check signature

pg2 --verify hadoop-2.9.0.tar.gz.asc
gpg: assuming signed data in 'hadoop-2.9.0.tar.gz'
gpg: Signature made Mon 13 Nov 23:45:49 2017 GMT
gpg:                using RSA key 0x7ECDEEEA64ECB6E6
gpg: Good signature from "Arun Suresh <as...@apache.org>>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 412B BFB1 27CB 48DA 6BA2  E3EE 7ECD EEEA 64EC B6E6


This is a valid signature; Arun is listed in KEYS. He's not trusted though: at the time of checking his public key hadn't been signed by anyone I trust
 though it shows we need more cross-trust between them. (Since then Andrew Wang has authenticated him, so he is now transitively trusted).


Downstream build

Clean build of Spark through the staged artifacts (must remember to rm the local copies when the release ships). This verifies artifacts and source code compatibility.

mvn clean install -Pyarn,hadoop-2.7,hadoop-cloud,snapshots-and-staging  -Dhadoop.version=2.9.0

Everything compiled fine. I did not do a full test run; I didn't have the time and without knowing whether everything worked locally on the 2.8.1 release, could have been a distraction on a failure.


Downstream tests:

Ran all my spark cloud integration tests: s3 (S3 ireland + S3Guard) , azure (Azure ireland(, swift (RAX US);

https://github.com/hortonworks-spark/cloud-integration/tree/branch-2

there were 3 failures of SparkSQL & ORC in test setup, but I think that's related to the latest spark code & my injected-into-org.apache.spark-namespace tests; they're a bit brittle to changes in spark-master.

All the work used the "legacy" FileOutputCommitter; with s3guard turned on. This delivers the consistency needed for Job and task commit to be correct, though without the performance needed for it to be usable in production. That's dependent on HADOOP-13786, which I don't propose to backport. (it loves its Java 8 & targets 3.1)


hadoop cloud module object store tests

Checked out the relevant git commit & did a local run of hadoop-aws, hadoop-azure and hadoop-openstack


hadoop-amazon
* s3a happy, including s3guard
* All the s3n & s3:// tests skipped/failed because I didn't have the test bindings for those set up: untested.

Azure wasb: happy; one transient failure which

ADLs: Not set up test this
OSS: not set up to test this

Swift:

Found one test failure due to swift not supporting FileSystem.createNonRecursive(); this means the new builder based FileSystem.create(Path) mechanism doesn't work for it. Nothing that serious, given its an experimental API, but it does show that we are undertesting this stuff.

https://issues.apache.org/jira/browse/HADOOP-15050

Note: the swift tests I ran downstream with spark did work. This is only the new API call which fails.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Akira Ajisaka <aa...@apache.org>]

+1

* Downloaded source tarball and verified checksum and signature
* Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
* Deployed a pseudo cluster and ran some simple MR jobs

I noticed ISA-L build options are documented in BUILDING.txt
but the options do not exist in 2.x releases.
Filed HADOOP-15045 to fix this issue.
I think this issue doesn't block the release.

Thanks and regards,
Akira

On 2017/11/14 9:10, Arun Suresh wrote:
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Junping Du <jd...@hortonworks.com>]

I did following verification work:

- build succeed from source
- verify signature
- deploy a pseudo cluster and run some simple MR jobs
- Check HDFS/YARN daemons' UI
- Verify commit history matching with JIRA's fix version (which will be included in site document).

Most works fine, except I found ~200 JIRA are claimed to be included in 2.9.0 but actually not show up in commit log for following cases:
a. commits are missing in 2.9.0
b. JIRA is marked as resolved but not fixed which shouldn't have fix version
c. JIRA is umbrella which doesn't include particular commits
d. JIRA commit message is lacking of JIRA number or have wrong number
e. JIRA commit is included in a whole commit due to branch merge work, like ATS v2.

While c,d,e is something we have to live with, but I hope we can enhance a. and b. next time.


Assume document issue is not a blocker for release, I give my bind +1.


Thanks,

Junping

________________________________________
From: Arun Suresh <as...@apache.org>
Sent: Monday, November 13, 2017 4:10 PM
To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common; Hdfs-dev
Cc: Subramaniam Krishnan
Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Sunil G <su...@apache.org>]

+1 (binding)

Built from source.



   - Tested few cases in an HA cluster and tried to do failover by using
   rmadmin commands etc. This seems works fine including submitting apps.
   - I also tested many MR apps and all are running fine w/o any issues.
   - Majorly tested below feature sanity too (works fine)
      - Application priority
      - Application timeout
   - Tested basic NodeLabel scenarios.
      - Added some labels to couple of nodes
      - Verified old UI for labels
      - Submitted apps to labelled cluster and it works fine.
      - Also performed few cli commands related to nodelabel
   - Verified new YARN UI and accessed various pages when cluster was in
   use. It seems fine to me.

- Sunil


On Tue, Nov 14, 2017 at 5:40 AM Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <
> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> >*
>
> New RC is available at: *
> https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <
> https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg
> >*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jason Lowe <jl...@oath.com.INVALID>]

Thanks for putting this release together!

+1 (binding)

- Verified signatures and digests
- Successfully built from source including native
- Deployed to single-node cluster and ran some test jobs

Jason


On Mon, Nov 13, 2017 at 6:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Payne <er...@yahoo.com.INVALID>]

Thanks Arun and Subru for the hard work on this release.

+1 (binding)

Built from source and stood up a pseudo cluster with 4 NMs
Tested the following:
o User limits are honored during In-queue preemption 

o Priorities are honored during In-queue preemption
o Can kill applications from the command line
o Users with different weights are assigned resources proportional to their weights.
Thanks,-Eric Payne


      From: Arun Suresh <as...@apache.org>
 To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org> 
Cc: Subramaniam Krishnan <su...@apache.org>
 Sent: Monday, November 13, 2017 6:10 PM
 Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
   
Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


   

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jian He <jh...@hortonworks.com>]

+1 (binding)

Built from source code.
Successfully ran jobs and in the meantime tried to restart RM.

Jian

> On Nov 13, 2017, at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Rohith Sharma K S <ro...@apache.org>]

+1(binding)

* Downloaded source and verified for checksum. Built from source and
deployed RM HA Non-Secure cluster along with Atsv2 and yarn-ui enabled!
* Tested for
          ** RM HA/Restart/Work-preserving restart and NM work preserving
restart scenarios
          ** Application priority and Application Timeout features are
verified
          ** Ran sample MR and Distributed jobs to test HA/work-preserving
restart scenarios/priority/lifetime features
          ** Verified for ATSv2 data using REST queries.
          ** Accessed new yarn-ui for data validations. All the pages and
links are verified.
* Also integrated JCarder tool to verify all above cases to ensure no
deadlock cycles are found in basic scenarios.

-Rohith Sharma K S

On 14 November 2017 at 05:40, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jian He <jh...@hortonworks.com>]

+1 (binding)

Built from source code.
Successfully ran jobs and in the meantime tried to restart RM.

Jian

> On Nov 13, 2017, at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jason Lowe <jl...@oath.com.INVALID>]

Thanks for putting this release together!

+1 (binding)

- Verified signatures and digests
- Successfully built from source including native
- Deployed to single-node cluster and ran some test jobs

Jason


On Mon, Nov 13, 2017 at 6:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Chris Douglas <cd...@apache.org>]

+1 (binding)

Verified source tarball. Checksum and signature match, built from
source, ran some unit tests. Skimmed NOTICE/LICENSE. -C

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Chris Douglas <cd...@apache.org>]

+1 (binding)

Verified source tarball. Checksum and signature match, built from
source, ran some unit tests. Skimmed NOTICE/LICENSE. -C

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Brahma Reddy Battula <br...@apache.org>]

+1 ( non-binding)

-Built from the source
-Installed 3 Node HA cluster and a pseudo cluster
-Verified through hdfs shell commands
-Verified HDFS router federation
-Ran sample jobs like pi,Slive



--Brahma Reddy


On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>



-- 



--Brahma Reddy Battula

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jason Lowe <jl...@oath.com.INVALID>]

Thanks for putting this release together!

+1 (binding)

- Verified signatures and digests
- Successfully built from source including native
- Deployed to single-node cluster and ran some test jobs

Jason


On Mon, Nov 13, 2017 at 6:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jian He <jh...@hortonworks.com>]

+1 (binding)

Built from source code.
Successfully ran jobs and in the meantime tried to restart RM.

Jian

> On Nov 13, 2017, at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Brahma Reddy Battula <br...@apache.org>]

+1 ( non-binding)

-Built from the source
-Installed 3 Node HA cluster and a pseudo cluster
-Verified through hdfs shell commands
-Verified HDFS router federation
-Ran sample jobs like pi,Slive



--Brahma Reddy


On Tue, Nov 14, 2017 at 5:40 AM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>



-- 



--Brahma Reddy Battula

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Rohith Sharma K S <ro...@apache.org>]

+1(binding)

* Downloaded source and verified for checksum. Built from source and
deployed RM HA Non-Secure cluster along with Atsv2 and yarn-ui enabled!
* Tested for
          ** RM HA/Restart/Work-preserving restart and NM work preserving
restart scenarios
          ** Application priority and Application Timeout features are
verified
          ** Ran sample MR and Distributed jobs to test HA/work-preserving
restart scenarios/priority/lifetime features
          ** Verified for ATSv2 data using REST queries.
          ** Accessed new yarn-ui for data validations. All the pages and
links are verified.
* Also integrated JCarder tool to verify all above cases to ensure no
deadlock cycles are found in basic scenarios.

-Rohith Sharma K S

On 14 November 2017 at 05:40, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Chris Douglas <cd...@apache.org>]

+1 (binding)

Verified source tarball. Checksum and signature match, built from
source, ran some unit tests. Skimmed NOTICE/LICENSE. -C

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:
> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Rohith Sharma K S <ro...@apache.org>]

+1(binding)

* Downloaded source and verified for checksum. Built from source and
deployed RM HA Non-Secure cluster along with Atsv2 and yarn-ui enabled!
* Tested for
          ** RM HA/Restart/Work-preserving restart and NM work preserving
restart scenarios
          ** Application priority and Application Timeout features are
verified
          ** Ran sample MR and Distributed jobs to test HA/work-preserving
restart scenarios/priority/lifetime features
          ** Verified for ATSv2 data using REST queries.
          ** Accessed new yarn-ui for data validations. All the pages and
links are verified.
* Also integrated JCarder tool to verify all above cases to ensure no
deadlock cycles are found in basic scenarios.

-Rohith Sharma K S

On 14 November 2017 at 05:40, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Jonathan Hung <jy...@gmail.com>]

Thanks Arun/Subru for working on this.

+1 (non-binding)
- Deployed RM HA on two nodes
- Tested manual failover
- Tested configuration mutation API with zk and leveldb backing store (also
ensuring configuration updates persisted on failover/restart), with queue
addition/removal/update
- Tested "yarn rmadmin -refreshQueues" enabled when configuration mutation
API disabled (and vice-versa)
- Tested queue admin configuration mutation policy



Jonathan Hung

On Mon, Nov 13, 2017 at 4:10 PM, Arun Suresh <as...@apache.org> wrote:

> Hi Folks,
>
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
>
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/
> Roadmap#Roadmap-Version2.9>*
>
> New RC is available at: *https://home.apache.org/~
> asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
>
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
>
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.
> apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&
> sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://
> repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> >*
>
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
>
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
>
> Thanks,
> -Arun/Subru
>

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Eric Payne <er...@yahoo.com.INVALID>]

Thanks Arun and Subru for the hard work on this release.

+1 (binding)

Built from source and stood up a pseudo cluster with 4 NMs
Tested the following:
o User limits are honored during In-queue preemption 

o Priorities are honored during In-queue preemption
o Can kill applications from the command line
o Users with different weights are assigned resources proportional to their weights.
Thanks,-Eric Payne


      From: Arun Suresh <as...@apache.org>
 To: yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org; Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org> 
Cc: Subramaniam Krishnan <su...@apache.org>
 Sent: Monday, November 13, 2017 6:10 PM
 Subject: [VOTE] Release Apache Hadoop 2.9.0 (RC3)
   
Hi Folks,

Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
2.8.2.

More information about the 2.9.0 release plan can be found here:
*https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
<https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*

New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
<https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*

The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
756ebc8394e473ac25feac05fa493f6d612e6c50.

The maven artifacts are available via repository.apache.org at:
<https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
<https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*

We are carrying over the votes from the previous RC given that the delta is
the license fix.

Given the above - we are also going to stick with the original deadline for
the vote : ending on Friday 17th November 2017 2pm PT time.

Thanks,
-Arun/Subru


   

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Mukul Kumar Singh <ms...@hortonworks.com>]

+1 (non-binding)

I built from source on Mac OS X 10.13.1 Java 1.8.0_111

- Deployed on a single node cluster.
- Deployed a ViewFS cluster with two hdfs mount points.
- Performed basic sanity checks.
- Performed DFS operations(put, ls, mkdir, touch)

Thanks,
Mukul


> On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Mukul Kumar Singh <ms...@hortonworks.com>]

+1 (non-binding)

I built from source on Mac OS X 10.13.1 Java 1.8.0_111

- Deployed on a single node cluster.
- Deployed a ViewFS cluster with two hdfs mount points.
- Performed basic sanity checks.
- Performed DFS operations(put, ls, mkdir, touch)

Thanks,
Mukul


> On 14-Nov-2017, at 5:40 AM, Arun Suresh <as...@apache.org> wrote:
> 
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru


---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

[Akira Ajisaka <aa...@apache.org>]

+1

* Downloaded source tarball and verified checksum and signature
* Compiled the source with OpenJDK 1.8.0_151 and CentOS 7.4
* Deployed a pseudo cluster and ran some simple MR jobs

I noticed ISA-L build options are documented in BUILDING.txt
but the options do not exist in 2.x releases.
Filed HADOOP-15045 to fix this issue.
I think this issue doesn't block the release.

Thanks and regards,
Akira

On 2017/11/14 9:10, Arun Suresh wrote:
> Hi Folks,
> 
> Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the
> starting release for Apache Hadoop 2.9.x line - it includes 30 New Features
> with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since
> 2.8.2.
> 
> More information about the 2.9.0 release plan can be found here:
> *https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9
> <https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Version2.9>*
> 
> New RC is available at: *https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/
> <https://home.apache.org/~asuresh/hadoop-2.9.0-RC3/>*
> 
> The RC tag in git is: release-2.9.0-RC3, and the latest commit id is:
> 756ebc8394e473ac25feac05fa493f6d612e6c50.
> 
> The maven artifacts are available via repository.apache.org at:
> <https://www.google.com/url?q=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1066&sa=D&sntz=1&usg=AFQjCNFcern4uingMV_sEreko_zeLlgdlg>*https://repository.apache.org/content/repositories/orgapachehadoop-1068/
> <https://repository.apache.org/content/repositories/orgapachehadoop-1068/>*
> 
> We are carrying over the votes from the previous RC given that the delta is
> the license fix.
> 
> Given the above - we are also going to stick with the original deadline for
> the vote : ending on Friday 17th November 2017 2pm PT time.
> 
> Thanks,
> -Arun/Subru
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org