You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Gabor Bota <ga...@apache.org> on 2020/07/21 12:50:30 UTC
[VOTE] Release Apache Hadoop 3.1.4 (RC4)
Hi folks,
I have put together a release candidate (RC4) for Hadoop 3.1.4.
*****
The RC includes in addition to the previous ones:
* fix for HDFS-15313. Ensure inodes in active filesystem are not
deleted during snapshot delete
* fix for YARN-10347. Fix double locking in
CapacityScheduler#reinitialize in branch-3.1
(https://issues.apache.org/jira/browse/YARN-10347)
* the revert of HDFS-14941, as it caused
HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
(https://issues.apache.org/jira/browse/HDFS-15421)
* HDFS-15323, as requested.
(https://issues.apache.org/jira/browse/HDFS-15323)
*****
The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
The RC tag in git is here:
https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1275/
You can find my public key at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
Please try the release and vote. The vote will run for 8 weekdays,
until July 31. 2020. 23:00 CET.
Thanks,
Gabor
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
This is a recount of votes based on https://hadoop.apache.org/bylaws.html :
Vote based on a Lazy Majority of active PMC members
and
Lazy Majority -
A lazy majority vote requires 3 binding +1 votes and more binding +1
votes than -1 votes.
So the following is the right number of votes:
Binding +1s:
- Masatake Iwasaki
- Steve Loughran
- Elek Marton
Non-binding +1s:
- Szilard Nemeth
- Dinesh Chitlangia
- Adam Antal
- Mukund Madhav Thakur
The RC is still voted +1 by the lazy majority, but I wanted to clarify this.
Thank you Elek Marton for noticing this.
Regards,
Gabor
On Mon, Aug 3, 2020 at 11:08 AM Gabor Bota <ga...@cloudera.com> wrote:
>
> Hi All,
>
> With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
> hadoop-3.1.4 Release passes.
>
> Thank you everybody for contributing to the release, testing, and voting.
>
> Binding +1s:
> - Masatake Iwasaki
> - Szilard Nemeth
> - Steve Loughran
> - Dinesh Chitlangia
> - Adam Antal
> - Elek, Marton
>
> Non-binding +1s:
> - Mukund Madhav Thakur
>
> I'm going to work on staging the release.
>
> Thanks,
> Gabor
>
> On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
> >
> > +1 (binding)
> >
> > * checked signature
> > * built from source
> > * deployed binary package to kubernetes
> > * executed teragen with automatic tests [1]
> > * checked "hadoop version" and compared with git revision
> > * checked if the staging repository contains src packages
> >
> >
> > Thanks the work (and the toughness) Gabor Bota.
> >
> > Marton
> >
> >
> > [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
> >
> >
> > On 7/21/20 2:50 PM, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
This is a recount of votes based on https://hadoop.apache.org/bylaws.html :
Vote based on a Lazy Majority of active PMC members
and
Lazy Majority -
A lazy majority vote requires 3 binding +1 votes and more binding +1
votes than -1 votes.
So the following is the right number of votes:
Binding +1s:
- Masatake Iwasaki
- Steve Loughran
- Elek Marton
Non-binding +1s:
- Szilard Nemeth
- Dinesh Chitlangia
- Adam Antal
- Mukund Madhav Thakur
The RC is still voted +1 by the lazy majority, but I wanted to clarify this.
Thank you Elek Marton for noticing this.
Regards,
Gabor
On Mon, Aug 3, 2020 at 11:08 AM Gabor Bota <ga...@cloudera.com> wrote:
>
> Hi All,
>
> With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
> hadoop-3.1.4 Release passes.
>
> Thank you everybody for contributing to the release, testing, and voting.
>
> Binding +1s:
> - Masatake Iwasaki
> - Szilard Nemeth
> - Steve Loughran
> - Dinesh Chitlangia
> - Adam Antal
> - Elek, Marton
>
> Non-binding +1s:
> - Mukund Madhav Thakur
>
> I'm going to work on staging the release.
>
> Thanks,
> Gabor
>
> On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
> >
> > +1 (binding)
> >
> > * checked signature
> > * built from source
> > * deployed binary package to kubernetes
> > * executed teragen with automatic tests [1]
> > * checked "hadoop version" and compared with git revision
> > * checked if the staging repository contains src packages
> >
> >
> > Thanks the work (and the toughness) Gabor Bota.
> >
> > Marton
> >
> >
> > [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
> >
> >
> > On 7/21/20 2:50 PM, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
This is a recount of votes based on https://hadoop.apache.org/bylaws.html :
Vote based on a Lazy Majority of active PMC members
and
Lazy Majority -
A lazy majority vote requires 3 binding +1 votes and more binding +1
votes than -1 votes.
So the following is the right number of votes:
Binding +1s:
- Masatake Iwasaki
- Steve Loughran
- Elek Marton
Non-binding +1s:
- Szilard Nemeth
- Dinesh Chitlangia
- Adam Antal
- Mukund Madhav Thakur
The RC is still voted +1 by the lazy majority, but I wanted to clarify this.
Thank you Elek Marton for noticing this.
Regards,
Gabor
On Mon, Aug 3, 2020 at 11:08 AM Gabor Bota <ga...@cloudera.com> wrote:
>
> Hi All,
>
> With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
> hadoop-3.1.4 Release passes.
>
> Thank you everybody for contributing to the release, testing, and voting.
>
> Binding +1s:
> - Masatake Iwasaki
> - Szilard Nemeth
> - Steve Loughran
> - Dinesh Chitlangia
> - Adam Antal
> - Elek, Marton
>
> Non-binding +1s:
> - Mukund Madhav Thakur
>
> I'm going to work on staging the release.
>
> Thanks,
> Gabor
>
> On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
> >
> > +1 (binding)
> >
> > * checked signature
> > * built from source
> > * deployed binary package to kubernetes
> > * executed teragen with automatic tests [1]
> > * checked "hadoop version" and compared with git revision
> > * checked if the staging repository contains src packages
> >
> >
> > Thanks the work (and the toughness) Gabor Bota.
> >
> > Marton
> >
> >
> > [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
> >
> >
> > On 7/21/20 2:50 PM, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
This is a recount of votes based on https://hadoop.apache.org/bylaws.html :
Vote based on a Lazy Majority of active PMC members
and
Lazy Majority -
A lazy majority vote requires 3 binding +1 votes and more binding +1
votes than -1 votes.
So the following is the right number of votes:
Binding +1s:
- Masatake Iwasaki
- Steve Loughran
- Elek Marton
Non-binding +1s:
- Szilard Nemeth
- Dinesh Chitlangia
- Adam Antal
- Mukund Madhav Thakur
The RC is still voted +1 by the lazy majority, but I wanted to clarify this.
Thank you Elek Marton for noticing this.
Regards,
Gabor
On Mon, Aug 3, 2020 at 11:08 AM Gabor Bota <ga...@cloudera.com> wrote:
>
> Hi All,
>
> With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
> hadoop-3.1.4 Release passes.
>
> Thank you everybody for contributing to the release, testing, and voting.
>
> Binding +1s:
> - Masatake Iwasaki
> - Szilard Nemeth
> - Steve Loughran
> - Dinesh Chitlangia
> - Adam Antal
> - Elek, Marton
>
> Non-binding +1s:
> - Mukund Madhav Thakur
>
> I'm going to work on staging the release.
>
> Thanks,
> Gabor
>
> On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
> >
> > +1 (binding)
> >
> > * checked signature
> > * built from source
> > * deployed binary package to kubernetes
> > * executed teragen with automatic tests [1]
> > * checked "hadoop version" and compared with git revision
> > * checked if the staging repository contains src packages
> >
> >
> > Thanks the work (and the toughness) Gabor Bota.
> >
> > Marton
> >
> >
> > [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
> >
> >
> > On 7/21/20 2:50 PM, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
hadoop-3.1.4 Release passes.
Thank you everybody for contributing to the release, testing, and voting.
Binding +1s:
- Masatake Iwasaki
- Szilard Nemeth
- Steve Loughran
- Dinesh Chitlangia
- Adam Antal
- Elek, Marton
Non-binding +1s:
- Mukund Madhav Thakur
I'm going to work on staging the release.
Thanks,
Gabor
On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
>
> +1 (binding)
>
> * checked signature
> * built from source
> * deployed binary package to kubernetes
> * executed teragen with automatic tests [1]
> * checked "hadoop version" and compared with git revision
> * checked if the staging repository contains src packages
>
>
> Thanks the work (and the toughness) Gabor Bota.
>
> Marton
>
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
>
>
> On 7/21/20 2:50 PM, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
hadoop-3.1.4 Release passes.
Thank you everybody for contributing to the release, testing, and voting.
Binding +1s:
- Masatake Iwasaki
- Szilard Nemeth
- Steve Loughran
- Dinesh Chitlangia
- Adam Antal
- Elek, Marton
Non-binding +1s:
- Mukund Madhav Thakur
I'm going to work on staging the release.
Thanks,
Gabor
On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
>
> +1 (binding)
>
> * checked signature
> * built from source
> * deployed binary package to kubernetes
> * executed teragen with automatic tests [1]
> * checked "hadoop version" and compared with git revision
> * checked if the staging repository contains src packages
>
>
> Thanks the work (and the toughness) Gabor Bota.
>
> Marton
>
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
>
>
> On 7/21/20 2:50 PM, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
hadoop-3.1.4 Release passes.
Thank you everybody for contributing to the release, testing, and voting.
Binding +1s:
- Masatake Iwasaki
- Szilard Nemeth
- Steve Loughran
- Dinesh Chitlangia
- Adam Antal
- Elek, Marton
Non-binding +1s:
- Mukund Madhav Thakur
I'm going to work on staging the release.
Thanks,
Gabor
On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
>
> +1 (binding)
>
> * checked signature
> * built from source
> * deployed binary package to kubernetes
> * executed teragen with automatic tests [1]
> * checked "hadoop version" and compared with git revision
> * checked if the staging repository contains src packages
>
>
> Thanks the work (and the toughness) Gabor Bota.
>
> Marton
>
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
>
>
> On 7/21/20 2:50 PM, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Hi All,
With 6 binding and 1 non-binding +1s and no -1s the vote for Apache
hadoop-3.1.4 Release passes.
Thank you everybody for contributing to the release, testing, and voting.
Binding +1s:
- Masatake Iwasaki
- Szilard Nemeth
- Steve Loughran
- Dinesh Chitlangia
- Adam Antal
- Elek, Marton
Non-binding +1s:
- Mukund Madhav Thakur
I'm going to work on staging the release.
Thanks,
Gabor
On Mon, Aug 3, 2020 at 10:03 AM Elek, Marton <el...@apache.org> wrote:
>
> +1 (binding)
>
> * checked signature
> * built from source
> * deployed binary package to kubernetes
> * executed teragen with automatic tests [1]
> * checked "hadoop version" and compared with git revision
> * checked if the staging repository contains src packages
>
>
> Thanks the work (and the toughness) Gabor Bota.
>
> Marton
>
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
>
>
> On 7/21/20 2:50 PM, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
* checked signature
* built from source
* deployed binary package to kubernetes
* executed teragen with automatic tests [1]
* checked "hadoop version" and compared with git revision
* checked if the staging repository contains src packages
Thanks the work (and the toughness) Gabor Bota.
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
On 7/21/20 2:50 PM, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
+1
- Built from source using mvn package -Pdist -DskipTests
-Dmaven.javadoc.skip=true -DskipShade on mac os with jdk 1.8.
- Ran some hadoop fs commands to s3 store from the packaged distribution.
- Ran s3a integration tests.
On Tue, Jul 28, 2020 at 12:56 AM Dinesh Chitlangia <di...@apache.org>
wrote:
> +1
>
> - Built from source
> - Verified checksum and signatures
> - Deployed 3 node cluster
> - Able to submit and complete an example mapreduce job
>
> Thanks Gabor for organizing the release.
>
> Regards,
> Dinesh
>
> On Tue, Jul 21, 2020 at 8:52 AM Gabor Bota <ga...@apache.org> wrote:
>
>> Hi folks,
>>
>> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>>
>> *****
>> The RC includes in addition to the previous ones:
>> * fix for HDFS-15313. Ensure inodes in active filesystem are not
>> deleted during snapshot delete
>> * fix for YARN-10347. Fix double locking in
>> CapacityScheduler#reinitialize in branch-3.1
>> (https://issues.apache.org/jira/browse/YARN-10347)
>> * the revert of HDFS-14941, as it caused
>> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
>> (https://issues.apache.org/jira/browse/HDFS-15421)
>> * HDFS-15323, as requested.
>> (https://issues.apache.org/jira/browse/HDFS-15323)
>> *****
>>
>> The RC is available at:
>> http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
>> The RC tag in git is here:
>> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
>> The maven artifacts are staged at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>>
>> You can find my public key at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>>
>> Please try the release and vote. The vote will run for 8 weekdays,
>> until July 31. 2020. 23:00 CET.
>>
>>
>> Thanks,
>> Gabor
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>>
>>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Dinesh Chitlangia <di...@apache.org>.
+1
- Built from source
- Verified checksum and signatures
- Deployed 3 node cluster
- Able to submit and complete an example mapreduce job
Thanks Gabor for organizing the release.
Regards,
Dinesh
On Tue, Jul 21, 2020 at 8:52 AM Gabor Bota <ga...@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
* checked signature
* built from source
* deployed binary package to kubernetes
* executed teragen with automatic tests [1]
* checked "hadoop version" and compared with git revision
* checked if the staging repository contains src packages
Thanks the work (and the toughness) Gabor Bota.
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
On 7/21/20 2:50 PM, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Adam Antal <ad...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
* verified checksum and signature of CHANGES.md, RELEASENOTES.md
* verified checksum and signature of the rat output, site (doc), source and
the compressed binaries
* browsed documentation, checked some relevant changes since 3.1.3
* built successfully on Ubuntu 16.04 (Xenial) using latest OpenJDK 8
(native libraries and PB installed via the steps described in BUILDING.txt)
* ran various YARN unit tests
**Details**
* Java version:
openjdk version "1.8.0_252"
OpenJDK Runtime Environment (build 1.8.0_252-8u252-b09-1~16.04-b09)
OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode)
On Thu, Jul 23, 2020 at 6:24 PM Szilard Nemeth <sn...@cloudera.com.invalid>
wrote:
> +1 (binding).
>
> **TEST STEPS**
> 1. Build from sources (see Maven / Java and OS details below)
> 2. Distribute Hadoop to all nodes
> 3. Start HDFS services + YARN services on nodes
> 4. Run Mapreduce pi job (QuasiMontecarlo)
> 5. Verifed that application was successful through YARN RM Web UI
> 6. Verified version of Hadoop release from YARN RM Web UI
>
> **OS version**
> $ cat /etc/os-release
> NAME="CentOS Linux"
> VERSION="7 (Core)"
> ID="centos"
> ID_LIKE="rhel fedora"
> VERSION_ID="7"
> PRETTY_NAME="CentOS Linux 7 (Core)"
> ANSI_COLOR="0;31"
> CPE_NAME="cpe:/o:centos:centos:7"
> HOME_URL="https://www.centos.org/"
> BUG_REPORT_URL="https://bugs.centos.org/"
>
> CENTOS_MANTISBT_PROJECT="CentOS-7"
> CENTOS_MANTISBT_PROJECT_VERSION="7"
> REDHAT_SUPPORT_PRODUCT="centos"
> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>
> **Maven version**
> $ mvn -v
> Apache Maven 3.0.5 (Red Hat 3.0.5-17)
> Maven home: /usr/share/maven
>
> **Java version**
> Java version: 1.8.0_191, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
> Default locale: en_US, platform encoding: ANSI_X3.4-1968
> OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
> "unix"
>
> **Maven command to build from sources**
> mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
>
>
> **OTHER NOTES**
> 1. Had to manually install maven in order to manually compile Hadoop based
> on these steps:
> https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
>
> 2. Had to manually install protoc + other required libraries with the
> following commands (in this particular order):
> sudo yum install -y protobuf-devel
> sudo yum install -y gcc gcc-c++ make
> sudo yum install -y openssl-devel
> sudo yum install -y libgsasl
>
>
> Thanks,
> Szilard
>
> On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
> > +1 (binding).
> >
> > * verified the checksum and signature of the source tarball.
> > * built from source tarball with native profile on CentOS 7 and OpenJDK
> 8.
> > * built documentation and skimmed the contents.
> > * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA
> enblaed.
> > * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> > basic EZ operation, ran example MR jobs.
> > * followed the reproduction step reported in HDFS-15313 to see if the
> > fix works.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2020/07/21 21:50, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at:
> > http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Adam Antal <ad...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
* verified checksum and signature of CHANGES.md, RELEASENOTES.md
* verified checksum and signature of the rat output, site (doc), source and
the compressed binaries
* browsed documentation, checked some relevant changes since 3.1.3
* built successfully on Ubuntu 16.04 (Xenial) using latest OpenJDK 8
(native libraries and PB installed via the steps described in BUILDING.txt)
* ran various YARN unit tests
**Details**
* Java version:
openjdk version "1.8.0_252"
OpenJDK Runtime Environment (build 1.8.0_252-8u252-b09-1~16.04-b09)
OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode)
On Thu, Jul 23, 2020 at 6:24 PM Szilard Nemeth <sn...@cloudera.com.invalid>
wrote:
> +1 (binding).
>
> **TEST STEPS**
> 1. Build from sources (see Maven / Java and OS details below)
> 2. Distribute Hadoop to all nodes
> 3. Start HDFS services + YARN services on nodes
> 4. Run Mapreduce pi job (QuasiMontecarlo)
> 5. Verifed that application was successful through YARN RM Web UI
> 6. Verified version of Hadoop release from YARN RM Web UI
>
> **OS version**
> $ cat /etc/os-release
> NAME="CentOS Linux"
> VERSION="7 (Core)"
> ID="centos"
> ID_LIKE="rhel fedora"
> VERSION_ID="7"
> PRETTY_NAME="CentOS Linux 7 (Core)"
> ANSI_COLOR="0;31"
> CPE_NAME="cpe:/o:centos:centos:7"
> HOME_URL="https://www.centos.org/"
> BUG_REPORT_URL="https://bugs.centos.org/"
>
> CENTOS_MANTISBT_PROJECT="CentOS-7"
> CENTOS_MANTISBT_PROJECT_VERSION="7"
> REDHAT_SUPPORT_PRODUCT="centos"
> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>
> **Maven version**
> $ mvn -v
> Apache Maven 3.0.5 (Red Hat 3.0.5-17)
> Maven home: /usr/share/maven
>
> **Java version**
> Java version: 1.8.0_191, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
> Default locale: en_US, platform encoding: ANSI_X3.4-1968
> OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
> "unix"
>
> **Maven command to build from sources**
> mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
>
>
> **OTHER NOTES**
> 1. Had to manually install maven in order to manually compile Hadoop based
> on these steps:
> https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
>
> 2. Had to manually install protoc + other required libraries with the
> following commands (in this particular order):
> sudo yum install -y protobuf-devel
> sudo yum install -y gcc gcc-c++ make
> sudo yum install -y openssl-devel
> sudo yum install -y libgsasl
>
>
> Thanks,
> Szilard
>
> On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
> > +1 (binding).
> >
> > * verified the checksum and signature of the source tarball.
> > * built from source tarball with native profile on CentOS 7 and OpenJDK
> 8.
> > * built documentation and skimmed the contents.
> > * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA
> enblaed.
> > * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> > basic EZ operation, ran example MR jobs.
> > * followed the reproduction step reported in HDFS-15313 to see if the
> > fix works.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2020/07/21 21:50, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at:
> > http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Adam Antal <ad...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
* verified checksum and signature of CHANGES.md, RELEASENOTES.md
* verified checksum and signature of the rat output, site (doc), source and
the compressed binaries
* browsed documentation, checked some relevant changes since 3.1.3
* built successfully on Ubuntu 16.04 (Xenial) using latest OpenJDK 8
(native libraries and PB installed via the steps described in BUILDING.txt)
* ran various YARN unit tests
**Details**
* Java version:
openjdk version "1.8.0_252"
OpenJDK Runtime Environment (build 1.8.0_252-8u252-b09-1~16.04-b09)
OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode)
On Thu, Jul 23, 2020 at 6:24 PM Szilard Nemeth <sn...@cloudera.com.invalid>
wrote:
> +1 (binding).
>
> **TEST STEPS**
> 1. Build from sources (see Maven / Java and OS details below)
> 2. Distribute Hadoop to all nodes
> 3. Start HDFS services + YARN services on nodes
> 4. Run Mapreduce pi job (QuasiMontecarlo)
> 5. Verifed that application was successful through YARN RM Web UI
> 6. Verified version of Hadoop release from YARN RM Web UI
>
> **OS version**
> $ cat /etc/os-release
> NAME="CentOS Linux"
> VERSION="7 (Core)"
> ID="centos"
> ID_LIKE="rhel fedora"
> VERSION_ID="7"
> PRETTY_NAME="CentOS Linux 7 (Core)"
> ANSI_COLOR="0;31"
> CPE_NAME="cpe:/o:centos:centos:7"
> HOME_URL="https://www.centos.org/"
> BUG_REPORT_URL="https://bugs.centos.org/"
>
> CENTOS_MANTISBT_PROJECT="CentOS-7"
> CENTOS_MANTISBT_PROJECT_VERSION="7"
> REDHAT_SUPPORT_PRODUCT="centos"
> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>
> **Maven version**
> $ mvn -v
> Apache Maven 3.0.5 (Red Hat 3.0.5-17)
> Maven home: /usr/share/maven
>
> **Java version**
> Java version: 1.8.0_191, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
> Default locale: en_US, platform encoding: ANSI_X3.4-1968
> OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
> "unix"
>
> **Maven command to build from sources**
> mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
>
>
> **OTHER NOTES**
> 1. Had to manually install maven in order to manually compile Hadoop based
> on these steps:
> https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
>
> 2. Had to manually install protoc + other required libraries with the
> following commands (in this particular order):
> sudo yum install -y protobuf-devel
> sudo yum install -y gcc gcc-c++ make
> sudo yum install -y openssl-devel
> sudo yum install -y libgsasl
>
>
> Thanks,
> Szilard
>
> On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
> > +1 (binding).
> >
> > * verified the checksum and signature of the source tarball.
> > * built from source tarball with native profile on CentOS 7 and OpenJDK
> 8.
> > * built documentation and skimmed the contents.
> > * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA
> enblaed.
> > * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> > basic EZ operation, ran example MR jobs.
> > * followed the reproduction step reported in HDFS-15313 to see if the
> > fix works.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2020/07/21 21:50, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at:
> > http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Adam Antal <ad...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
* verified checksum and signature of CHANGES.md, RELEASENOTES.md
* verified checksum and signature of the rat output, site (doc), source and
the compressed binaries
* browsed documentation, checked some relevant changes since 3.1.3
* built successfully on Ubuntu 16.04 (Xenial) using latest OpenJDK 8
(native libraries and PB installed via the steps described in BUILDING.txt)
* ran various YARN unit tests
**Details**
* Java version:
openjdk version "1.8.0_252"
OpenJDK Runtime Environment (build 1.8.0_252-8u252-b09-1~16.04-b09)
OpenJDK 64-Bit Server VM (build 25.252-b09, mixed mode)
On Thu, Jul 23, 2020 at 6:24 PM Szilard Nemeth <sn...@cloudera.com.invalid>
wrote:
> +1 (binding).
>
> **TEST STEPS**
> 1. Build from sources (see Maven / Java and OS details below)
> 2. Distribute Hadoop to all nodes
> 3. Start HDFS services + YARN services on nodes
> 4. Run Mapreduce pi job (QuasiMontecarlo)
> 5. Verifed that application was successful through YARN RM Web UI
> 6. Verified version of Hadoop release from YARN RM Web UI
>
> **OS version**
> $ cat /etc/os-release
> NAME="CentOS Linux"
> VERSION="7 (Core)"
> ID="centos"
> ID_LIKE="rhel fedora"
> VERSION_ID="7"
> PRETTY_NAME="CentOS Linux 7 (Core)"
> ANSI_COLOR="0;31"
> CPE_NAME="cpe:/o:centos:centos:7"
> HOME_URL="https://www.centos.org/"
> BUG_REPORT_URL="https://bugs.centos.org/"
>
> CENTOS_MANTISBT_PROJECT="CentOS-7"
> CENTOS_MANTISBT_PROJECT_VERSION="7"
> REDHAT_SUPPORT_PRODUCT="centos"
> REDHAT_SUPPORT_PRODUCT_VERSION="7"
>
> **Maven version**
> $ mvn -v
> Apache Maven 3.0.5 (Red Hat 3.0.5-17)
> Maven home: /usr/share/maven
>
> **Java version**
> Java version: 1.8.0_191, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
> Default locale: en_US, platform encoding: ANSI_X3.4-1968
> OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
> "unix"
>
> **Maven command to build from sources**
> mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
>
>
> **OTHER NOTES**
> 1. Had to manually install maven in order to manually compile Hadoop based
> on these steps:
> https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
>
> 2. Had to manually install protoc + other required libraries with the
> following commands (in this particular order):
> sudo yum install -y protobuf-devel
> sudo yum install -y gcc gcc-c++ make
> sudo yum install -y openssl-devel
> sudo yum install -y libgsasl
>
>
> Thanks,
> Szilard
>
> On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
> > +1 (binding).
> >
> > * verified the checksum and signature of the source tarball.
> > * built from source tarball with native profile on CentOS 7 and OpenJDK
> 8.
> > * built documentation and skimmed the contents.
> > * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA
> enblaed.
> > * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> > basic EZ operation, ran example MR jobs.
> > * followed the reproduction step reported in HDFS-15313 to see if the
> > fix works.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2020/07/21 21:50, Gabor Bota wrote:
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> > >
> > > *****
> > > The RC includes in addition to the previous ones:
> > > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > > deleted during snapshot delete
> > > * fix for YARN-10347. Fix double locking in
> > > CapacityScheduler#reinitialize in branch-3.1
> > > (https://issues.apache.org/jira/browse/YARN-10347)
> > > * the revert of HDFS-14941, as it caused
> > > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > > (https://issues.apache.org/jira/browse/HDFS-15421)
> > > * HDFS-15323, as requested.
> > > (https://issues.apache.org/jira/browse/HDFS-15323)
> > > *****
> > >
> > > The RC is available at:
> > http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > > The RC tag in git is here:
> > > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> > >
> > > Please try the release and vote. The vote will run for 8 weekdays,
> > > until July 31. 2020. 23:00 CET.
> > >
> > >
> > > Thanks,
> > > Gabor
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Szilard Nemeth <sn...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
1. Build from sources (see Maven / Java and OS details below)
2. Distribute Hadoop to all nodes
3. Start HDFS services + YARN services on nodes
4. Run Mapreduce pi job (QuasiMontecarlo)
5. Verifed that application was successful through YARN RM Web UI
6. Verified version of Hadoop release from YARN RM Web UI
**OS version**
$ cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
**Maven version**
$ mvn -v
Apache Maven 3.0.5 (Red Hat 3.0.5-17)
Maven home: /usr/share/maven
**Java version**
Java version: 1.8.0_191, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
"unix"
**Maven command to build from sources**
mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
**OTHER NOTES**
1. Had to manually install maven in order to manually compile Hadoop based
on these steps:
https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
2. Had to manually install protoc + other required libraries with the
following commands (in this particular order):
sudo yum install -y protobuf-devel
sudo yum install -y gcc gcc-c++ make
sudo yum install -y openssl-devel
sudo yum install -y libgsasl
Thanks,
Szilard
On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> +1 (binding).
>
> * verified the checksum and signature of the source tarball.
> * built from source tarball with native profile on CentOS 7 and OpenJDK 8.
> * built documentation and skimmed the contents.
> * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
> * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> basic EZ operation, ran example MR jobs.
> * followed the reproduction step reported in HDFS-15313 to see if the
> fix works.
>
> Thanks,
> Masatake Iwasaki
>
> On 2020/07/21 21:50, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at:
> http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Szilard Nemeth <sn...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
1. Build from sources (see Maven / Java and OS details below)
2. Distribute Hadoop to all nodes
3. Start HDFS services + YARN services on nodes
4. Run Mapreduce pi job (QuasiMontecarlo)
5. Verifed that application was successful through YARN RM Web UI
6. Verified version of Hadoop release from YARN RM Web UI
**OS version**
$ cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
**Maven version**
$ mvn -v
Apache Maven 3.0.5 (Red Hat 3.0.5-17)
Maven home: /usr/share/maven
**Java version**
Java version: 1.8.0_191, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
"unix"
**Maven command to build from sources**
mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
**OTHER NOTES**
1. Had to manually install maven in order to manually compile Hadoop based
on these steps:
https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
2. Had to manually install protoc + other required libraries with the
following commands (in this particular order):
sudo yum install -y protobuf-devel
sudo yum install -y gcc gcc-c++ make
sudo yum install -y openssl-devel
sudo yum install -y libgsasl
Thanks,
Szilard
On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> +1 (binding).
>
> * verified the checksum and signature of the source tarball.
> * built from source tarball with native profile on CentOS 7 and OpenJDK 8.
> * built documentation and skimmed the contents.
> * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
> * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> basic EZ operation, ran example MR jobs.
> * followed the reproduction step reported in HDFS-15313 to see if the
> fix works.
>
> Thanks,
> Masatake Iwasaki
>
> On 2020/07/21 21:50, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at:
> http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Szilard Nemeth <sn...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
1. Build from sources (see Maven / Java and OS details below)
2. Distribute Hadoop to all nodes
3. Start HDFS services + YARN services on nodes
4. Run Mapreduce pi job (QuasiMontecarlo)
5. Verifed that application was successful through YARN RM Web UI
6. Verified version of Hadoop release from YARN RM Web UI
**OS version**
$ cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
**Maven version**
$ mvn -v
Apache Maven 3.0.5 (Red Hat 3.0.5-17)
Maven home: /usr/share/maven
**Java version**
Java version: 1.8.0_191, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
"unix"
**Maven command to build from sources**
mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
**OTHER NOTES**
1. Had to manually install maven in order to manually compile Hadoop based
on these steps:
https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
2. Had to manually install protoc + other required libraries with the
following commands (in this particular order):
sudo yum install -y protobuf-devel
sudo yum install -y gcc gcc-c++ make
sudo yum install -y openssl-devel
sudo yum install -y libgsasl
Thanks,
Szilard
On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> +1 (binding).
>
> * verified the checksum and signature of the source tarball.
> * built from source tarball with native profile on CentOS 7 and OpenJDK 8.
> * built documentation and skimmed the contents.
> * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
> * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> basic EZ operation, ran example MR jobs.
> * followed the reproduction step reported in HDFS-15313 to see if the
> fix works.
>
> Thanks,
> Masatake Iwasaki
>
> On 2020/07/21 21:50, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at:
> http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Szilard Nemeth <sn...@cloudera.com.INVALID>.
+1 (binding).
**TEST STEPS**
1. Build from sources (see Maven / Java and OS details below)
2. Distribute Hadoop to all nodes
3. Start HDFS services + YARN services on nodes
4. Run Mapreduce pi job (QuasiMontecarlo)
5. Verifed that application was successful through YARN RM Web UI
6. Verified version of Hadoop release from YARN RM Web UI
**OS version**
$ cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"
CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"
**Maven version**
$ mvn -v
Apache Maven 3.0.5 (Red Hat 3.0.5-17)
Maven home: /usr/share/maven
**Java version**
Java version: 1.8.0_191, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.191.b12-0.el7_5.x86_64/jre
Default locale: en_US, platform encoding: ANSI_X3.4-1968
OS name: "linux", version: "3.10.0-1062.el7.x86_64", arch: "amd64", family:
"unix"
**Maven command to build from sources**
mvn clean package -Pdist -DskipTests -Dmaven.javadoc.skip=true
**OTHER NOTES**
1. Had to manually install maven in order to manually compile Hadoop based
on these steps:
https://gist.github.com/miroslavtamas/cdca97f2eafdd6c28b844434eaa3b631
2. Had to manually install protoc + other required libraries with the
following commands (in this particular order):
sudo yum install -y protobuf-devel
sudo yum install -y gcc gcc-c++ make
sudo yum install -y openssl-devel
sudo yum install -y libgsasl
Thanks,
Szilard
On Thu, Jul 23, 2020 at 4:05 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> +1 (binding).
>
> * verified the checksum and signature of the source tarball.
> * built from source tarball with native profile on CentOS 7 and OpenJDK 8.
> * built documentation and skimmed the contents.
> * ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
> * launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
> basic EZ operation, ran example MR jobs.
> * followed the reproduction step reported in HDFS-15313 to see if the
> fix works.
>
> Thanks,
> Masatake Iwasaki
>
> On 2020/07/21 21:50, Gabor Bota wrote:
> > Hi folks,
> >
> > I have put together a release candidate (RC4) for Hadoop 3.1.4.
> >
> > *****
> > The RC includes in addition to the previous ones:
> > * fix for HDFS-15313. Ensure inodes in active filesystem are not
> > deleted during snapshot delete
> > * fix for YARN-10347. Fix double locking in
> > CapacityScheduler#reinitialize in branch-3.1
> > (https://issues.apache.org/jira/browse/YARN-10347)
> > * the revert of HDFS-14941, as it caused
> > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> > (https://issues.apache.org/jira/browse/HDFS-15421)
> > * HDFS-15323, as requested.
> > (https://issues.apache.org/jira/browse/HDFS-15323)
> > *****
> >
> > The RC is available at:
> http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> > The RC tag in git is here:
> > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1275/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
> >
> > Please try the release and vote. The vote will run for 8 weekdays,
> > until July 31. 2020. 23:00 CET.
> >
> >
> > Thanks,
> > Gabor
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 (binding).
* verified the checksum and signature of the source tarball.
* built from source tarball with native profile on CentOS 7 and OpenJDK 8.
* built documentation and skimmed the contents.
* ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
* launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
basic EZ operation, ran example MR jobs.
* followed the reproduction step reported in HDFS-15313 to see if the
fix works.
Thanks,
Masatake Iwasaki
On 2020/07/21 21:50, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
I should add, that's a binding +1
On Mon, 27 Jul 2020 at 19:55, Steve Loughran <st...@cloudera.com> wrote:
> +1
>
> did a cloudstore clean build and test
> did as well as I could with a spark build.
>
> For anyone having maven problems building hadoop on a mac, homebrew now
> forces its version of maven to use a homebrew specific openjdk 11
> (one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
> work if maven is running on java 11. Removing the homebrew maven fixes up
> that but now the bits of the spark maven build which call out to the SBT
> build tool are going out of memory. This is one of those times when I think
> "I need a linux box'
>
> Anyway: maven builds are happy, spark compiles with the branch once you
> change its guava version. Well, that's progress
>
> -Steve
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
I should add, that's a binding +1
On Mon, 27 Jul 2020 at 19:55, Steve Loughran <st...@cloudera.com> wrote:
> +1
>
> did a cloudstore clean build and test
> did as well as I could with a spark build.
>
> For anyone having maven problems building hadoop on a mac, homebrew now
> forces its version of maven to use a homebrew specific openjdk 11
> (one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
> work if maven is running on java 11. Removing the homebrew maven fixes up
> that but now the bits of the spark maven build which call out to the SBT
> build tool are going out of memory. This is one of those times when I think
> "I need a linux box'
>
> Anyway: maven builds are happy, spark compiles with the branch once you
> change its guava version. Well, that's progress
>
> -Steve
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
I should add, that's a binding +1
On Mon, 27 Jul 2020 at 19:55, Steve Loughran <st...@cloudera.com> wrote:
> +1
>
> did a cloudstore clean build and test
> did as well as I could with a spark build.
>
> For anyone having maven problems building hadoop on a mac, homebrew now
> forces its version of maven to use a homebrew specific openjdk 11
> (one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
> work if maven is running on java 11. Removing the homebrew maven fixes up
> that but now the bits of the spark maven build which call out to the SBT
> build tool are going out of memory. This is one of those times when I think
> "I need a linux box'
>
> Anyway: maven builds are happy, spark compiles with the branch once you
> change its guava version. Well, that's progress
>
> -Steve
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
I should add, that's a binding +1
On Mon, 27 Jul 2020 at 19:55, Steve Loughran <st...@cloudera.com> wrote:
> +1
>
> did a cloudstore clean build and test
> did as well as I could with a spark build.
>
> For anyone having maven problems building hadoop on a mac, homebrew now
> forces its version of maven to use a homebrew specific openjdk 11
> (one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
> work if maven is running on java 11. Removing the homebrew maven fixes up
> that but now the bits of the spark maven build which call out to the SBT
> build tool are going out of memory. This is one of those times when I think
> "I need a linux box'
>
> Anyway: maven builds are happy, spark compiles with the branch once you
> change its guava version. Well, that's progress
>
> -Steve
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
+1
did a cloudstore clean build and test
did as well as I could with a spark build.
For anyone having maven problems building hadoop on a mac, homebrew now
forces its version of maven to use a homebrew specific openjdk 11
(one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
work if maven is running on java 11. Removing the homebrew maven fixes up
that but now the bits of the spark maven build which call out to the SBT
build tool are going out of memory. This is one of those times when I think
"I need a linux box'
Anyway: maven builds are happy, spark compiles with the branch once you
change its guava version. Well, that's progress
-Steve
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
+1
did a cloudstore clean build and test
did as well as I could with a spark build.
For anyone having maven problems building hadoop on a mac, homebrew now
forces its version of maven to use a homebrew specific openjdk 11
(one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
work if maven is running on java 11. Removing the homebrew maven fixes up
that but now the bits of the spark maven build which call out to the SBT
build tool are going out of memory. This is one of those times when I think
"I need a linux box'
Anyway: maven builds are happy, spark compiles with the branch once you
change its guava version. Well, that's progress
-Steve
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 (binding).
* verified the checksum and signature of the source tarball.
* built from source tarball with native profile on CentOS 7 and OpenJDK 8.
* built documentation and skimmed the contents.
* ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
* launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
basic EZ operation, ran example MR jobs.
* followed the reproduction step reported in HDFS-15313 to see if the
fix works.
Thanks,
Masatake Iwasaki
On 2020/07/21 21:50, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
* checked signature
* built from source
* deployed binary package to kubernetes
* executed teragen with automatic tests [1]
* checked "hadoop version" and compared with git revision
* checked if the staging repository contains src packages
Thanks the work (and the toughness) Gabor Bota.
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
On 7/21/20 2:50 PM, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 (binding).
* verified the checksum and signature of the source tarball.
* built from source tarball with native profile on CentOS 7 and OpenJDK 8.
* built documentation and skimmed the contents.
* ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
* launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
basic EZ operation, ran example MR jobs.
* followed the reproduction step reported in HDFS-15313 to see if the
fix works.
Thanks,
Masatake Iwasaki
On 2020/07/21 21:50, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Dinesh Chitlangia <di...@apache.org>.
+1
- Built from source
- Verified checksum and signatures
- Deployed 3 node cluster
- Able to submit and complete an example mapreduce job
Thanks Gabor for organizing the release.
Regards,
Dinesh
On Tue, Jul 21, 2020 at 8:52 AM Gabor Bota <ga...@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Dinesh Chitlangia <di...@apache.org>.
+1
- Built from source
- Verified checksum and signatures
- Deployed 3 node cluster
- Able to submit and complete an example mapreduce job
Thanks Gabor for organizing the release.
Regards,
Dinesh
On Tue, Jul 21, 2020 at 8:52 AM Gabor Bota <ga...@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 (binding).
* verified the checksum and signature of the source tarball.
* built from source tarball with native profile on CentOS 7 and OpenJDK 8.
* built documentation and skimmed the contents.
* ran example jobs on 3 nodes docker cluster with NN-HA and RM-HA enblaed.
* launched pseudo-distributed cluster with Kerberos and SSL enabled, ran
basic EZ operation, ran example MR jobs.
* followed the reproduction step reported in HDFS-15313 to see if the
fix works.
Thanks,
Masatake Iwasaki
On 2020/07/21 21:50, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
+1
did a cloudstore clean build and test
did as well as I could with a spark build.
For anyone having maven problems building hadoop on a mac, homebrew now
forces its version of maven to use a homebrew specific openjdk 11
(one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
work if maven is running on java 11. Removing the homebrew maven fixes up
that but now the bits of the spark maven build which call out to the SBT
build tool are going out of memory. This is one of those times when I think
"I need a linux box'
Anyway: maven builds are happy, spark compiles with the branch once you
change its guava version. Well, that's progress
-Steve
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
* checked signature
* built from source
* deployed binary package to kubernetes
* executed teragen with automatic tests [1]
* checked "hadoop version" and compared with git revision
* checked if the staging repository contains src packages
Thanks the work (and the toughness) Gabor Bota.
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-hdfs
On 7/21/20 2:50 PM, Gabor Bota wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Dinesh Chitlangia <di...@apache.org>.
+1
- Built from source
- Verified checksum and signatures
- Deployed 3 node cluster
- Able to submit and complete an example mapreduce job
Thanks Gabor for organizing the release.
Regards,
Dinesh
On Tue, Jul 21, 2020 at 8:52 AM Gabor Bota <ga...@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC4) for Hadoop 3.1.4.
>
> *****
> The RC includes in addition to the previous ones:
> * fix for HDFS-15313. Ensure inodes in active filesystem are not
> deleted during snapshot delete
> * fix for YARN-10347. Fix double locking in
> CapacityScheduler#reinitialize in branch-3.1
> (https://issues.apache.org/jira/browse/YARN-10347)
> * the revert of HDFS-14941, as it caused
> HDFS-15421. IBR leak causes standby NN to be stuck in safe mode.
> (https://issues.apache.org/jira/browse/HDFS-15421)
> * HDFS-15323, as requested.
> (https://issues.apache.org/jira/browse/HDFS-15323)
> *****
>
> The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC4/
> The RC tag in git is here:
> https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC4
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1275/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C
>
> Please try the release and vote. The vote will run for 8 weekdays,
> until July 31. 2020. 23:00 CET.
>
>
> Thanks,
> Gabor
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.4 (RC4)
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
+1
did a cloudstore clean build and test
did as well as I could with a spark build.
For anyone having maven problems building hadoop on a mac, homebrew now
forces its version of maven to use a homebrew specific openjdk 11
(one /usr/libexec/java_home doesn't locate); bits of the hadoop build don't
work if maven is running on java 11. Removing the homebrew maven fixes up
that but now the bits of the spark maven build which call out to the SBT
build tool are going out of memory. This is one of those times when I think
"I need a linux box'
Anyway: maven builds are happy, spark compiles with the branch once you
change its guava version. Well, that's progress
-Steve