You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Wangda Tan <wh...@gmail.com> on 2018/08/02 18:43:50 UTC
[VOTE] Release Apache Hadoop 3.1.1 - RC0
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shane Kumpf <sh...@gmail.com>.
+1 (binding) - Thanks for putting this together Wangda.
- Built from source
- Deployed a single node cluster on CentOS 7.4
- Basic dfs command checkout
- Ran dshell, MR pi, and MR sleep with the default and docker runtimes
- Validated the ability to disable the docker runtime
- Validated the ability to disable privileged docker containers
- Successfully launched a docker based YARN service
- Validated basic lookups against Registry DNS
-Shane
On Thu, Aug 2, 2018 at 12:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Ajay Kumar <aj...@hortonworks.com>.
+1 (non-binding) Thanks for working on this Wangda!!
- built from source on mac, jdk1.8.0_111
- deployed on a 3 node non-secure cluster
- tested basic hdfs cli functionality (put,get, delete,ls etc)
- executed sample MR jobs (wordcount, TestDFSIO read/write)
- Basic sanity check for NN and RM UI
Best,
Ajay
On 8/7/18, 8:51 AM, "Kitti Nánási" <kn...@cloudera.com.INVALID> wrote:
Thanks Wangda for working on this!
+1 (non-binding)
- checked out git tag release-3.1.1-RC0
- built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
- deployed on a 3 node cluster
- ran terasort, teragen, teravalidate with success
- executed basic hdfs and dfsadmin commands
- executed unit tests for hadoop-hdfs-project/hadoop-hdfs-client and
hadoop-hdfs-project/hadoop-- hdfs-httpfs modules that have all passed
Thanks,
Kitti
On Tue, Aug 7, 2018 at 5:23 PM, Brahma Reddy Battula <br...@gmail.com>
wrote:
> +1 ,(binding).
>
> Wangda Tan thanks for driving this.
>
>
> --Built with source.
> --Installed the HA cluster
> --Ran basic hdfs operations through shell/API
> --Ran Sample jobs like pi, wordcount
> --Browsed UI.
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Ajay Kumar <aj...@hortonworks.com>.
+1 (non-binding) Thanks for working on this Wangda!!
- built from source on mac, jdk1.8.0_111
- deployed on a 3 node non-secure cluster
- tested basic hdfs cli functionality (put,get, delete,ls etc)
- executed sample MR jobs (wordcount, TestDFSIO read/write)
- Basic sanity check for NN and RM UI
Best,
Ajay
On 8/7/18, 8:51 AM, "Kitti Nánási" <kn...@cloudera.com.INVALID> wrote:
Thanks Wangda for working on this!
+1 (non-binding)
- checked out git tag release-3.1.1-RC0
- built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
- deployed on a 3 node cluster
- ran terasort, teragen, teravalidate with success
- executed basic hdfs and dfsadmin commands
- executed unit tests for hadoop-hdfs-project/hadoop-hdfs-client and
hadoop-hdfs-project/hadoop-- hdfs-httpfs modules that have all passed
Thanks,
Kitti
On Tue, Aug 7, 2018 at 5:23 PM, Brahma Reddy Battula <br...@gmail.com>
wrote:
> +1 ,(binding).
>
> Wangda Tan thanks for driving this.
>
>
> --Built with source.
> --Installed the HA cluster
> --Ran basic hdfs operations through shell/API
> --Ran Sample jobs like pi, wordcount
> --Browsed UI.
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Kitti Nánási <kn...@cloudera.com.INVALID>.
Thanks Wangda for working on this!
+1 (non-binding)
- checked out git tag release-3.1.1-RC0
- built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
- deployed on a 3 node cluster
- ran terasort, teragen, teravalidate with success
- executed basic hdfs and dfsadmin commands
- executed unit tests for hadoop-hdfs-project/hadoop-hdfs-client and
hadoop-hdfs-project/hadoop-- hdfs-httpfs modules that have all passed
Thanks,
Kitti
On Tue, Aug 7, 2018 at 5:23 PM, Brahma Reddy Battula <br...@gmail.com>
wrote:
> +1 ,(binding).
>
> Wangda Tan thanks for driving this.
>
>
> --Built with source.
> --Installed the HA cluster
> --Ran basic hdfs operations through shell/API
> --Ran Sample jobs like pi, wordcount
> --Browsed UI.
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Kitti Nánási <kn...@cloudera.com.INVALID>.
Thanks Wangda for working on this!
+1 (non-binding)
- checked out git tag release-3.1.1-RC0
- built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
- deployed on a 3 node cluster
- ran terasort, teragen, teravalidate with success
- executed basic hdfs and dfsadmin commands
- executed unit tests for hadoop-hdfs-project/hadoop-hdfs-client and
hadoop-hdfs-project/hadoop-- hdfs-httpfs modules that have all passed
Thanks,
Kitti
On Tue, Aug 7, 2018 at 5:23 PM, Brahma Reddy Battula <br...@gmail.com>
wrote:
> +1 ,(binding).
>
> Wangda Tan thanks for driving this.
>
>
> --Built with source.
> --Installed the HA cluster
> --Ran basic hdfs operations through shell/API
> --Ran Sample jobs like pi, wordcount
> --Browsed UI.
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Brahma Reddy Battula <br...@gmail.com>.
+1 ,(binding).
Wangda Tan thanks for driving this.
--Built with source.
--Installed the HA cluster
--Ran basic hdfs operations through shell/API
--Ran Sample jobs like pi, wordcount
--Browsed UI.
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Includes these additional votings we got 5 binding votings, and 12
non-binding votings, we have many others like Bibin/Akhil gave offline
suggestions and testing results. Thanks everyone for your help!
I've done most of staging/pushing works for the 3.1.1 release. Given Apache
mirrors will take some time to finish syncing tasks, I plan to send out the
release announcement by Thu noon PDT time. If there anything wanna to
highlight for the announcement of 3.1.1, please let me know by Thu 10 AM
PDT.
Thanks again for your help of the release!
Best,
Wangda
On Tue, Aug 7, 2018 at 7:57 PM Chandni Singh <si...@gmail.com>
wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source and ran a single node cluster
> - Ran the example pi job
> - Launched yarn service sleep example
> - Verified upgrade of yarn service sleep
>
> Thanks,
> Chandni
>
>
> On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> Thanks Wangda!
>>
>> +1 (non-binding)
>>
>> Tested the following:
>> - Built from source
>> - Setup single node cluster
>> - Tested Dynamic queues
>> - Tested MR and DS with default, docker runtime
>> - Tested Yarn Services with various restart policies
>>
>> Thanks
>> Suma
>>
>>
>> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <erichadoop-1@yahoo.com
>> .invalid>
>> wrote:
>>
>> > Thanks Wangda for creating this release.
>> >
>> > +1 (binding)
>> > Tested:
>> > - Built from source
>> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
>> > hierarchical queue structure (CS)
>> > - Refreshed queue (CS) properties
>> > - Intra-queue preemption (CS)
>> > - inter-queue preemption (CS)
>> > - User weights (CS)
>> >
>> > Issues:
>> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
>> > when the queue balancing feature is enabled. This does not seem to be
>> > specific to this release.
>> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
>> > to always be enabled, but again, that is not specific to this release.
>> >
>> >
>> > Eric
>> >
>> >
>> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
>> > wheeleast@gmail.com> wrote:
>> >
>> >
>> >
>> >
>> >
>> > Hi folks,
>> >
>> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
>> here:
>> >
>> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>> >
>> > The RC tag in git is release-3.1.1-RC0:
>> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>> >
>> > The maven artifacts are available via repository.apache.org at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>> >
>> > You can find my public key at
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > This vote will run 5 days from now.
>> >
>> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Best,
>> > Wangda Tan
>> >
>> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
>> > ORDER BY priority DESC
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Includes these additional votings we got 5 binding votings, and 12
non-binding votings, we have many others like Bibin/Akhil gave offline
suggestions and testing results. Thanks everyone for your help!
I've done most of staging/pushing works for the 3.1.1 release. Given Apache
mirrors will take some time to finish syncing tasks, I plan to send out the
release announcement by Thu noon PDT time. If there anything wanna to
highlight for the announcement of 3.1.1, please let me know by Thu 10 AM
PDT.
Thanks again for your help of the release!
Best,
Wangda
On Tue, Aug 7, 2018 at 7:57 PM Chandni Singh <si...@gmail.com>
wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source and ran a single node cluster
> - Ran the example pi job
> - Launched yarn service sleep example
> - Verified upgrade of yarn service sleep
>
> Thanks,
> Chandni
>
>
> On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> Thanks Wangda!
>>
>> +1 (non-binding)
>>
>> Tested the following:
>> - Built from source
>> - Setup single node cluster
>> - Tested Dynamic queues
>> - Tested MR and DS with default, docker runtime
>> - Tested Yarn Services with various restart policies
>>
>> Thanks
>> Suma
>>
>>
>> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <erichadoop-1@yahoo.com
>> .invalid>
>> wrote:
>>
>> > Thanks Wangda for creating this release.
>> >
>> > +1 (binding)
>> > Tested:
>> > - Built from source
>> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
>> > hierarchical queue structure (CS)
>> > - Refreshed queue (CS) properties
>> > - Intra-queue preemption (CS)
>> > - inter-queue preemption (CS)
>> > - User weights (CS)
>> >
>> > Issues:
>> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
>> > when the queue balancing feature is enabled. This does not seem to be
>> > specific to this release.
>> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
>> > to always be enabled, but again, that is not specific to this release.
>> >
>> >
>> > Eric
>> >
>> >
>> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
>> > wheeleast@gmail.com> wrote:
>> >
>> >
>> >
>> >
>> >
>> > Hi folks,
>> >
>> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
>> here:
>> >
>> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>> >
>> > The RC tag in git is release-3.1.1-RC0:
>> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>> >
>> > The maven artifacts are available via repository.apache.org at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>> >
>> > You can find my public key at
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > This vote will run 5 days from now.
>> >
>> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Best,
>> > Wangda Tan
>> >
>> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
>> > ORDER BY priority DESC
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Includes these additional votings we got 5 binding votings, and 12
non-binding votings, we have many others like Bibin/Akhil gave offline
suggestions and testing results. Thanks everyone for your help!
I've done most of staging/pushing works for the 3.1.1 release. Given Apache
mirrors will take some time to finish syncing tasks, I plan to send out the
release announcement by Thu noon PDT time. If there anything wanna to
highlight for the announcement of 3.1.1, please let me know by Thu 10 AM
PDT.
Thanks again for your help of the release!
Best,
Wangda
On Tue, Aug 7, 2018 at 7:57 PM Chandni Singh <si...@gmail.com>
wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source and ran a single node cluster
> - Ran the example pi job
> - Launched yarn service sleep example
> - Verified upgrade of yarn service sleep
>
> Thanks,
> Chandni
>
>
> On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> Thanks Wangda!
>>
>> +1 (non-binding)
>>
>> Tested the following:
>> - Built from source
>> - Setup single node cluster
>> - Tested Dynamic queues
>> - Tested MR and DS with default, docker runtime
>> - Tested Yarn Services with various restart policies
>>
>> Thanks
>> Suma
>>
>>
>> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <erichadoop-1@yahoo.com
>> .invalid>
>> wrote:
>>
>> > Thanks Wangda for creating this release.
>> >
>> > +1 (binding)
>> > Tested:
>> > - Built from source
>> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
>> > hierarchical queue structure (CS)
>> > - Refreshed queue (CS) properties
>> > - Intra-queue preemption (CS)
>> > - inter-queue preemption (CS)
>> > - User weights (CS)
>> >
>> > Issues:
>> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
>> > when the queue balancing feature is enabled. This does not seem to be
>> > specific to this release.
>> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
>> > to always be enabled, but again, that is not specific to this release.
>> >
>> >
>> > Eric
>> >
>> >
>> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
>> > wheeleast@gmail.com> wrote:
>> >
>> >
>> >
>> >
>> >
>> > Hi folks,
>> >
>> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
>> here:
>> >
>> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>> >
>> > The RC tag in git is release-3.1.1-RC0:
>> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>> >
>> > The maven artifacts are available via repository.apache.org at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>> >
>> > You can find my public key at
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > This vote will run 5 days from now.
>> >
>> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Best,
>> > Wangda Tan
>> >
>> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
>> > ORDER BY priority DESC
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Includes these additional votings we got 5 binding votings, and 12
non-binding votings, we have many others like Bibin/Akhil gave offline
suggestions and testing results. Thanks everyone for your help!
I've done most of staging/pushing works for the 3.1.1 release. Given Apache
mirrors will take some time to finish syncing tasks, I plan to send out the
release announcement by Thu noon PDT time. If there anything wanna to
highlight for the announcement of 3.1.1, please let me know by Thu 10 AM
PDT.
Thanks again for your help of the release!
Best,
Wangda
On Tue, Aug 7, 2018 at 7:57 PM Chandni Singh <si...@gmail.com>
wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source and ran a single node cluster
> - Ran the example pi job
> - Launched yarn service sleep example
> - Verified upgrade of yarn service sleep
>
> Thanks,
> Chandni
>
>
> On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
> sumasai.shivaprasad@gmail.com> wrote:
>
>> Thanks Wangda!
>>
>> +1 (non-binding)
>>
>> Tested the following:
>> - Built from source
>> - Setup single node cluster
>> - Tested Dynamic queues
>> - Tested MR and DS with default, docker runtime
>> - Tested Yarn Services with various restart policies
>>
>> Thanks
>> Suma
>>
>>
>> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <erichadoop-1@yahoo.com
>> .invalid>
>> wrote:
>>
>> > Thanks Wangda for creating this release.
>> >
>> > +1 (binding)
>> > Tested:
>> > - Built from source
>> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
>> > hierarchical queue structure (CS)
>> > - Refreshed queue (CS) properties
>> > - Intra-queue preemption (CS)
>> > - inter-queue preemption (CS)
>> > - User weights (CS)
>> >
>> > Issues:
>> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
>> > when the queue balancing feature is enabled. This does not seem to be
>> > specific to this release.
>> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
>> > to always be enabled, but again, that is not specific to this release.
>> >
>> >
>> > Eric
>> >
>> >
>> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
>> > wheeleast@gmail.com> wrote:
>> >
>> >
>> >
>> >
>> >
>> > Hi folks,
>> >
>> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
>> here:
>> >
>> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>> >
>> > The RC tag in git is release-3.1.1-RC0:
>> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>> >
>> > The maven artifacts are available via repository.apache.org at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>> >
>> > You can find my public key at
>> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>> >
>> > This vote will run 5 days from now.
>> >
>> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Best,
>> > Wangda Tan
>> >
>> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
>> > ORDER BY priority DESC
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Chandni Singh <si...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source and ran a single node cluster
- Ran the example pi job
- Launched yarn service sleep example
- Verified upgrade of yarn service sleep
Thanks,
Chandni
On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
sumasai.shivaprasad@gmail.com> wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source
> - Setup single node cluster
> - Tested Dynamic queues
> - Tested MR and DS with default, docker runtime
> - Tested Yarn Services with various restart policies
>
> Thanks
> Suma
>
>
> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
> wrote:
>
> > Thanks Wangda for creating this release.
> >
> > +1 (binding)
> > Tested:
> > - Built from source
> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> > hierarchical queue structure (CS)
> > - Refreshed queue (CS) properties
> > - Intra-queue preemption (CS)
> > - inter-queue preemption (CS)
> > - User weights (CS)
> >
> > Issues:
> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> > when the queue balancing feature is enabled. This does not seem to be
> > specific to this release.
> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
> > to always be enabled, but again, that is not specific to this release.
> >
> >
> > Eric
> >
> >
> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> > wheeleast@gmail.com> wrote:
> >
> >
> >
> >
> >
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Chandni Singh <si...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source and ran a single node cluster
- Ran the example pi job
- Launched yarn service sleep example
- Verified upgrade of yarn service sleep
Thanks,
Chandni
On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
sumasai.shivaprasad@gmail.com> wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source
> - Setup single node cluster
> - Tested Dynamic queues
> - Tested MR and DS with default, docker runtime
> - Tested Yarn Services with various restart policies
>
> Thanks
> Suma
>
>
> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
> wrote:
>
> > Thanks Wangda for creating this release.
> >
> > +1 (binding)
> > Tested:
> > - Built from source
> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> > hierarchical queue structure (CS)
> > - Refreshed queue (CS) properties
> > - Intra-queue preemption (CS)
> > - inter-queue preemption (CS)
> > - User weights (CS)
> >
> > Issues:
> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> > when the queue balancing feature is enabled. This does not seem to be
> > specific to this release.
> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
> > to always be enabled, but again, that is not specific to this release.
> >
> >
> > Eric
> >
> >
> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> > wheeleast@gmail.com> wrote:
> >
> >
> >
> >
> >
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Chandni Singh <si...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source and ran a single node cluster
- Ran the example pi job
- Launched yarn service sleep example
- Verified upgrade of yarn service sleep
Thanks,
Chandni
On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
sumasai.shivaprasad@gmail.com> wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source
> - Setup single node cluster
> - Tested Dynamic queues
> - Tested MR and DS with default, docker runtime
> - Tested Yarn Services with various restart policies
>
> Thanks
> Suma
>
>
> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
> wrote:
>
> > Thanks Wangda for creating this release.
> >
> > +1 (binding)
> > Tested:
> > - Built from source
> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> > hierarchical queue structure (CS)
> > - Refreshed queue (CS) properties
> > - Intra-queue preemption (CS)
> > - inter-queue preemption (CS)
> > - User weights (CS)
> >
> > Issues:
> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> > when the queue balancing feature is enabled. This does not seem to be
> > specific to this release.
> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
> > to always be enabled, but again, that is not specific to this release.
> >
> >
> > Eric
> >
> >
> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> > wheeleast@gmail.com> wrote:
> >
> >
> >
> >
> >
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Chandni Singh <si...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source and ran a single node cluster
- Ran the example pi job
- Launched yarn service sleep example
- Verified upgrade of yarn service sleep
Thanks,
Chandni
On Tue, Aug 7, 2018 at 7:02 PM Suma Shivaprasad <
sumasai.shivaprasad@gmail.com> wrote:
> Thanks Wangda!
>
> +1 (non-binding)
>
> Tested the following:
> - Built from source
> - Setup single node cluster
> - Tested Dynamic queues
> - Tested MR and DS with default, docker runtime
> - Tested Yarn Services with various restart policies
>
> Thanks
> Suma
>
>
> On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
> wrote:
>
> > Thanks Wangda for creating this release.
> >
> > +1 (binding)
> > Tested:
> > - Built from source
> > - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> > hierarchical queue structure (CS)
> > - Refreshed queue (CS) properties
> > - Intra-queue preemption (CS)
> > - inter-queue preemption (CS)
> > - User weights (CS)
> >
> > Issues:
> > - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> > when the queue balancing feature is enabled. This does not seem to be
> > specific to this release.
> > - The preemption-to-balance-queue-after-satisfied.enabled property seems
> > to always be enabled, but again, that is not specific to this release.
> >
> >
> > Eric
> >
> >
> > On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> > wheeleast@gmail.com> wrote:
> >
> >
> >
> >
> >
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Suma Shivaprasad <su...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source
- Setup single node cluster
- Tested Dynamic queues
- Tested MR and DS with default, docker runtime
- Tested Yarn Services with various restart policies
Thanks
Suma
On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
wrote:
> Thanks Wangda for creating this release.
>
> +1 (binding)
> Tested:
> - Built from source
> - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> hierarchical queue structure (CS)
> - Refreshed queue (CS) properties
> - Intra-queue preemption (CS)
> - inter-queue preemption (CS)
> - User weights (CS)
>
> Issues:
> - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> when the queue balancing feature is enabled. This does not seem to be
> specific to this release.
> - The preemption-to-balance-queue-after-satisfied.enabled property seems
> to always be enabled, but again, that is not specific to this release.
>
>
> Eric
>
>
> On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> wheeleast@gmail.com> wrote:
>
>
>
>
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Suma Shivaprasad <su...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source
- Setup single node cluster
- Tested Dynamic queues
- Tested MR and DS with default, docker runtime
- Tested Yarn Services with various restart policies
Thanks
Suma
On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
wrote:
> Thanks Wangda for creating this release.
>
> +1 (binding)
> Tested:
> - Built from source
> - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> hierarchical queue structure (CS)
> - Refreshed queue (CS) properties
> - Intra-queue preemption (CS)
> - inter-queue preemption (CS)
> - User weights (CS)
>
> Issues:
> - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> when the queue balancing feature is enabled. This does not seem to be
> specific to this release.
> - The preemption-to-balance-queue-after-satisfied.enabled property seems
> to always be enabled, but again, that is not specific to this release.
>
>
> Eric
>
>
> On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> wheeleast@gmail.com> wrote:
>
>
>
>
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Suma Shivaprasad <su...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source
- Setup single node cluster
- Tested Dynamic queues
- Tested MR and DS with default, docker runtime
- Tested Yarn Services with various restart policies
Thanks
Suma
On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
wrote:
> Thanks Wangda for creating this release.
>
> +1 (binding)
> Tested:
> - Built from source
> - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> hierarchical queue structure (CS)
> - Refreshed queue (CS) properties
> - Intra-queue preemption (CS)
> - inter-queue preemption (CS)
> - User weights (CS)
>
> Issues:
> - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> when the queue balancing feature is enabled. This does not seem to be
> specific to this release.
> - The preemption-to-balance-queue-after-satisfied.enabled property seems
> to always be enabled, but again, that is not specific to this release.
>
>
> Eric
>
>
> On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> wheeleast@gmail.com> wrote:
>
>
>
>
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Suma Shivaprasad <su...@gmail.com>.
Thanks Wangda!
+1 (non-binding)
Tested the following:
- Built from source
- Setup single node cluster
- Tested Dynamic queues
- Tested MR and DS with default, docker runtime
- Tested Yarn Services with various restart policies
Thanks
Suma
On Tue, Aug 7, 2018 at 2:45 PM Eric Payne <er...@yahoo.com.invalid>
wrote:
> Thanks Wangda for creating this release.
>
> +1 (binding)
> Tested:
> - Built from source
> - Deployed to 6-node, multi-tennant, unsecured pseudo cluster with
> hierarchical queue structure (CS)
> - Refreshed queue (CS) properties
> - Intra-queue preemption (CS)
> - inter-queue preemption (CS)
> - User weights (CS)
>
> Issues:
> - Inter-queue preemption seems to be preempting unnecessarily (flapping)
> when the queue balancing feature is enabled. This does not seem to be
> specific to this release.
> - The preemption-to-balance-queue-after-satisfied.enabled property seems
> to always be enabled, but again, that is not specific to this release.
>
>
> Eric
>
>
> On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <
> wheeleast@gmail.com> wrote:
>
>
>
>
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Wangda for creating this release.
+1 (binding)
Tested:
- Built from source
- Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS)
- Refreshed queue (CS) properties
- Intra-queue preemption (CS)
- inter-queue preemption (CS)
- User weights (CS)
Issues:
- Inter-queue preemption seems to be preempting unnecessarily (flapping) when the queue balancing feature is enabled. This does not seem to be specific to this release.
- The preemption-to-balance-queue-after-satisfied.enabled property seems to always be enabled, but again, that is not specific to this release.
Eric
On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all hashes and checksums
- Built from source on macOS 10.13.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs
On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee <
sbanerjee@hortonworks.com> wrote:
> +1(non-binding)
>
> * checked out git tag release-3.1.1-RC0
> * built from source
> * deployed on a single node cluster
> * executed basic dfs commands
> * executed some snapshot commands
>
> Thank you very much the work Wangda.
>
> Thanks
> Shashi
>
> On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
>
>
> +1 (non-binding)
>
> 1. Built from the source package.
> 2. Checked the signature
> 3. Started docker based pseudo cluster and smoketested some basic
> functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word
> count
> job)
>
> Thank you very much the work Wangda.
> Marton
>
>
> On 08/02/2018 08:43 PM, Wangda Tan wrote:
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are
> available here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/
> orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job.
> My +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> > ORDER BY priority DESC
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all hashes and checksums
- Built from source on macOS 10.13.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs
On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee <
sbanerjee@hortonworks.com> wrote:
> +1(non-binding)
>
> * checked out git tag release-3.1.1-RC0
> * built from source
> * deployed on a single node cluster
> * executed basic dfs commands
> * executed some snapshot commands
>
> Thank you very much the work Wangda.
>
> Thanks
> Shashi
>
> On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
>
>
> +1 (non-binding)
>
> 1. Built from the source package.
> 2. Checked the signature
> 3. Started docker based pseudo cluster and smoketested some basic
> functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word
> count
> job)
>
> Thank you very much the work Wangda.
> Marton
>
>
> On 08/02/2018 08:43 PM, Wangda Tan wrote:
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are
> available here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/
> orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job.
> My +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> > ORDER BY priority DESC
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all hashes and checksums
- Built from source on macOS 10.13.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs
On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee <
sbanerjee@hortonworks.com> wrote:
> +1(non-binding)
>
> * checked out git tag release-3.1.1-RC0
> * built from source
> * deployed on a single node cluster
> * executed basic dfs commands
> * executed some snapshot commands
>
> Thank you very much the work Wangda.
>
> Thanks
> Shashi
>
> On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
>
>
> +1 (non-binding)
>
> 1. Built from the source package.
> 2. Checked the signature
> 3. Started docker based pseudo cluster and smoketested some basic
> functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word
> count
> job)
>
> Thank you very much the work Wangda.
> Marton
>
>
> On 08/02/2018 08:43 PM, Wangda Tan wrote:
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are
> available here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/
> orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job.
> My +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> > ORDER BY priority DESC
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all hashes and checksums
- Built from source on macOS 10.13.6, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs
On Tue, Aug 7, 2018 at 8:46 AM, Shashikant Banerjee <
sbanerjee@hortonworks.com> wrote:
> +1(non-binding)
>
> * checked out git tag release-3.1.1-RC0
> * built from source
> * deployed on a single node cluster
> * executed basic dfs commands
> * executed some snapshot commands
>
> Thank you very much the work Wangda.
>
> Thanks
> Shashi
>
> On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
>
>
> +1 (non-binding)
>
> 1. Built from the source package.
> 2. Checked the signature
> 3. Started docker based pseudo cluster and smoketested some basic
> functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word
> count
> job)
>
> Thank you very much the work Wangda.
> Marton
>
>
> On 08/02/2018 08:43 PM, Wangda Tan wrote:
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are
> available here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/
> orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job.
> My +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> > ORDER BY priority DESC
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1(non-binding)
* checked out git tag release-3.1.1-RC0
* built from source
* deployed on a single node cluster
* executed basic dfs commands
* executed some snapshot commands
Thank you very much the work Wangda.
Thanks
Shashi
On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1(non-binding)
* checked out git tag release-3.1.1-RC0
* built from source
* deployed on a single node cluster
* executed basic dfs commands
* executed some snapshot commands
Thank you very much the work Wangda.
Thanks
Shashi
On 8/7/18, 6:43 PM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Zsolt Venczel <zv...@cloudera.com.INVALID>.
Thanks for your efforts Wangda!
+1 (non-binding)
* checked out git tag release-3.1.1-RC0
* built from source on Ubuntu 16.04, java 8u161-oracle
* deployed on a 4 node cluster
* executed snapshot commands: create, diff, checked file presence in
.snapshot directory
* execute map-reduce examples: teragen, terasort, teravalidate
* checked out web UI: file browser, snapshots
* executed unit tests for hadoop-hdfs-project/hadoop-hdfs module that have
all passed
Best regards,
Zsolt
On Tue, Aug 7, 2018 at 12:28 PM Sunil G <su...@apache.org> wrote:
> Thanks Wangda for the initiative.
> +1 for this RC.
> I have tested this RC built from source file.
>
> - Also ran few MR apps and verified both new YARN UI and old RM UI.
> - Tested Application priority and timeout
> - Inter Queue and Intra Queue Preemption cases were also verified
> - Tested basic placement constraints with DS.
> - Tested NodeLabel scenarios.
> - Tested new YARN UI with ATS v2
>
> - Sunil
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Zsolt Venczel <zv...@cloudera.com.INVALID>.
Thanks for your efforts Wangda!
+1 (non-binding)
* checked out git tag release-3.1.1-RC0
* built from source on Ubuntu 16.04, java 8u161-oracle
* deployed on a 4 node cluster
* executed snapshot commands: create, diff, checked file presence in
.snapshot directory
* execute map-reduce examples: teragen, terasort, teravalidate
* checked out web UI: file browser, snapshots
* executed unit tests for hadoop-hdfs-project/hadoop-hdfs module that have
all passed
Best regards,
Zsolt
On Tue, Aug 7, 2018 at 12:28 PM Sunil G <su...@apache.org> wrote:
> Thanks Wangda for the initiative.
> +1 for this RC.
> I have tested this RC built from source file.
>
> - Also ran few MR apps and verified both new YARN UI and old RM UI.
> - Tested Application priority and timeout
> - Inter Queue and Intra Queue Preemption cases were also verified
> - Tested basic placement constraints with DS.
> - Tested NodeLabel scenarios.
> - Tested new YARN UI with ATS v2
>
> - Sunil
>
> On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
>
> > Hi folks,
> >
> > I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
> >
> > http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
> >
> > The RC tag in git is release-3.1.1-RC0:
> > https://github.com/apache/hadoop/commits/release-3.1.1-RC0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1139/
> >
> > You can find my public key at
> > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
> >
> > This vote will run 5 days from now.
> >
> > 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Best,
> > Wangda Tan
> >
> > [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> > ORDER BY priority DESC
> >
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Sunil G <su...@apache.org>.
Thanks Wangda for the initiative.
+1 for this RC.
I have tested this RC built from source file.
- Also ran few MR apps and verified both new YARN UI and old RM UI.
- Tested Application priority and timeout
- Inter Queue and Intra Queue Preemption cases were also verified
- Tested basic placement constraints with DS.
- Tested NodeLabel scenarios.
- Tested new YARN UI with ATS v2
- Sunil
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Brahma Reddy Battula <br...@gmail.com>.
+1 ,(binding).
Wangda Tan thanks for driving this.
--Built with source.
--Installed the HA cluster
--Ran basic hdfs operations through shell/API
--Ran Sample jobs like pi, wordcount
--Browsed UI.
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Wangda for creating this release.
+1 (binding)
Tested:
- Built from source
- Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS)
- Refreshed queue (CS) properties
- Intra-queue preemption (CS)
- inter-queue preemption (CS)
- User weights (CS)
Issues:
- Inter-queue preemption seems to be preempting unnecessarily (flapping) when the queue balancing feature is enabled. This does not seem to be specific to this release.
- The preemption-to-balance-queue-after-satisfied.enabled property seems to always be enabled, but again, that is not specific to this release.
Eric
On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Sunil G <su...@apache.org>.
Thanks Wangda for the initiative.
+1 for this RC.
I have tested this RC built from source file.
- Also ran few MR apps and verified both new YARN UI and old RM UI.
- Tested Application priority and timeout
- Inter Queue and Intra Queue Preemption cases were also verified
- Tested basic placement constraints with DS.
- Tested NodeLabel scenarios.
- Tested new YARN UI with ATS v2
- Sunil
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Thanks for the work Wangda Tan!
+1 (non-binding)
checked out git tag release-3.1.1-RC0
hadoop-aws integration (mvn verify) test run was successful on eu-west-1
built from source on Mac OS X 10.13.6, java version 8.0.181-oracle
deployed on a 3 node cluster
verified pi job (yarn), teragen, terasort and teravalidate
Regards,
Gabor Bota
On Thu, Aug 2, 2018 at 8:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Brahma Reddy Battula <br...@gmail.com>.
+1 ,(binding).
Wangda Tan thanks for driving this.
--Built with source.
--Installed the HA cluster
--Ran basic hdfs operations through shell/API
--Ran Sample jobs like pi, wordcount
--Browsed UI.
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shane Kumpf <sh...@gmail.com>.
+1 (binding) - Thanks for putting this together Wangda.
- Built from source
- Deployed a single node cluster on CentOS 7.4
- Basic dfs command checkout
- Ran dshell, MR pi, and MR sleep with the default and docker runtimes
- Validated the ability to disable the docker runtime
- Validated the ability to disable privileged docker containers
- Successfully launched a docker based YARN service
- Validated basic lookups against Registry DNS
-Shane
On Thu, Aug 2, 2018 at 12:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Brahma Reddy Battula <br...@gmail.com>.
+1 ,(binding).
Wangda Tan thanks for driving this.
--Built with source.
--Installed the HA cluster
--Ran basic hdfs operations through shell/API
--Ran Sample jobs like pi, wordcount
--Browsed UI.
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Wangda for creating this release.
+1 (binding)
Tested:
- Built from source
- Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS)
- Refreshed queue (CS) properties
- Intra-queue preemption (CS)
- inter-queue preemption (CS)
- User weights (CS)
Issues:
- Inter-queue preemption seems to be preempting unnecessarily (flapping) when the queue balancing feature is enabled. This does not seem to be specific to this release.
- The preemption-to-balance-queue-after-satisfied.enabled property seems to always be enabled, but again, that is not specific to this release.
Eric
On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Sunil G <su...@apache.org>.
Thanks Wangda for the initiative.
+1 for this RC.
I have tested this RC built from source file.
- Also ran few MR apps and verified both new YARN UI and old RM UI.
- Tested Application priority and timeout
- Inter Queue and Intra Queue Preemption cases were also verified
- Tested basic placement constraints with DS.
- Tested NodeLabel scenarios.
- Tested new YARN UI with ATS v2
- Sunil
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
- Built from source and deployed 2 node RM HA non-secure cluster
- ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0.
- Ran sample MR and DS applications
- Verified for RM HA, Work preserving restart, NM work preserving restart.
- Verified jobs for application priority and application timeout.
- Accessed UI2 for all web pages. Verified for UI2+ATSv2 integration web
pages.
-Rohith Sharma K S
On Fri, 3 Aug 2018 at 00:14, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Thanks everyone for voting!
With 4 binding votes, 10 non-binding votes and no veto. The vote passed,
I'm going to work on staging the release.
Best,
Wangda
On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu <
nvadivelu@hortonworks.com> wrote:
> Thanks for all the hard work Wangda!
> +1
>
> * Verified pgp signatures
> * Verified MD5 checksums
> * Verified both source and binary releases
> * Installed pseudo distributed cluster
> * Verified hdfs filesystem commands
> * Verified hdfs admin commands
> * Verified hdfs snapshot commands
> * Basic sanity check on NN UI
>
> Issue found
> * In "Browse the file system" under "Utilities" tab in NN UI, "Head the
> file" and "Tail the file" are not working.
>
> -Nanda
>
> On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> ORDER BY priority DESC
>
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Thanks everyone for voting!
With 4 binding votes, 10 non-binding votes and no veto. The vote passed,
I'm going to work on staging the release.
Best,
Wangda
On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu <
nvadivelu@hortonworks.com> wrote:
> Thanks for all the hard work Wangda!
> +1
>
> * Verified pgp signatures
> * Verified MD5 checksums
> * Verified both source and binary releases
> * Installed pseudo distributed cluster
> * Verified hdfs filesystem commands
> * Verified hdfs admin commands
> * Verified hdfs snapshot commands
> * Basic sanity check on NN UI
>
> Issue found
> * In "Browse the file system" under "Utilities" tab in NN UI, "Head the
> file" and "Tail the file" are not working.
>
> -Nanda
>
> On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> ORDER BY priority DESC
>
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Thanks everyone for voting!
With 4 binding votes, 10 non-binding votes and no veto. The vote passed,
I'm going to work on staging the release.
Best,
Wangda
On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu <
nvadivelu@hortonworks.com> wrote:
> Thanks for all the hard work Wangda!
> +1
>
> * Verified pgp signatures
> * Verified MD5 checksums
> * Verified both source and binary releases
> * Installed pseudo distributed cluster
> * Verified hdfs filesystem commands
> * Verified hdfs admin commands
> * Verified hdfs snapshot commands
> * Basic sanity check on NN UI
>
> Issue found
> * In "Browse the file system" under "Utilities" tab in NN UI, "Head the
> file" and "Tail the file" are not working.
>
> -Nanda
>
> On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> ORDER BY priority DESC
>
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Wangda Tan <wh...@gmail.com>.
Thanks everyone for voting!
With 4 binding votes, 10 non-binding votes and no veto. The vote passed,
I'm going to work on staging the release.
Best,
Wangda
On Tue, Aug 7, 2018 at 12:33 PM Nandakumar Vadivelu <
nvadivelu@hortonworks.com> wrote:
> Thanks for all the hard work Wangda!
> +1
>
> * Verified pgp signatures
> * Verified MD5 checksums
> * Verified both source and binary releases
> * Installed pseudo distributed cluster
> * Verified hdfs filesystem commands
> * Verified hdfs admin commands
> * Verified hdfs snapshot commands
> * Basic sanity check on NN UI
>
> Issue found
> * In "Browse the file system" under "Utilities" tab in NN UI, "Head the
> file" and "Tail the file" are not working.
>
> -Nanda
>
> On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
>
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available
> here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in
> (3.1.1)
> ORDER BY priority DESC
>
>
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Nandakumar Vadivelu <nv...@hortonworks.com>.
Thanks for all the hard work Wangda!
+1
* Verified pgp signatures
* Verified MD5 checksums
* Verified both source and binary releases
* Installed pseudo distributed cluster
* Verified hdfs filesystem commands
* Verified hdfs admin commands
* Verified hdfs snapshot commands
* Basic sanity check on NN UI
Issue found
* In "Browse the file system" under "Utilities" tab in NN UI, "Head the file" and "Tail the file" are not working.
-Nanda
On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
- Built from source and deployed 2 node RM HA non-secure cluster
- ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0.
- Ran sample MR and DS applications
- Verified for RM HA, Work preserving restart, NM work preserving restart.
- Verified jobs for application priority and application timeout.
- Accessed UI2 for all web pages. Verified for UI2+ATSv2 integration web
pages.
-Rohith Sharma K S
On Fri, 3 Aug 2018 at 00:14, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Gabor Bota <ga...@cloudera.com.INVALID>.
Thanks for the work Wangda Tan!
+1 (non-binding)
checked out git tag release-3.1.1-RC0
hadoop-aws integration (mvn verify) test run was successful on eu-west-1
built from source on Mac OS X 10.13.6, java version 8.0.181-oracle
deployed on a 3 node cluster
verified pi job (yarn), teragen, terasort and teravalidate
Regards,
Gabor Bota
On Thu, Aug 2, 2018 at 8:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Nandakumar Vadivelu <nv...@hortonworks.com>.
Thanks for all the hard work Wangda!
+1
* Verified pgp signatures
* Verified MD5 checksums
* Verified both source and binary releases
* Installed pseudo distributed cluster
* Verified hdfs filesystem commands
* Verified hdfs admin commands
* Verified hdfs snapshot commands
* Basic sanity check on NN UI
Issue found
* In "Browse the file system" under "Utilities" tab in NN UI, "Head the file" and "Tail the file" are not working.
-Nanda
On 8/3/18, 12:14 AM, "Wangda Tan" <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
- Built from source and deployed 2 node RM HA non-secure cluster
- ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0.
- Ran sample MR and DS applications
- Verified for RM HA, Work preserving restart, NM work preserving restart.
- Verified jobs for application priority and application timeout.
- Accessed UI2 for all web pages. Verified for UI2+ATSv2 integration web
pages.
-Rohith Sharma K S
On Fri, 3 Aug 2018 at 00:14, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shane Kumpf <sh...@gmail.com>.
+1 (binding) - Thanks for putting this together Wangda.
- Built from source
- Deployed a single node cluster on CentOS 7.4
- Basic dfs command checkout
- Ran dshell, MR pi, and MR sleep with the default and docker runtimes
- Validated the ability to disable the docker runtime
- Validated the ability to disable privileged docker containers
- Successfully launched a docker based YARN service
- Validated basic lookups against Registry DNS
-Shane
On Thu, Aug 2, 2018 at 12:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Shane Kumpf <sh...@gmail.com>.
+1 (binding) - Thanks for putting this together Wangda.
- Built from source
- Deployed a single node cluster on CentOS 7.4
- Basic dfs command checkout
- Ran dshell, MR pi, and MR sleep with the default and docker runtimes
- Validated the ability to disable the docker runtime
- Validated the ability to disable privileged docker containers
- Successfully launched a docker based YARN service
- Validated basic lookups against Registry DNS
-Shane
On Thu, Aug 2, 2018 at 12:44 PM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
- Built from source and deployed 2 node RM HA non-secure cluster
- ATSv2 enabled for profile hbase.profile=2.0. Enabled both ats 1.5 and 2.0.
- Ran sample MR and DS applications
- Verified for RM HA, Work preserving restart, NM work preserving restart.
- Verified jobs for application priority and application timeout.
- Accessed UI2 for all web pages. Verified for UI2+ATSv2 integration web
pages.
-Rohith Sharma K S
On Fri, 3 Aug 2018 at 00:14, Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Sunil G <su...@apache.org>.
Thanks Wangda for the initiative.
+1 for this RC.
I have tested this RC built from source file.
- Also ran few MR apps and verified both new YARN UI and old RM UI.
- Tested Application priority and timeout
- Inter Queue and Intra Queue Preemption cases were also verified
- Tested basic placement constraints with DS.
- Tested NodeLabel scenarios.
- Tested new YARN UI with ATS v2
- Sunil
On Fri, Aug 3, 2018 at 12:14 AM Wangda Tan <wh...@gmail.com> wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
Thanks Wangda for creating this release.
+1 (binding)
Tested:
- Built from source
- Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical queue structure (CS)
- Refreshed queue (CS) properties
- Intra-queue preemption (CS)
- inter-queue preemption (CS)
- User weights (CS)
Issues:
- Inter-queue preemption seems to be preempting unnecessarily (flapping) when the queue balancing feature is enabled. This does not seem to be specific to this release.
- The preemption-to-balance-queue-after-satisfied.enabled property seems to always be enabled, but again, that is not specific to this release.
Eric
On Thursday, August 2, 2018, 1:44:22 PM CDT, Wangda Tan <wh...@gmail.com> wrote:
Hi folks,
I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
The RC tag in git is release-3.1.1-RC0:
https://github.com/apache/hadoop/commits/release-3.1.1-RC0
The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1139/
You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
This vote will run 5 days from now.
3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Best,
Wangda Tan
[1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
ORDER BY priority DESC
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.1.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
1. Built from the source package.
2. Checked the signature
3. Started docker based pseudo cluster and smoketested some basic
functionality (hdfs cli, ec cli, viewfs, yarn examples, spark word count
job)
Thank you very much the work Wangda.
Marton
On 08/02/2018 08:43 PM, Wangda Tan wrote:
> Hi folks,
>
> I've created RC0 for Apache Hadoop 3.1.1. The artifacts are available here:
>
> http://people.apache.org/~wangda/hadoop-3.1.1-RC0/
>
> The RC tag in git is release-3.1.1-RC0:
> https://github.com/apache/hadoop/commits/release-3.1.1-RC0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1139/
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> This vote will run 5 days from now.
>
> 3.1.1 contains 435 [1] fixed JIRA issues since 3.1.0.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Best,
> Wangda Tan
>
> [1] project in (YARN, HADOOP, MAPREDUCE, HDFS) AND fixVersion in (3.1.1)
> ORDER BY priority DESC
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org