You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Andrew Wang <an...@cloudera.com> on 2017/09/29 00:04:17 UTC
[VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Hi all,
Let me start, as always, by thanking the many, many contributors who helped
with this release! I've prepared an RC0 for 3.0.0-beta1:
http://home.apache.org/~wang/3.0.0-beta1-RC0/
This vote will run five days, ending on Nov 3rd at 5PM Pacific.
beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
improvements, and feature enhancements. Notable additions include the
addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
shaded client, and HDFS erasure coding pluggable policy support.
I've done the traditional testing of running a Pi job on a pseudo cluster.
My +1 to start.
We're working internally on getting this run through our integration test
rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
Best,
Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for the additional review Rohith, much appreciated!
On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> +1 (binding)
>
> Built from source and deployed YARN HA cluster with ATSv2 enabled in
> non-secured cluster.
> - tested for RM HA/work-preservring-restart/ NM-work-preserving restart
> for ATSv2 entities.
> - verified all ATSv2 REST end points to retrieve the entities
> - ran sample MR jobs and distributed jobs
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
>
>> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
>> vote passes.
>>
>> I'll get started on pushing out the release.
>>
>> Best,
>> Andrew
>>
>> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>>
>> > +1
>> >
>> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
>> > (both Local and Dynamo metadatastore).
>> >
>> > Everything worked fine except I hit one integration test failure. It
>> is a
>> > minor test issue IMO and I've filed HADOOP-14927
>> >
>> > Failed tests:
>> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe
>> stroyNoBucket:228
>> > Expected an exception, got 0
>> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr
>> oyNoBucket:228
>> > Expected an exception, got 0
>> >
>> >
>> >
>> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
>> > wrote:
>> >
>> >> +1 (non-binding)
>> >>
>> >> - built from source
>> >> - deployed on single node cluster
>> >> - Basic hdfs operations
>> >> - Run wordcount on a text file
>> >> Thanks,
>> >> Ajay
>> >>
>> >>
>> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>> >>
>> >> +1 (non-binding)
>> >>
>> >> - Verified all checksums and signatures
>> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> >> - Deployed a single node pseudo cluster
>> >> - Ran pi and sleep jobs
>> >> - Verified Docker was marked as experimental
>> >>
>> >> Thanks,
>> >>
>> >> Eric
>> >>
>> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> >> wrote:
>> >>
>> >> > +1 (binding)
>> >> >
>> >> > - Verified checksums and signatures of all tarballs
>> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> >> 10.12.6
>> >> > - Verified cloud connectors:
>> >> > - All S3A integration tests
>> >> > - All ADL live unit tests
>> >> > - Deployed both binary and built source to a pseudo cluster,
>> >> passed the
>> >> > following sanity tests in insecure, SSL, and SSL+Kerberos
>> mode:
>> >> > - HDFS basic and ACL
>> >> > - DistCp basic
>> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> >> binary
>> >> > tarball, probably unrelated)
>> >> > - KMS and HttpFS basic
>> >> > - Balancer start/stop
>> >> >
>> >> > Hit the following errors but they don't seem to be blocking:
>> >> >
>> >> > == Missing dependencies during build ==
>> >> >
>> >> > > ERROR: hadoop-aliyun has missing dependencies:
>> json-lib-jdk15.jar
>> >> > > ERROR: hadoop-azure has missing dependencies:
>> >> jetty-util-ajax-9.3.19.
>> >> > > v20170502.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okhttp-2.4.0.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okio-1.4.0.jar
>> >> >
>> >> >
>> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >> >
>> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> >> default HTTP
>> >> > servlet /conf, /stacks, and /logLevel ==
>> >> >
>> >> > One example below:
>> >> >
>> >> > > Connecting to
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer
>> >> > > Exception in thread "main"
>> >> > > org.apache.hadoop.security.authentication.client.
>> >> > AuthenticationException:
>> >> > > Authentication failed, URL:
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer&user.name=jzhuge,
>> >> > > status: 403, message: GSSException: Failure unspecified at
>> >> GSS-API level
>> >> > > (Mechanism level: Request is a replay (34))
>> >> >
>> >> >
>> >> > The /logLevel failure will affect command "hadoop daemonlog".
>> >> >
>> >> >
>> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > wrote:
>> >> >
>> >> > > Thanks for all the votes thus far! We've gotten the binding
>> +1's
>> >> to close
>> >> > > the release, though are there contributors who could kick the
>> >> tires on
>> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> >> merged since
>> >> > > alpha4, so it'd be good to get some coverage.
>> >> > >
>> >> > >
>> >> > >
>> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> > > wrote:
>> >> > >
>> >> > > >
>> >> > > > Thanks Andrew.
>> >> > > >
>> >> > > > +1 (non binding)
>> >> > > >
>> >> > > > --Built from source
>> >> > > > --installed 3 node HA cluster
>> >> > > > --Verified shell commands and UI
>> >> > > > --Ran wordcount/pic jobs
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > > > wrote:
>> >> > > >
>> >> > > >> Hi all,
>> >> > > >>
>> >> > > >> Let me start, as always, by thanking the many, many
>> >> contributors who
>> >> > > >> helped
>> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> >> > > >>
>> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> >> > > >>
>> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
>> Pacific.
>> >> > > >>
>> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> >> bug fixes,
>> >> > > >> improvements, and feature enhancements. Notable additions
>> >> include the
>> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> >> completion of
>> >> > the
>> >> > > >> shaded client, and HDFS erasure coding pluggable policy
>> >> support.
>> >> > > >>
>> >> > > >> I've done the traditional testing of running a Pi job on a
>> >> pseudo
>> >> > > cluster.
>> >> > > >> My +1 to start.
>> >> > > >>
>> >> > > >> We're working internally on getting this run through our
>> >> integration
>> >> > > test
>> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
>> that's
>> >> > complete.
>> >> > > >>
>> >> > > >> Best,
>> >> > > >> Andrew
>> >> > > >>
>> >> > > > --
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --Brahma Reddy Battula
>> >> > > >
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > John
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for the additional review Rohith, much appreciated!
On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> +1 (binding)
>
> Built from source and deployed YARN HA cluster with ATSv2 enabled in
> non-secured cluster.
> - tested for RM HA/work-preservring-restart/ NM-work-preserving restart
> for ATSv2 entities.
> - verified all ATSv2 REST end points to retrieve the entities
> - ran sample MR jobs and distributed jobs
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
>
>> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
>> vote passes.
>>
>> I'll get started on pushing out the release.
>>
>> Best,
>> Andrew
>>
>> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>>
>> > +1
>> >
>> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
>> > (both Local and Dynamo metadatastore).
>> >
>> > Everything worked fine except I hit one integration test failure. It
>> is a
>> > minor test issue IMO and I've filed HADOOP-14927
>> >
>> > Failed tests:
>> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe
>> stroyNoBucket:228
>> > Expected an exception, got 0
>> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr
>> oyNoBucket:228
>> > Expected an exception, got 0
>> >
>> >
>> >
>> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
>> > wrote:
>> >
>> >> +1 (non-binding)
>> >>
>> >> - built from source
>> >> - deployed on single node cluster
>> >> - Basic hdfs operations
>> >> - Run wordcount on a text file
>> >> Thanks,
>> >> Ajay
>> >>
>> >>
>> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>> >>
>> >> +1 (non-binding)
>> >>
>> >> - Verified all checksums and signatures
>> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> >> - Deployed a single node pseudo cluster
>> >> - Ran pi and sleep jobs
>> >> - Verified Docker was marked as experimental
>> >>
>> >> Thanks,
>> >>
>> >> Eric
>> >>
>> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> >> wrote:
>> >>
>> >> > +1 (binding)
>> >> >
>> >> > - Verified checksums and signatures of all tarballs
>> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> >> 10.12.6
>> >> > - Verified cloud connectors:
>> >> > - All S3A integration tests
>> >> > - All ADL live unit tests
>> >> > - Deployed both binary and built source to a pseudo cluster,
>> >> passed the
>> >> > following sanity tests in insecure, SSL, and SSL+Kerberos
>> mode:
>> >> > - HDFS basic and ACL
>> >> > - DistCp basic
>> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> >> binary
>> >> > tarball, probably unrelated)
>> >> > - KMS and HttpFS basic
>> >> > - Balancer start/stop
>> >> >
>> >> > Hit the following errors but they don't seem to be blocking:
>> >> >
>> >> > == Missing dependencies during build ==
>> >> >
>> >> > > ERROR: hadoop-aliyun has missing dependencies:
>> json-lib-jdk15.jar
>> >> > > ERROR: hadoop-azure has missing dependencies:
>> >> jetty-util-ajax-9.3.19.
>> >> > > v20170502.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okhttp-2.4.0.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okio-1.4.0.jar
>> >> >
>> >> >
>> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >> >
>> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> >> default HTTP
>> >> > servlet /conf, /stacks, and /logLevel ==
>> >> >
>> >> > One example below:
>> >> >
>> >> > > Connecting to
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer
>> >> > > Exception in thread "main"
>> >> > > org.apache.hadoop.security.authentication.client.
>> >> > AuthenticationException:
>> >> > > Authentication failed, URL:
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer&user.name=jzhuge,
>> >> > > status: 403, message: GSSException: Failure unspecified at
>> >> GSS-API level
>> >> > > (Mechanism level: Request is a replay (34))
>> >> >
>> >> >
>> >> > The /logLevel failure will affect command "hadoop daemonlog".
>> >> >
>> >> >
>> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > wrote:
>> >> >
>> >> > > Thanks for all the votes thus far! We've gotten the binding
>> +1's
>> >> to close
>> >> > > the release, though are there contributors who could kick the
>> >> tires on
>> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> >> merged since
>> >> > > alpha4, so it'd be good to get some coverage.
>> >> > >
>> >> > >
>> >> > >
>> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> > > wrote:
>> >> > >
>> >> > > >
>> >> > > > Thanks Andrew.
>> >> > > >
>> >> > > > +1 (non binding)
>> >> > > >
>> >> > > > --Built from source
>> >> > > > --installed 3 node HA cluster
>> >> > > > --Verified shell commands and UI
>> >> > > > --Ran wordcount/pic jobs
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > > > wrote:
>> >> > > >
>> >> > > >> Hi all,
>> >> > > >>
>> >> > > >> Let me start, as always, by thanking the many, many
>> >> contributors who
>> >> > > >> helped
>> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> >> > > >>
>> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> >> > > >>
>> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
>> Pacific.
>> >> > > >>
>> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> >> bug fixes,
>> >> > > >> improvements, and feature enhancements. Notable additions
>> >> include the
>> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> >> completion of
>> >> > the
>> >> > > >> shaded client, and HDFS erasure coding pluggable policy
>> >> support.
>> >> > > >>
>> >> > > >> I've done the traditional testing of running a Pi job on a
>> >> pseudo
>> >> > > cluster.
>> >> > > >> My +1 to start.
>> >> > > >>
>> >> > > >> We're working internally on getting this run through our
>> >> integration
>> >> > > test
>> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
>> that's
>> >> > complete.
>> >> > > >>
>> >> > > >> Best,
>> >> > > >> Andrew
>> >> > > >>
>> >> > > > --
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --Brahma Reddy Battula
>> >> > > >
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > John
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for the additional review Rohith, much appreciated!
On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> +1 (binding)
>
> Built from source and deployed YARN HA cluster with ATSv2 enabled in
> non-secured cluster.
> - tested for RM HA/work-preservring-restart/ NM-work-preserving restart
> for ATSv2 entities.
> - verified all ATSv2 REST end points to retrieve the entities
> - ran sample MR jobs and distributed jobs
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
>
>> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
>> vote passes.
>>
>> I'll get started on pushing out the release.
>>
>> Best,
>> Andrew
>>
>> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>>
>> > +1
>> >
>> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
>> > (both Local and Dynamo metadatastore).
>> >
>> > Everything worked fine except I hit one integration test failure. It
>> is a
>> > minor test issue IMO and I've filed HADOOP-14927
>> >
>> > Failed tests:
>> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe
>> stroyNoBucket:228
>> > Expected an exception, got 0
>> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr
>> oyNoBucket:228
>> > Expected an exception, got 0
>> >
>> >
>> >
>> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
>> > wrote:
>> >
>> >> +1 (non-binding)
>> >>
>> >> - built from source
>> >> - deployed on single node cluster
>> >> - Basic hdfs operations
>> >> - Run wordcount on a text file
>> >> Thanks,
>> >> Ajay
>> >>
>> >>
>> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>> >>
>> >> +1 (non-binding)
>> >>
>> >> - Verified all checksums and signatures
>> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> >> - Deployed a single node pseudo cluster
>> >> - Ran pi and sleep jobs
>> >> - Verified Docker was marked as experimental
>> >>
>> >> Thanks,
>> >>
>> >> Eric
>> >>
>> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> >> wrote:
>> >>
>> >> > +1 (binding)
>> >> >
>> >> > - Verified checksums and signatures of all tarballs
>> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> >> 10.12.6
>> >> > - Verified cloud connectors:
>> >> > - All S3A integration tests
>> >> > - All ADL live unit tests
>> >> > - Deployed both binary and built source to a pseudo cluster,
>> >> passed the
>> >> > following sanity tests in insecure, SSL, and SSL+Kerberos
>> mode:
>> >> > - HDFS basic and ACL
>> >> > - DistCp basic
>> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> >> binary
>> >> > tarball, probably unrelated)
>> >> > - KMS and HttpFS basic
>> >> > - Balancer start/stop
>> >> >
>> >> > Hit the following errors but they don't seem to be blocking:
>> >> >
>> >> > == Missing dependencies during build ==
>> >> >
>> >> > > ERROR: hadoop-aliyun has missing dependencies:
>> json-lib-jdk15.jar
>> >> > > ERROR: hadoop-azure has missing dependencies:
>> >> jetty-util-ajax-9.3.19.
>> >> > > v20170502.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okhttp-2.4.0.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okio-1.4.0.jar
>> >> >
>> >> >
>> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >> >
>> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> >> default HTTP
>> >> > servlet /conf, /stacks, and /logLevel ==
>> >> >
>> >> > One example below:
>> >> >
>> >> > > Connecting to
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer
>> >> > > Exception in thread "main"
>> >> > > org.apache.hadoop.security.authentication.client.
>> >> > AuthenticationException:
>> >> > > Authentication failed, URL:
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer&user.name=jzhuge,
>> >> > > status: 403, message: GSSException: Failure unspecified at
>> >> GSS-API level
>> >> > > (Mechanism level: Request is a replay (34))
>> >> >
>> >> >
>> >> > The /logLevel failure will affect command "hadoop daemonlog".
>> >> >
>> >> >
>> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > wrote:
>> >> >
>> >> > > Thanks for all the votes thus far! We've gotten the binding
>> +1's
>> >> to close
>> >> > > the release, though are there contributors who could kick the
>> >> tires on
>> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> >> merged since
>> >> > > alpha4, so it'd be good to get some coverage.
>> >> > >
>> >> > >
>> >> > >
>> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> > > wrote:
>> >> > >
>> >> > > >
>> >> > > > Thanks Andrew.
>> >> > > >
>> >> > > > +1 (non binding)
>> >> > > >
>> >> > > > --Built from source
>> >> > > > --installed 3 node HA cluster
>> >> > > > --Verified shell commands and UI
>> >> > > > --Ran wordcount/pic jobs
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > > > wrote:
>> >> > > >
>> >> > > >> Hi all,
>> >> > > >>
>> >> > > >> Let me start, as always, by thanking the many, many
>> >> contributors who
>> >> > > >> helped
>> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> >> > > >>
>> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> >> > > >>
>> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
>> Pacific.
>> >> > > >>
>> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> >> bug fixes,
>> >> > > >> improvements, and feature enhancements. Notable additions
>> >> include the
>> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> >> completion of
>> >> > the
>> >> > > >> shaded client, and HDFS erasure coding pluggable policy
>> >> support.
>> >> > > >>
>> >> > > >> I've done the traditional testing of running a Pi job on a
>> >> pseudo
>> >> > > cluster.
>> >> > > >> My +1 to start.
>> >> > > >>
>> >> > > >> We're working internally on getting this run through our
>> >> integration
>> >> > > test
>> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
>> that's
>> >> > complete.
>> >> > > >>
>> >> > > >> Best,
>> >> > > >> Andrew
>> >> > > >>
>> >> > > > --
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --Brahma Reddy Battula
>> >> > > >
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > John
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for the additional review Rohith, much appreciated!
On Wed, Oct 4, 2017 at 12:14 AM, Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> +1 (binding)
>
> Built from source and deployed YARN HA cluster with ATSv2 enabled in
> non-secured cluster.
> - tested for RM HA/work-preservring-restart/ NM-work-preserving restart
> for ATSv2 entities.
> - verified all ATSv2 REST end points to retrieve the entities
> - ran sample MR jobs and distributed jobs
>
> Thanks & Regards
> Rohith Sharma K S
>
> On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
>
>> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
>> vote passes.
>>
>> I'll get started on pushing out the release.
>>
>> Best,
>> Andrew
>>
>> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>>
>> > +1
>> >
>> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
>> > (both Local and Dynamo metadatastore).
>> >
>> > Everything worked fine except I hit one integration test failure. It
>> is a
>> > minor test issue IMO and I've filed HADOOP-14927
>> >
>> > Failed tests:
>> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDe
>> stroyNoBucket:228
>> > Expected an exception, got 0
>> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestr
>> oyNoBucket:228
>> > Expected an exception, got 0
>> >
>> >
>> >
>> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
>> > wrote:
>> >
>> >> +1 (non-binding)
>> >>
>> >> - built from source
>> >> - deployed on single node cluster
>> >> - Basic hdfs operations
>> >> - Run wordcount on a text file
>> >> Thanks,
>> >> Ajay
>> >>
>> >>
>> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>> >>
>> >> +1 (non-binding)
>> >>
>> >> - Verified all checksums and signatures
>> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> >> - Deployed a single node pseudo cluster
>> >> - Ran pi and sleep jobs
>> >> - Verified Docker was marked as experimental
>> >>
>> >> Thanks,
>> >>
>> >> Eric
>> >>
>> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> >> wrote:
>> >>
>> >> > +1 (binding)
>> >> >
>> >> > - Verified checksums and signatures of all tarballs
>> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> >> 10.12.6
>> >> > - Verified cloud connectors:
>> >> > - All S3A integration tests
>> >> > - All ADL live unit tests
>> >> > - Deployed both binary and built source to a pseudo cluster,
>> >> passed the
>> >> > following sanity tests in insecure, SSL, and SSL+Kerberos
>> mode:
>> >> > - HDFS basic and ACL
>> >> > - DistCp basic
>> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> >> binary
>> >> > tarball, probably unrelated)
>> >> > - KMS and HttpFS basic
>> >> > - Balancer start/stop
>> >> >
>> >> > Hit the following errors but they don't seem to be blocking:
>> >> >
>> >> > == Missing dependencies during build ==
>> >> >
>> >> > > ERROR: hadoop-aliyun has missing dependencies:
>> json-lib-jdk15.jar
>> >> > > ERROR: hadoop-azure has missing dependencies:
>> >> jetty-util-ajax-9.3.19.
>> >> > > v20170502.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okhttp-2.4.0.jar
>> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> >> okio-1.4.0.jar
>> >> >
>> >> >
>> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >> >
>> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> >> default HTTP
>> >> > servlet /conf, /stacks, and /logLevel ==
>> >> >
>> >> > One example below:
>> >> >
>> >> > > Connecting to
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer
>> >> > > Exception in thread "main"
>> >> > > org.apache.hadoop.security.authentication.client.
>> >> > AuthenticationException:
>> >> > > Authentication failed, URL:
>> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> >> http.server.
>> >> > HttpFSServer&user.name=jzhuge,
>> >> > > status: 403, message: GSSException: Failure unspecified at
>> >> GSS-API level
>> >> > > (Mechanism level: Request is a replay (34))
>> >> >
>> >> >
>> >> > The /logLevel failure will affect command "hadoop daemonlog".
>> >> >
>> >> >
>> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > wrote:
>> >> >
>> >> > > Thanks for all the votes thus far! We've gotten the binding
>> +1's
>> >> to close
>> >> > > the release, though are there contributors who could kick the
>> >> tires on
>> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> >> merged since
>> >> > > alpha4, so it'd be good to get some coverage.
>> >> > >
>> >> > >
>> >> > >
>> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> > > wrote:
>> >> > >
>> >> > > >
>> >> > > > Thanks Andrew.
>> >> > > >
>> >> > > > +1 (non binding)
>> >> > > >
>> >> > > > --Built from source
>> >> > > > --installed 3 node HA cluster
>> >> > > > --Verified shell commands and UI
>> >> > > > --Ran wordcount/pic jobs
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> >> andrew.wang@cloudera.com>
>> >> > > > wrote:
>> >> > > >
>> >> > > >> Hi all,
>> >> > > >>
>> >> > > >> Let me start, as always, by thanking the many, many
>> >> contributors who
>> >> > > >> helped
>> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> >> > > >>
>> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> >> > > >>
>> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
>> Pacific.
>> >> > > >>
>> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> >> bug fixes,
>> >> > > >> improvements, and feature enhancements. Notable additions
>> >> include the
>> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> >> completion of
>> >> > the
>> >> > > >> shaded client, and HDFS erasure coding pluggable policy
>> >> support.
>> >> > > >>
>> >> > > >> I've done the traditional testing of running a Pi job on a
>> >> pseudo
>> >> > > cluster.
>> >> > > >> My +1 to start.
>> >> > > >>
>> >> > > >> We're working internally on getting this run through our
>> >> integration
>> >> > > test
>> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
>> that's
>> >> > complete.
>> >> > > >>
>> >> > > >> Best,
>> >> > > >> Andrew
>> >> > > >>
>> >> > > > --
>> >> > > >
>> >> > > >
>> >> > > >
>> >> > > > --Brahma Reddy Battula
>> >> > > >
>> >> > >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > John
>> >> >
>> >>
>> >>
>> >>
>> >
>>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
Built from source and deployed YARN HA cluster with ATSv2 enabled in
non-secured cluster.
- tested for RM HA/work-preservring-restart/ NM-work-preserving restart for
ATSv2 entities.
- verified all ATSv2 REST end points to retrieve the entities
- ran sample MR jobs and distributed jobs
Thanks & Regards
Rohith Sharma K S
On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
> vote passes.
>
> I'll get started on pushing out the release.
>
> Best,
> Andrew
>
> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>
> > +1
> >
> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> > (both Local and Dynamo metadatastore).
> >
> > Everything worked fine except I hit one integration test failure. It is
> a
> > minor test issue IMO and I've filed HADOOP-14927
> >
> > Failed tests:
> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >
> >
> >
> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> - built from source
> >> - deployed on single node cluster
> >> - Basic hdfs operations
> >> - Run wordcount on a text file
> >> Thanks,
> >> Ajay
> >>
> >>
> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
> >>
> >> +1 (non-binding)
> >>
> >> - Verified all checksums and signatures
> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
> >> - Deployed a single node pseudo cluster
> >> - Ran pi and sleep jobs
> >> - Verified Docker was marked as experimental
> >>
> >> Thanks,
> >>
> >> Eric
> >>
> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> >> wrote:
> >>
> >> > +1 (binding)
> >> >
> >> > - Verified checksums and signatures of all tarballs
> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
> >> 10.12.6
> >> > - Verified cloud connectors:
> >> > - All S3A integration tests
> >> > - All ADL live unit tests
> >> > - Deployed both binary and built source to a pseudo cluster,
> >> passed the
> >> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> >> > - HDFS basic and ACL
> >> > - DistCp basic
> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> >> binary
> >> > tarball, probably unrelated)
> >> > - KMS and HttpFS basic
> >> > - Balancer start/stop
> >> >
> >> > Hit the following errors but they don't seem to be blocking:
> >> >
> >> > == Missing dependencies during build ==
> >> >
> >> > > ERROR: hadoop-aliyun has missing dependencies:
> json-lib-jdk15.jar
> >> > > ERROR: hadoop-azure has missing dependencies:
> >> jetty-util-ajax-9.3.19.
> >> > > v20170502.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okhttp-2.4.0.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okio-1.4.0.jar
> >> >
> >> >
> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >> >
> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
> >> default HTTP
> >> > servlet /conf, /stacks, and /logLevel ==
> >> >
> >> > One example below:
> >> >
> >> > > Connecting to
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer
> >> > > Exception in thread "main"
> >> > > org.apache.hadoop.security.authentication.client.
> >> > AuthenticationException:
> >> > > Authentication failed, URL:
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer&user.name=jzhuge,
> >> > > status: 403, message: GSSException: Failure unspecified at
> >> GSS-API level
> >> > > (Mechanism level: Request is a replay (34))
> >> >
> >> >
> >> > The /logLevel failure will affect command "hadoop daemonlog".
> >> >
> >> >
> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > wrote:
> >> >
> >> > > Thanks for all the votes thus far! We've gotten the binding +1's
> >> to close
> >> > > the release, though are there contributors who could kick the
> >> tires on
> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> >> merged since
> >> > > alpha4, so it'd be good to get some coverage.
> >> > >
> >> > >
> >> > >
> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> >> brahma@apache.org>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > Thanks Andrew.
> >> > > >
> >> > > > +1 (non binding)
> >> > > >
> >> > > > --Built from source
> >> > > > --installed 3 node HA cluster
> >> > > > --Verified shell commands and UI
> >> > > > --Ran wordcount/pic jobs
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > > > wrote:
> >> > > >
> >> > > >> Hi all,
> >> > > >>
> >> > > >> Let me start, as always, by thanking the many, many
> >> contributors who
> >> > > >> helped
> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >> > > >>
> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >> > > >>
> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
> Pacific.
> >> > > >>
> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
> >> bug fixes,
> >> > > >> improvements, and feature enhancements. Notable additions
> >> include the
> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> >> completion of
> >> > the
> >> > > >> shaded client, and HDFS erasure coding pluggable policy
> >> support.
> >> > > >>
> >> > > >> I've done the traditional testing of running a Pi job on a
> >> pseudo
> >> > > cluster.
> >> > > >> My +1 to start.
> >> > > >>
> >> > > >> We're working internally on getting this run through our
> >> integration
> >> > > test
> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
> that's
> >> > complete.
> >> > > >>
> >> > > >> Best,
> >> > > >> Andrew
> >> > > >>
> >> > > > --
> >> > > >
> >> > > >
> >> > > >
> >> > > > --Brahma Reddy Battula
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > John
> >> >
> >>
> >>
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
Built from source and deployed YARN HA cluster with ATSv2 enabled in
non-secured cluster.
- tested for RM HA/work-preservring-restart/ NM-work-preserving restart for
ATSv2 entities.
- verified all ATSv2 REST end points to retrieve the entities
- ran sample MR jobs and distributed jobs
Thanks & Regards
Rohith Sharma K S
On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
> vote passes.
>
> I'll get started on pushing out the release.
>
> Best,
> Andrew
>
> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>
> > +1
> >
> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> > (both Local and Dynamo metadatastore).
> >
> > Everything worked fine except I hit one integration test failure. It is
> a
> > minor test issue IMO and I've filed HADOOP-14927
> >
> > Failed tests:
> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >
> >
> >
> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> - built from source
> >> - deployed on single node cluster
> >> - Basic hdfs operations
> >> - Run wordcount on a text file
> >> Thanks,
> >> Ajay
> >>
> >>
> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
> >>
> >> +1 (non-binding)
> >>
> >> - Verified all checksums and signatures
> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
> >> - Deployed a single node pseudo cluster
> >> - Ran pi and sleep jobs
> >> - Verified Docker was marked as experimental
> >>
> >> Thanks,
> >>
> >> Eric
> >>
> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> >> wrote:
> >>
> >> > +1 (binding)
> >> >
> >> > - Verified checksums and signatures of all tarballs
> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
> >> 10.12.6
> >> > - Verified cloud connectors:
> >> > - All S3A integration tests
> >> > - All ADL live unit tests
> >> > - Deployed both binary and built source to a pseudo cluster,
> >> passed the
> >> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> >> > - HDFS basic and ACL
> >> > - DistCp basic
> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> >> binary
> >> > tarball, probably unrelated)
> >> > - KMS and HttpFS basic
> >> > - Balancer start/stop
> >> >
> >> > Hit the following errors but they don't seem to be blocking:
> >> >
> >> > == Missing dependencies during build ==
> >> >
> >> > > ERROR: hadoop-aliyun has missing dependencies:
> json-lib-jdk15.jar
> >> > > ERROR: hadoop-azure has missing dependencies:
> >> jetty-util-ajax-9.3.19.
> >> > > v20170502.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okhttp-2.4.0.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okio-1.4.0.jar
> >> >
> >> >
> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >> >
> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
> >> default HTTP
> >> > servlet /conf, /stacks, and /logLevel ==
> >> >
> >> > One example below:
> >> >
> >> > > Connecting to
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer
> >> > > Exception in thread "main"
> >> > > org.apache.hadoop.security.authentication.client.
> >> > AuthenticationException:
> >> > > Authentication failed, URL:
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer&user.name=jzhuge,
> >> > > status: 403, message: GSSException: Failure unspecified at
> >> GSS-API level
> >> > > (Mechanism level: Request is a replay (34))
> >> >
> >> >
> >> > The /logLevel failure will affect command "hadoop daemonlog".
> >> >
> >> >
> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > wrote:
> >> >
> >> > > Thanks for all the votes thus far! We've gotten the binding +1's
> >> to close
> >> > > the release, though are there contributors who could kick the
> >> tires on
> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> >> merged since
> >> > > alpha4, so it'd be good to get some coverage.
> >> > >
> >> > >
> >> > >
> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> >> brahma@apache.org>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > Thanks Andrew.
> >> > > >
> >> > > > +1 (non binding)
> >> > > >
> >> > > > --Built from source
> >> > > > --installed 3 node HA cluster
> >> > > > --Verified shell commands and UI
> >> > > > --Ran wordcount/pic jobs
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > > > wrote:
> >> > > >
> >> > > >> Hi all,
> >> > > >>
> >> > > >> Let me start, as always, by thanking the many, many
> >> contributors who
> >> > > >> helped
> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >> > > >>
> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >> > > >>
> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
> Pacific.
> >> > > >>
> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
> >> bug fixes,
> >> > > >> improvements, and feature enhancements. Notable additions
> >> include the
> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> >> completion of
> >> > the
> >> > > >> shaded client, and HDFS erasure coding pluggable policy
> >> support.
> >> > > >>
> >> > > >> I've done the traditional testing of running a Pi job on a
> >> pseudo
> >> > > cluster.
> >> > > >> My +1 to start.
> >> > > >>
> >> > > >> We're working internally on getting this run through our
> >> integration
> >> > > test
> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
> that's
> >> > complete.
> >> > > >>
> >> > > >> Best,
> >> > > >> Andrew
> >> > > >>
> >> > > > --
> >> > > >
> >> > > >
> >> > > >
> >> > > > --Brahma Reddy Battula
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > John
> >> >
> >>
> >>
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
Built from source and deployed YARN HA cluster with ATSv2 enabled in
non-secured cluster.
- tested for RM HA/work-preservring-restart/ NM-work-preserving restart for
ATSv2 entities.
- verified all ATSv2 REST end points to retrieve the entities
- ran sample MR jobs and distributed jobs
Thanks & Regards
Rohith Sharma K S
On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
> vote passes.
>
> I'll get started on pushing out the release.
>
> Best,
> Andrew
>
> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>
> > +1
> >
> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> > (both Local and Dynamo metadatastore).
> >
> > Everything worked fine except I hit one integration test failure. It is
> a
> > minor test issue IMO and I've filed HADOOP-14927
> >
> > Failed tests:
> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >
> >
> >
> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> - built from source
> >> - deployed on single node cluster
> >> - Basic hdfs operations
> >> - Run wordcount on a text file
> >> Thanks,
> >> Ajay
> >>
> >>
> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
> >>
> >> +1 (non-binding)
> >>
> >> - Verified all checksums and signatures
> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
> >> - Deployed a single node pseudo cluster
> >> - Ran pi and sleep jobs
> >> - Verified Docker was marked as experimental
> >>
> >> Thanks,
> >>
> >> Eric
> >>
> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> >> wrote:
> >>
> >> > +1 (binding)
> >> >
> >> > - Verified checksums and signatures of all tarballs
> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
> >> 10.12.6
> >> > - Verified cloud connectors:
> >> > - All S3A integration tests
> >> > - All ADL live unit tests
> >> > - Deployed both binary and built source to a pseudo cluster,
> >> passed the
> >> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> >> > - HDFS basic and ACL
> >> > - DistCp basic
> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> >> binary
> >> > tarball, probably unrelated)
> >> > - KMS and HttpFS basic
> >> > - Balancer start/stop
> >> >
> >> > Hit the following errors but they don't seem to be blocking:
> >> >
> >> > == Missing dependencies during build ==
> >> >
> >> > > ERROR: hadoop-aliyun has missing dependencies:
> json-lib-jdk15.jar
> >> > > ERROR: hadoop-azure has missing dependencies:
> >> jetty-util-ajax-9.3.19.
> >> > > v20170502.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okhttp-2.4.0.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okio-1.4.0.jar
> >> >
> >> >
> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >> >
> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
> >> default HTTP
> >> > servlet /conf, /stacks, and /logLevel ==
> >> >
> >> > One example below:
> >> >
> >> > > Connecting to
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer
> >> > > Exception in thread "main"
> >> > > org.apache.hadoop.security.authentication.client.
> >> > AuthenticationException:
> >> > > Authentication failed, URL:
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer&user.name=jzhuge,
> >> > > status: 403, message: GSSException: Failure unspecified at
> >> GSS-API level
> >> > > (Mechanism level: Request is a replay (34))
> >> >
> >> >
> >> > The /logLevel failure will affect command "hadoop daemonlog".
> >> >
> >> >
> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > wrote:
> >> >
> >> > > Thanks for all the votes thus far! We've gotten the binding +1's
> >> to close
> >> > > the release, though are there contributors who could kick the
> >> tires on
> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> >> merged since
> >> > > alpha4, so it'd be good to get some coverage.
> >> > >
> >> > >
> >> > >
> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> >> brahma@apache.org>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > Thanks Andrew.
> >> > > >
> >> > > > +1 (non binding)
> >> > > >
> >> > > > --Built from source
> >> > > > --installed 3 node HA cluster
> >> > > > --Verified shell commands and UI
> >> > > > --Ran wordcount/pic jobs
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > > > wrote:
> >> > > >
> >> > > >> Hi all,
> >> > > >>
> >> > > >> Let me start, as always, by thanking the many, many
> >> contributors who
> >> > > >> helped
> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >> > > >>
> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >> > > >>
> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
> Pacific.
> >> > > >>
> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
> >> bug fixes,
> >> > > >> improvements, and feature enhancements. Notable additions
> >> include the
> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> >> completion of
> >> > the
> >> > > >> shaded client, and HDFS erasure coding pluggable policy
> >> support.
> >> > > >>
> >> > > >> I've done the traditional testing of running a Pi job on a
> >> pseudo
> >> > > cluster.
> >> > > >> My +1 to start.
> >> > > >>
> >> > > >> We're working internally on getting this run through our
> >> integration
> >> > > test
> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
> that's
> >> > complete.
> >> > > >>
> >> > > >> Best,
> >> > > >> Andrew
> >> > > >>
> >> > > > --
> >> > > >
> >> > > >
> >> > > >
> >> > > > --Brahma Reddy Battula
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > John
> >> >
> >>
> >>
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
+1 (binding)
Built from source and deployed YARN HA cluster with ATSv2 enabled in
non-secured cluster.
- tested for RM HA/work-preservring-restart/ NM-work-preserving restart for
ATSv2 entities.
- verified all ATSv2 REST end points to retrieve the entities
- ran sample MR jobs and distributed jobs
Thanks & Regards
Rohith Sharma K S
On 4 October 2017 at 05:31, Andrew Wang <an...@cloudera.com> wrote:
> Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
> vote passes.
>
> I'll get started on pushing out the release.
>
> Best,
> Andrew
>
> On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
>
> > +1
> >
> > Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> > (both Local and Dynamo metadatastore).
> >
> > Everything worked fine except I hit one integration test failure. It is
> a
> > minor test issue IMO and I've filed HADOOP-14927
> >
> > Failed tests:
> > ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> > ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.
> testDestroyNoBucket:228
> > Expected an exception, got 0
> >
> >
> >
> > On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> - built from source
> >> - deployed on single node cluster
> >> - Basic hdfs operations
> >> - Run wordcount on a text file
> >> Thanks,
> >> Ajay
> >>
> >>
> >> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
> >>
> >> +1 (non-binding)
> >>
> >> - Verified all checksums and signatures
> >> - Built native from source on macOS 10.12.6 and RHEL 7.1
> >> - Deployed a single node pseudo cluster
> >> - Ran pi and sleep jobs
> >> - Verified Docker was marked as experimental
> >>
> >> Thanks,
> >>
> >> Eric
> >>
> >> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> >> wrote:
> >>
> >> > +1 (binding)
> >> >
> >> > - Verified checksums and signatures of all tarballs
> >> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
> >> 10.12.6
> >> > - Verified cloud connectors:
> >> > - All S3A integration tests
> >> > - All ADL live unit tests
> >> > - Deployed both binary and built source to a pseudo cluster,
> >> passed the
> >> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> >> > - HDFS basic and ACL
> >> > - DistCp basic
> >> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> >> binary
> >> > tarball, probably unrelated)
> >> > - KMS and HttpFS basic
> >> > - Balancer start/stop
> >> >
> >> > Hit the following errors but they don't seem to be blocking:
> >> >
> >> > == Missing dependencies during build ==
> >> >
> >> > > ERROR: hadoop-aliyun has missing dependencies:
> json-lib-jdk15.jar
> >> > > ERROR: hadoop-azure has missing dependencies:
> >> jetty-util-ajax-9.3.19.
> >> > > v20170502.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okhttp-2.4.0.jar
> >> > > ERROR: hadoop-azure-datalake has missing dependencies:
> >> okio-1.4.0.jar
> >> >
> >> >
> >> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >> >
> >> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
> >> default HTTP
> >> > servlet /conf, /stacks, and /logLevel ==
> >> >
> >> > One example below:
> >> >
> >> > > Connecting to
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer
> >> > > Exception in thread "main"
> >> > > org.apache.hadoop.security.authentication.client.
> >> > AuthenticationException:
> >> > > Authentication failed, URL:
> >> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
> >> http.server.
> >> > HttpFSServer&user.name=jzhuge,
> >> > > status: 403, message: GSSException: Failure unspecified at
> >> GSS-API level
> >> > > (Mechanism level: Request is a replay (34))
> >> >
> >> >
> >> > The /logLevel failure will affect command "hadoop daemonlog".
> >> >
> >> >
> >> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > wrote:
> >> >
> >> > > Thanks for all the votes thus far! We've gotten the binding +1's
> >> to close
> >> > > the release, though are there contributors who could kick the
> >> tires on
> >> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> >> merged since
> >> > > alpha4, so it'd be good to get some coverage.
> >> > >
> >> > >
> >> > >
> >> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> >> brahma@apache.org>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > Thanks Andrew.
> >> > > >
> >> > > > +1 (non binding)
> >> > > >
> >> > > > --Built from source
> >> > > > --installed 3 node HA cluster
> >> > > > --Verified shell commands and UI
> >> > > > --Ran wordcount/pic jobs
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> >> andrew.wang@cloudera.com>
> >> > > > wrote:
> >> > > >
> >> > > >> Hi all,
> >> > > >>
> >> > > >> Let me start, as always, by thanking the many, many
> >> contributors who
> >> > > >> helped
> >> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >> > > >>
> >> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >> > > >>
> >> > > >> This vote will run five days, ending on Nov 3rd at 5PM
> Pacific.
> >> > > >>
> >> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
> >> bug fixes,
> >> > > >> improvements, and feature enhancements. Notable additions
> >> include the
> >> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> >> completion of
> >> > the
> >> > > >> shaded client, and HDFS erasure coding pluggable policy
> >> support.
> >> > > >>
> >> > > >> I've done the traditional testing of running a Pi job on a
> >> pseudo
> >> > > cluster.
> >> > > >> My +1 to start.
> >> > > >>
> >> > > >> We're working internally on getting this run through our
> >> integration
> >> > > test
> >> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once
> that's
> >> > complete.
> >> > > >>
> >> > > >> Best,
> >> > > >> Andrew
> >> > > >>
> >> > > > --
> >> > > >
> >> > > >
> >> > > >
> >> > > > --Brahma Reddy Battula
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > John
> >> >
> >>
> >>
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
vote passes.
I'll get started on pushing out the release.
Best,
Andrew
On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
> +1
>
> Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> (both Local and Dynamo metadatastore).
>
> Everything worked fine except I hit one integration test failure. It is a
> minor test issue IMO and I've filed HADOOP-14927
>
> Failed tests:
> ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
> ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
>
>
>
> On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> +1 (non-binding)
>>
>> - built from source
>> - deployed on single node cluster
>> - Basic hdfs operations
>> - Run wordcount on a text file
>> Thanks,
>> Ajay
>>
>>
>> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>>
>> +1 (non-binding)
>>
>> - Verified all checksums and signatures
>> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> - Deployed a single node pseudo cluster
>> - Ran pi and sleep jobs
>> - Verified Docker was marked as experimental
>>
>> Thanks,
>>
>> Eric
>>
>> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> wrote:
>>
>> > +1 (binding)
>> >
>> > - Verified checksums and signatures of all tarballs
>> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> 10.12.6
>> > - Verified cloud connectors:
>> > - All S3A integration tests
>> > - All ADL live unit tests
>> > - Deployed both binary and built source to a pseudo cluster,
>> passed the
>> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
>> > - HDFS basic and ACL
>> > - DistCp basic
>> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> binary
>> > tarball, probably unrelated)
>> > - KMS and HttpFS basic
>> > - Balancer start/stop
>> >
>> > Hit the following errors but they don't seem to be blocking:
>> >
>> > == Missing dependencies during build ==
>> >
>> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
>> > > ERROR: hadoop-azure has missing dependencies:
>> jetty-util-ajax-9.3.19.
>> > > v20170502.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okhttp-2.4.0.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okio-1.4.0.jar
>> >
>> >
>> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >
>> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> default HTTP
>> > servlet /conf, /stacks, and /logLevel ==
>> >
>> > One example below:
>> >
>> > > Connecting to
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer
>> > > Exception in thread "main"
>> > > org.apache.hadoop.security.authentication.client.
>> > AuthenticationException:
>> > > Authentication failed, URL:
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer&user.name=jzhuge,
>> > > status: 403, message: GSSException: Failure unspecified at
>> GSS-API level
>> > > (Mechanism level: Request is a replay (34))
>> >
>> >
>> > The /logLevel failure will affect command "hadoop daemonlog".
>> >
>> >
>> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > wrote:
>> >
>> > > Thanks for all the votes thus far! We've gotten the binding +1's
>> to close
>> > > the release, though are there contributors who could kick the
>> tires on
>> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> merged since
>> > > alpha4, so it'd be good to get some coverage.
>> > >
>> > >
>> > >
>> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> brahma@apache.org>
>> > > wrote:
>> > >
>> > > >
>> > > > Thanks Andrew.
>> > > >
>> > > > +1 (non binding)
>> > > >
>> > > > --Built from source
>> > > > --installed 3 node HA cluster
>> > > > --Verified shell commands and UI
>> > > > --Ran wordcount/pic jobs
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > > > wrote:
>> > > >
>> > > >> Hi all,
>> > > >>
>> > > >> Let me start, as always, by thanking the many, many
>> contributors who
>> > > >> helped
>> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> > > >>
>> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> > > >>
>> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>> > > >>
>> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> bug fixes,
>> > > >> improvements, and feature enhancements. Notable additions
>> include the
>> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> completion of
>> > the
>> > > >> shaded client, and HDFS erasure coding pluggable policy
>> support.
>> > > >>
>> > > >> I've done the traditional testing of running a Pi job on a
>> pseudo
>> > > cluster.
>> > > >> My +1 to start.
>> > > >>
>> > > >> We're working internally on getting this run through our
>> integration
>> > > test
>> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
>> > complete.
>> > > >>
>> > > >> Best,
>> > > >> Andrew
>> > > >>
>> > > > --
>> > > >
>> > > >
>> > > >
>> > > > --Brahma Reddy Battula
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > John
>> >
>>
>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
vote passes.
I'll get started on pushing out the release.
Best,
Andrew
On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
> +1
>
> Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> (both Local and Dynamo metadatastore).
>
> Everything worked fine except I hit one integration test failure. It is a
> minor test issue IMO and I've filed HADOOP-14927
>
> Failed tests:
> ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
> ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
>
>
>
> On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> +1 (non-binding)
>>
>> - built from source
>> - deployed on single node cluster
>> - Basic hdfs operations
>> - Run wordcount on a text file
>> Thanks,
>> Ajay
>>
>>
>> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>>
>> +1 (non-binding)
>>
>> - Verified all checksums and signatures
>> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> - Deployed a single node pseudo cluster
>> - Ran pi and sleep jobs
>> - Verified Docker was marked as experimental
>>
>> Thanks,
>>
>> Eric
>>
>> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> wrote:
>>
>> > +1 (binding)
>> >
>> > - Verified checksums and signatures of all tarballs
>> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> 10.12.6
>> > - Verified cloud connectors:
>> > - All S3A integration tests
>> > - All ADL live unit tests
>> > - Deployed both binary and built source to a pseudo cluster,
>> passed the
>> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
>> > - HDFS basic and ACL
>> > - DistCp basic
>> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> binary
>> > tarball, probably unrelated)
>> > - KMS and HttpFS basic
>> > - Balancer start/stop
>> >
>> > Hit the following errors but they don't seem to be blocking:
>> >
>> > == Missing dependencies during build ==
>> >
>> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
>> > > ERROR: hadoop-azure has missing dependencies:
>> jetty-util-ajax-9.3.19.
>> > > v20170502.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okhttp-2.4.0.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okio-1.4.0.jar
>> >
>> >
>> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >
>> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> default HTTP
>> > servlet /conf, /stacks, and /logLevel ==
>> >
>> > One example below:
>> >
>> > > Connecting to
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer
>> > > Exception in thread "main"
>> > > org.apache.hadoop.security.authentication.client.
>> > AuthenticationException:
>> > > Authentication failed, URL:
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer&user.name=jzhuge,
>> > > status: 403, message: GSSException: Failure unspecified at
>> GSS-API level
>> > > (Mechanism level: Request is a replay (34))
>> >
>> >
>> > The /logLevel failure will affect command "hadoop daemonlog".
>> >
>> >
>> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > wrote:
>> >
>> > > Thanks for all the votes thus far! We've gotten the binding +1's
>> to close
>> > > the release, though are there contributors who could kick the
>> tires on
>> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> merged since
>> > > alpha4, so it'd be good to get some coverage.
>> > >
>> > >
>> > >
>> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> brahma@apache.org>
>> > > wrote:
>> > >
>> > > >
>> > > > Thanks Andrew.
>> > > >
>> > > > +1 (non binding)
>> > > >
>> > > > --Built from source
>> > > > --installed 3 node HA cluster
>> > > > --Verified shell commands and UI
>> > > > --Ran wordcount/pic jobs
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > > > wrote:
>> > > >
>> > > >> Hi all,
>> > > >>
>> > > >> Let me start, as always, by thanking the many, many
>> contributors who
>> > > >> helped
>> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> > > >>
>> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> > > >>
>> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>> > > >>
>> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> bug fixes,
>> > > >> improvements, and feature enhancements. Notable additions
>> include the
>> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> completion of
>> > the
>> > > >> shaded client, and HDFS erasure coding pluggable policy
>> support.
>> > > >>
>> > > >> I've done the traditional testing of running a Pi job on a
>> pseudo
>> > > cluster.
>> > > >> My +1 to start.
>> > > >>
>> > > >> We're working internally on getting this run through our
>> integration
>> > > test
>> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
>> > complete.
>> > > >>
>> > > >> Best,
>> > > >> Andrew
>> > > >>
>> > > > --
>> > > >
>> > > >
>> > > >
>> > > > --Brahma Reddy Battula
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > John
>> >
>>
>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
vote passes.
I'll get started on pushing out the release.
Best,
Andrew
On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
> +1
>
> Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> (both Local and Dynamo metadatastore).
>
> Everything worked fine except I hit one integration test failure. It is a
> minor test issue IMO and I've filed HADOOP-14927
>
> Failed tests:
> ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
> ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
>
>
>
> On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> +1 (non-binding)
>>
>> - built from source
>> - deployed on single node cluster
>> - Basic hdfs operations
>> - Run wordcount on a text file
>> Thanks,
>> Ajay
>>
>>
>> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>>
>> +1 (non-binding)
>>
>> - Verified all checksums and signatures
>> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> - Deployed a single node pseudo cluster
>> - Ran pi and sleep jobs
>> - Verified Docker was marked as experimental
>>
>> Thanks,
>>
>> Eric
>>
>> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> wrote:
>>
>> > +1 (binding)
>> >
>> > - Verified checksums and signatures of all tarballs
>> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> 10.12.6
>> > - Verified cloud connectors:
>> > - All S3A integration tests
>> > - All ADL live unit tests
>> > - Deployed both binary and built source to a pseudo cluster,
>> passed the
>> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
>> > - HDFS basic and ACL
>> > - DistCp basic
>> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> binary
>> > tarball, probably unrelated)
>> > - KMS and HttpFS basic
>> > - Balancer start/stop
>> >
>> > Hit the following errors but they don't seem to be blocking:
>> >
>> > == Missing dependencies during build ==
>> >
>> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
>> > > ERROR: hadoop-azure has missing dependencies:
>> jetty-util-ajax-9.3.19.
>> > > v20170502.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okhttp-2.4.0.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okio-1.4.0.jar
>> >
>> >
>> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >
>> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> default HTTP
>> > servlet /conf, /stacks, and /logLevel ==
>> >
>> > One example below:
>> >
>> > > Connecting to
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer
>> > > Exception in thread "main"
>> > > org.apache.hadoop.security.authentication.client.
>> > AuthenticationException:
>> > > Authentication failed, URL:
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer&user.name=jzhuge,
>> > > status: 403, message: GSSException: Failure unspecified at
>> GSS-API level
>> > > (Mechanism level: Request is a replay (34))
>> >
>> >
>> > The /logLevel failure will affect command "hadoop daemonlog".
>> >
>> >
>> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > wrote:
>> >
>> > > Thanks for all the votes thus far! We've gotten the binding +1's
>> to close
>> > > the release, though are there contributors who could kick the
>> tires on
>> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> merged since
>> > > alpha4, so it'd be good to get some coverage.
>> > >
>> > >
>> > >
>> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> brahma@apache.org>
>> > > wrote:
>> > >
>> > > >
>> > > > Thanks Andrew.
>> > > >
>> > > > +1 (non binding)
>> > > >
>> > > > --Built from source
>> > > > --installed 3 node HA cluster
>> > > > --Verified shell commands and UI
>> > > > --Ran wordcount/pic jobs
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > > > wrote:
>> > > >
>> > > >> Hi all,
>> > > >>
>> > > >> Let me start, as always, by thanking the many, many
>> contributors who
>> > > >> helped
>> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> > > >>
>> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> > > >>
>> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>> > > >>
>> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> bug fixes,
>> > > >> improvements, and feature enhancements. Notable additions
>> include the
>> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> completion of
>> > the
>> > > >> shaded client, and HDFS erasure coding pluggable policy
>> support.
>> > > >>
>> > > >> I've done the traditional testing of running a Pi job on a
>> pseudo
>> > > cluster.
>> > > >> My +1 to start.
>> > > >>
>> > > >> We're working internally on getting this run through our
>> integration
>> > > test
>> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
>> > complete.
>> > > >>
>> > > >> Best,
>> > > >> Andrew
>> > > >>
>> > > > --
>> > > >
>> > > >
>> > > >
>> > > > --Brahma Reddy Battula
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > John
>> >
>>
>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks everyone for voting! With 4 binding +1s and 7 non-binding +1s, the
vote passes.
I'll get started on pushing out the release.
Best,
Andrew
On Tue, Oct 3, 2017 at 3:45 PM, Aaron Fabbri <fa...@cloudera.com> wrote:
> +1
>
> Built from source. Ran S3A integration tests in us-west-2 with S3Guard
> (both Local and Dynamo metadatastore).
>
> Everything worked fine except I hit one integration test failure. It is a
> minor test issue IMO and I've filed HADOOP-14927
>
> Failed tests:
> ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
> ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
> Expected an exception, got 0
>
>
>
> On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> +1 (non-binding)
>>
>> - built from source
>> - deployed on single node cluster
>> - Basic hdfs operations
>> - Run wordcount on a text file
>> Thanks,
>> Ajay
>>
>>
>> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>>
>> +1 (non-binding)
>>
>> - Verified all checksums and signatures
>> - Built native from source on macOS 10.12.6 and RHEL 7.1
>> - Deployed a single node pseudo cluster
>> - Ran pi and sleep jobs
>> - Verified Docker was marked as experimental
>>
>> Thanks,
>>
>> Eric
>>
>> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
>> wrote:
>>
>> > +1 (binding)
>> >
>> > - Verified checksums and signatures of all tarballs
>> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X
>> 10.12.6
>> > - Verified cloud connectors:
>> > - All S3A integration tests
>> > - All ADL live unit tests
>> > - Deployed both binary and built source to a pseudo cluster,
>> passed the
>> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
>> > - HDFS basic and ACL
>> > - DistCp basic
>> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
>> binary
>> > tarball, probably unrelated)
>> > - KMS and HttpFS basic
>> > - Balancer start/stop
>> >
>> > Hit the following errors but they don't seem to be blocking:
>> >
>> > == Missing dependencies during build ==
>> >
>> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
>> > > ERROR: hadoop-azure has missing dependencies:
>> jetty-util-ajax-9.3.19.
>> > > v20170502.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okhttp-2.4.0.jar
>> > > ERROR: hadoop-azure-datalake has missing dependencies:
>> okio-1.4.0.jar
>> >
>> >
>> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>> >
>> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs
>> default HTTP
>> > servlet /conf, /stacks, and /logLevel ==
>> >
>> > One example below:
>> >
>> > > Connecting to
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer
>> > > Exception in thread "main"
>> > > org.apache.hadoop.security.authentication.client.
>> > AuthenticationException:
>> > > Authentication failed, URL:
>> > > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.
>> http.server.
>> > HttpFSServer&user.name=jzhuge,
>> > > status: 403, message: GSSException: Failure unspecified at
>> GSS-API level
>> > > (Mechanism level: Request is a replay (34))
>> >
>> >
>> > The /logLevel failure will affect command "hadoop daemonlog".
>> >
>> >
>> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > wrote:
>> >
>> > > Thanks for all the votes thus far! We've gotten the binding +1's
>> to close
>> > > the release, though are there contributors who could kick the
>> tires on
>> > > S3Guard and YARN TSv2 alpha2? These are the two new features
>> merged since
>> > > alpha4, so it'd be good to get some coverage.
>> > >
>> > >
>> > >
>> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
>> brahma@apache.org>
>> > > wrote:
>> > >
>> > > >
>> > > > Thanks Andrew.
>> > > >
>> > > > +1 (non binding)
>> > > >
>> > > > --Built from source
>> > > > --installed 3 node HA cluster
>> > > > --Verified shell commands and UI
>> > > > --Ran wordcount/pic jobs
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
>> andrew.wang@cloudera.com>
>> > > > wrote:
>> > > >
>> > > >> Hi all,
>> > > >>
>> > > >> Let me start, as always, by thanking the many, many
>> contributors who
>> > > >> helped
>> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
>> > > >>
>> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>> > > >>
>> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>> > > >>
>> > > >> beta1 contains 576 fixed JIRA issues comprising a number of
>> bug fixes,
>> > > >> improvements, and feature enhancements. Notable additions
>> include the
>> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
>> completion of
>> > the
>> > > >> shaded client, and HDFS erasure coding pluggable policy
>> support.
>> > > >>
>> > > >> I've done the traditional testing of running a Pi job on a
>> pseudo
>> > > cluster.
>> > > >> My +1 to start.
>> > > >>
>> > > >> We're working internally on getting this run through our
>> integration
>> > > test
>> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
>> > complete.
>> > > >>
>> > > >> Best,
>> > > >> Andrew
>> > > >>
>> > > > --
>> > > >
>> > > >
>> > > >
>> > > > --Brahma Reddy Battula
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > John
>> >
>>
>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Aaron Fabbri <fa...@cloudera.com>.
+1
Built from source. Ran S3A integration tests in us-west-2 with S3Guard
(both Local and Dynamo metadatastore).
Everything worked fine except I hit one integration test failure. It is a
minor test issue IMO and I've filed HADOOP-14927
Failed tests:
ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
wrote:
> +1 (non-binding)
>
> - built from source
> - deployed on single node cluster
> - Basic hdfs operations
> - Run wordcount on a text file
> Thanks,
> Ajay
>
>
> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>
> +1 (non-binding)
>
> - Verified all checksums and signatures
> - Built native from source on macOS 10.12.6 and RHEL 7.1
> - Deployed a single node pseudo cluster
> - Ran pi and sleep jobs
> - Verified Docker was marked as experimental
>
> Thanks,
>
> Eric
>
> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > - Verified checksums and signatures of all tarballs
> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> > - Verified cloud connectors:
> > - All S3A integration tests
> > - All ADL live unit tests
> > - Deployed both binary and built source to a pseudo cluster,
> passed the
> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> > - HDFS basic and ACL
> > - DistCp basic
> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> binary
> > tarball, probably unrelated)
> > - KMS and HttpFS basic
> > - Balancer start/stop
> >
> > Hit the following errors but they don't seem to be blocking:
> >
> > == Missing dependencies during build ==
> >
> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > > ERROR: hadoop-azure has missing dependencies:
> jetty-util-ajax-9.3.19.
> > > v20170502.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okhttp-2.4.0.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okio-1.4.0.jar
> >
> >
> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >
> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default
> HTTP
> > servlet /conf, /stacks, and /logLevel ==
> >
> > One example below:
> >
> > > Connecting to
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer
> > > Exception in thread "main"
> > > org.apache.hadoop.security.authentication.client.
> > AuthenticationException:
> > > Authentication failed, URL:
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer&user.name=jzhuge,
> > > status: 403, message: GSSException: Failure unspecified at GSS-API
> level
> > > (Mechanism level: Request is a replay (34))
> >
> >
> > The /logLevel failure will affect command "hadoop daemonlog".
> >
> >
> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > wrote:
> >
> > > Thanks for all the votes thus far! We've gotten the binding +1's
> to close
> > > the release, though are there contributors who could kick the
> tires on
> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> merged since
> > > alpha4, so it'd be good to get some coverage.
> > >
> > >
> > >
> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> brahma@apache.org>
> > > wrote:
> > >
> > > >
> > > > Thanks Andrew.
> > > >
> > > > +1 (non binding)
> > > >
> > > > --Built from source
> > > > --installed 3 node HA cluster
> > > > --Verified shell commands and UI
> > > > --Ran wordcount/pic jobs
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > > > wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> Let me start, as always, by thanking the many, many
> contributors who
> > > >> helped
> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > > >>
> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > > >>
> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > > >>
> > > >> beta1 contains 576 fixed JIRA issues comprising a number of bug
> fixes,
> > > >> improvements, and feature enhancements. Notable additions
> include the
> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> completion of
> > the
> > > >> shaded client, and HDFS erasure coding pluggable policy support.
> > > >>
> > > >> I've done the traditional testing of running a Pi job on a
> pseudo
> > > cluster.
> > > >> My +1 to start.
> > > >>
> > > >> We're working internally on getting this run through our
> integration
> > > test
> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> > complete.
> > > >>
> > > >> Best,
> > > >> Andrew
> > > >>
> > > > --
> > > >
> > > >
> > > >
> > > > --Brahma Reddy Battula
> > > >
> > >
> >
> >
> >
> > --
> > John
> >
>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Aaron Fabbri <fa...@cloudera.com>.
+1
Built from source. Ran S3A integration tests in us-west-2 with S3Guard
(both Local and Dynamo metadatastore).
Everything worked fine except I hit one integration test failure. It is a
minor test issue IMO and I've filed HADOOP-14927
Failed tests:
ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
wrote:
> +1 (non-binding)
>
> - built from source
> - deployed on single node cluster
> - Basic hdfs operations
> - Run wordcount on a text file
> Thanks,
> Ajay
>
>
> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>
> +1 (non-binding)
>
> - Verified all checksums and signatures
> - Built native from source on macOS 10.12.6 and RHEL 7.1
> - Deployed a single node pseudo cluster
> - Ran pi and sleep jobs
> - Verified Docker was marked as experimental
>
> Thanks,
>
> Eric
>
> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > - Verified checksums and signatures of all tarballs
> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> > - Verified cloud connectors:
> > - All S3A integration tests
> > - All ADL live unit tests
> > - Deployed both binary and built source to a pseudo cluster,
> passed the
> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> > - HDFS basic and ACL
> > - DistCp basic
> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> binary
> > tarball, probably unrelated)
> > - KMS and HttpFS basic
> > - Balancer start/stop
> >
> > Hit the following errors but they don't seem to be blocking:
> >
> > == Missing dependencies during build ==
> >
> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > > ERROR: hadoop-azure has missing dependencies:
> jetty-util-ajax-9.3.19.
> > > v20170502.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okhttp-2.4.0.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okio-1.4.0.jar
> >
> >
> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >
> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default
> HTTP
> > servlet /conf, /stacks, and /logLevel ==
> >
> > One example below:
> >
> > > Connecting to
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer
> > > Exception in thread "main"
> > > org.apache.hadoop.security.authentication.client.
> > AuthenticationException:
> > > Authentication failed, URL:
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer&user.name=jzhuge,
> > > status: 403, message: GSSException: Failure unspecified at GSS-API
> level
> > > (Mechanism level: Request is a replay (34))
> >
> >
> > The /logLevel failure will affect command "hadoop daemonlog".
> >
> >
> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > wrote:
> >
> > > Thanks for all the votes thus far! We've gotten the binding +1's
> to close
> > > the release, though are there contributors who could kick the
> tires on
> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> merged since
> > > alpha4, so it'd be good to get some coverage.
> > >
> > >
> > >
> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> brahma@apache.org>
> > > wrote:
> > >
> > > >
> > > > Thanks Andrew.
> > > >
> > > > +1 (non binding)
> > > >
> > > > --Built from source
> > > > --installed 3 node HA cluster
> > > > --Verified shell commands and UI
> > > > --Ran wordcount/pic jobs
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > > > wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> Let me start, as always, by thanking the many, many
> contributors who
> > > >> helped
> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > > >>
> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > > >>
> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > > >>
> > > >> beta1 contains 576 fixed JIRA issues comprising a number of bug
> fixes,
> > > >> improvements, and feature enhancements. Notable additions
> include the
> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> completion of
> > the
> > > >> shaded client, and HDFS erasure coding pluggable policy support.
> > > >>
> > > >> I've done the traditional testing of running a Pi job on a
> pseudo
> > > cluster.
> > > >> My +1 to start.
> > > >>
> > > >> We're working internally on getting this run through our
> integration
> > > test
> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> > complete.
> > > >>
> > > >> Best,
> > > >> Andrew
> > > >>
> > > > --
> > > >
> > > >
> > > >
> > > > --Brahma Reddy Battula
> > > >
> > >
> >
> >
> >
> > --
> > John
> >
>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Aaron Fabbri <fa...@cloudera.com>.
+1
Built from source. Ran S3A integration tests in us-west-2 with S3Guard
(both Local and Dynamo metadatastore).
Everything worked fine except I hit one integration test failure. It is a
minor test issue IMO and I've filed HADOOP-14927
Failed tests:
ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
wrote:
> +1 (non-binding)
>
> - built from source
> - deployed on single node cluster
> - Basic hdfs operations
> - Run wordcount on a text file
> Thanks,
> Ajay
>
>
> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>
> +1 (non-binding)
>
> - Verified all checksums and signatures
> - Built native from source on macOS 10.12.6 and RHEL 7.1
> - Deployed a single node pseudo cluster
> - Ran pi and sleep jobs
> - Verified Docker was marked as experimental
>
> Thanks,
>
> Eric
>
> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > - Verified checksums and signatures of all tarballs
> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> > - Verified cloud connectors:
> > - All S3A integration tests
> > - All ADL live unit tests
> > - Deployed both binary and built source to a pseudo cluster,
> passed the
> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> > - HDFS basic and ACL
> > - DistCp basic
> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> binary
> > tarball, probably unrelated)
> > - KMS and HttpFS basic
> > - Balancer start/stop
> >
> > Hit the following errors but they don't seem to be blocking:
> >
> > == Missing dependencies during build ==
> >
> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > > ERROR: hadoop-azure has missing dependencies:
> jetty-util-ajax-9.3.19.
> > > v20170502.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okhttp-2.4.0.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okio-1.4.0.jar
> >
> >
> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >
> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default
> HTTP
> > servlet /conf, /stacks, and /logLevel ==
> >
> > One example below:
> >
> > > Connecting to
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer
> > > Exception in thread "main"
> > > org.apache.hadoop.security.authentication.client.
> > AuthenticationException:
> > > Authentication failed, URL:
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer&user.name=jzhuge,
> > > status: 403, message: GSSException: Failure unspecified at GSS-API
> level
> > > (Mechanism level: Request is a replay (34))
> >
> >
> > The /logLevel failure will affect command "hadoop daemonlog".
> >
> >
> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > wrote:
> >
> > > Thanks for all the votes thus far! We've gotten the binding +1's
> to close
> > > the release, though are there contributors who could kick the
> tires on
> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> merged since
> > > alpha4, so it'd be good to get some coverage.
> > >
> > >
> > >
> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> brahma@apache.org>
> > > wrote:
> > >
> > > >
> > > > Thanks Andrew.
> > > >
> > > > +1 (non binding)
> > > >
> > > > --Built from source
> > > > --installed 3 node HA cluster
> > > > --Verified shell commands and UI
> > > > --Ran wordcount/pic jobs
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > > > wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> Let me start, as always, by thanking the many, many
> contributors who
> > > >> helped
> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > > >>
> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > > >>
> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > > >>
> > > >> beta1 contains 576 fixed JIRA issues comprising a number of bug
> fixes,
> > > >> improvements, and feature enhancements. Notable additions
> include the
> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> completion of
> > the
> > > >> shaded client, and HDFS erasure coding pluggable policy support.
> > > >>
> > > >> I've done the traditional testing of running a Pi job on a
> pseudo
> > > cluster.
> > > >> My +1 to start.
> > > >>
> > > >> We're working internally on getting this run through our
> integration
> > > test
> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> > complete.
> > > >>
> > > >> Best,
> > > >> Andrew
> > > >>
> > > > --
> > > >
> > > >
> > > >
> > > > --Brahma Reddy Battula
> > > >
> > >
> >
> >
> >
> > --
> > John
> >
>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Aaron Fabbri <fa...@cloudera.com>.
+1
Built from source. Ran S3A integration tests in us-west-2 with S3Guard
(both Local and Dynamo metadatastore).
Everything worked fine except I hit one integration test failure. It is a
minor test issue IMO and I've filed HADOOP-14927
Failed tests:
ITestS3GuardToolDynamoDB>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
ITestS3GuardToolLocal>AbstractS3GuardToolTestBase.testDestroyNoBucket:228
Expected an exception, got 0
On Tue, Oct 3, 2017 at 2:45 PM, Ajay Kumar <aj...@hortonworks.com>
wrote:
> +1 (non-binding)
>
> - built from source
> - deployed on single node cluster
> - Basic hdfs operations
> - Run wordcount on a text file
> Thanks,
> Ajay
>
>
> On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
>
> +1 (non-binding)
>
> - Verified all checksums and signatures
> - Built native from source on macOS 10.12.6 and RHEL 7.1
> - Deployed a single node pseudo cluster
> - Ran pi and sleep jobs
> - Verified Docker was marked as experimental
>
> Thanks,
>
> Eric
>
> On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com>
> wrote:
>
> > +1 (binding)
> >
> > - Verified checksums and signatures of all tarballs
> > - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> > - Verified cloud connectors:
> > - All S3A integration tests
> > - All ADL live unit tests
> > - Deployed both binary and built source to a pseudo cluster,
> passed the
> > following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> > - HDFS basic and ACL
> > - DistCp basic
> > - MapReduce wordcount (only failed in SSL+Kerberos mode for
> binary
> > tarball, probably unrelated)
> > - KMS and HttpFS basic
> > - Balancer start/stop
> >
> > Hit the following errors but they don't seem to be blocking:
> >
> > == Missing dependencies during build ==
> >
> > > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > > ERROR: hadoop-azure has missing dependencies:
> jetty-util-ajax-9.3.19.
> > > v20170502.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okhttp-2.4.0.jar
> > > ERROR: hadoop-azure-datalake has missing dependencies:
> okio-1.4.0.jar
> >
> >
> > Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
> >
> > == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default
> HTTP
> > servlet /conf, /stacks, and /logLevel ==
> >
> > One example below:
> >
> > > Connecting to
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer
> > > Exception in thread "main"
> > > org.apache.hadoop.security.authentication.client.
> > AuthenticationException:
> > > Authentication failed, URL:
> > > https://localhost:14000/logLevel?log=org.apache.
> hadoop.fs.http.server.
> > HttpFSServer&user.name=jzhuge,
> > > status: 403, message: GSSException: Failure unspecified at GSS-API
> level
> > > (Mechanism level: Request is a replay (34))
> >
> >
> > The /logLevel failure will affect command "hadoop daemonlog".
> >
> >
> > On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > wrote:
> >
> > > Thanks for all the votes thus far! We've gotten the binding +1's
> to close
> > > the release, though are there contributors who could kick the
> tires on
> > > S3Guard and YARN TSv2 alpha2? These are the two new features
> merged since
> > > alpha4, so it'd be good to get some coverage.
> > >
> > >
> > >
> > > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <
> brahma@apache.org>
> > > wrote:
> > >
> > > >
> > > > Thanks Andrew.
> > > >
> > > > +1 (non binding)
> > > >
> > > > --Built from source
> > > > --installed 3 node HA cluster
> > > > --Verified shell commands and UI
> > > > --Ran wordcount/pic jobs
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <
> andrew.wang@cloudera.com>
> > > > wrote:
> > > >
> > > >> Hi all,
> > > >>
> > > >> Let me start, as always, by thanking the many, many
> contributors who
> > > >> helped
> > > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > > >>
> > > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > > >>
> > > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > > >>
> > > >> beta1 contains 576 fixed JIRA issues comprising a number of bug
> fixes,
> > > >> improvements, and feature enhancements. Notable additions
> include the
> > > >> addition of YARN Timeline Service v2 alpha2, S3Guard,
> completion of
> > the
> > > >> shaded client, and HDFS erasure coding pluggable policy support.
> > > >>
> > > >> I've done the traditional testing of running a Pi job on a
> pseudo
> > > cluster.
> > > >> My +1 to start.
> > > >>
> > > >> We're working internally on getting this run through our
> integration
> > > test
> > > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> > complete.
> > > >>
> > > >> Best,
> > > >> Andrew
> > > >>
> > > > --
> > > >
> > > >
> > > >
> > > > --Brahma Reddy Battula
> > > >
> > >
> >
> >
> >
> > --
> > John
> >
>
>
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Ajay Kumar <aj...@hortonworks.com>.
+1 (non-binding)
- built from source
- deployed on single node cluster
- Basic hdfs operations
- Run wordcount on a text file
Thanks,
Ajay
On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Ajay Kumar <aj...@hortonworks.com>.
+1 (non-binding)
- built from source
- deployed on single node cluster
- Basic hdfs operations
- Run wordcount on a text file
Thanks,
Ajay
On 10/3/17, 1:04 PM, "Eric Badger" <eb...@oath.com.INVALID> wrote:
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Badger <eb...@oath.com.INVALID>.
+1 (non-binding)
- Verified all checksums and signatures
- Built native from source on macOS 10.12.6 and RHEL 7.1
- Deployed a single node pseudo cluster
- Ran pi and sleep jobs
- Verified Docker was marked as experimental
Thanks,
Eric
On Tue, Oct 3, 2017 at 1:41 PM, John Zhuge <jo...@gmail.com> wrote:
> +1 (binding)
>
> - Verified checksums and signatures of all tarballs
> - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
> - Verified cloud connectors:
> - All S3A integration tests
> - All ADL live unit tests
> - Deployed both binary and built source to a pseudo cluster, passed the
> following sanity tests in insecure, SSL, and SSL+Kerberos mode:
> - HDFS basic and ACL
> - DistCp basic
> - MapReduce wordcount (only failed in SSL+Kerberos mode for binary
> tarball, probably unrelated)
> - KMS and HttpFS basic
> - Balancer start/stop
>
> Hit the following errors but they don't seem to be blocking:
>
> == Missing dependencies during build ==
>
> > ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> > ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> > v20170502.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> > ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
>
>
> Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
>
> == Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
> servlet /conf, /stacks, and /logLevel ==
>
> One example below:
>
> > Connecting to
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer
> > Exception in thread "main"
> > org.apache.hadoop.security.authentication.client.
> AuthenticationException:
> > Authentication failed, URL:
> > https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.
> HttpFSServer&user.name=jzhuge,
> > status: 403, message: GSSException: Failure unspecified at GSS-API level
> > (Mechanism level: Request is a replay (34))
>
>
> The /logLevel failure will affect command "hadoop daemonlog".
>
>
> On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
> > Thanks for all the votes thus far! We've gotten the binding +1's to close
> > the release, though are there contributors who could kick the tires on
> > S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> > alpha4, so it'd be good to get some coverage.
> >
> >
> >
> > On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > >
> > > Thanks Andrew.
> > >
> > > +1 (non binding)
> > >
> > > --Built from source
> > > --installed 3 node HA cluster
> > > --Verified shell commands and UI
> > > --Ran wordcount/pic jobs
> > >
> > >
> > >
> > >
> > > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > > wrote:
> > >
> > >> Hi all,
> > >>
> > >> Let me start, as always, by thanking the many, many contributors who
> > >> helped
> > >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> > >>
> > >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> > >>
> > >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> > >>
> > >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> > >> improvements, and feature enhancements. Notable additions include the
> > >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of
> the
> > >> shaded client, and HDFS erasure coding pluggable policy support.
> > >>
> > >> I've done the traditional testing of running a Pi job on a pseudo
> > cluster.
> > >> My +1 to start.
> > >>
> > >> We're working internally on getting this run through our integration
> > test
> > >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's
> complete.
> > >>
> > >> Best,
> > >> Andrew
> > >>
> > > --
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
> >
>
>
>
> --
> John
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by John Zhuge <jo...@gmail.com>.
+1 (binding)
- Verified checksums and signatures of all tarballs
- Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
- Verified cloud connectors:
- All S3A integration tests
- All ADL live unit tests
- Deployed both binary and built source to a pseudo cluster, passed the
following sanity tests in insecure, SSL, and SSL+Kerberos mode:
- HDFS basic and ACL
- DistCp basic
- MapReduce wordcount (only failed in SSL+Kerberos mode for binary
tarball, probably unrelated)
- KMS and HttpFS basic
- Balancer start/stop
Hit the following errors but they don't seem to be blocking:
== Missing dependencies during build ==
> ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> v20170502.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
== Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
servlet /conf, /stacks, and /logLevel ==
One example below:
> Connecting to
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer
> Exception in thread "main"
> org.apache.hadoop.security.authentication.client.AuthenticationException:
> Authentication failed, URL:
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer&user.name=jzhuge,
> status: 403, message: GSSException: Failure unspecified at GSS-API level
> (Mechanism level: Request is a replay (34))
The /logLevel failure will affect command "hadoop daemonlog".
On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Thanks for all the votes thus far! We've gotten the binding +1's to close
> the release, though are there contributors who could kick the tires on
> S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> alpha4, so it'd be good to get some coverage.
>
>
>
> On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> >
> > Thanks Andrew.
> >
> > +1 (non binding)
> >
> > --Built from source
> > --installed 3 node HA cluster
> > --Verified shell commands and UI
> > --Ran wordcount/pic jobs
> >
> >
> >
> >
> > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Let me start, as always, by thanking the many, many contributors who
> >> helped
> >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >>
> >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >>
> >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> >>
> >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> >> improvements, and feature enhancements. Notable additions include the
> >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> >> shaded client, and HDFS erasure coding pluggable policy support.
> >>
> >> I've done the traditional testing of running a Pi job on a pseudo
> cluster.
> >> My +1 to start.
> >>
> >> We're working internally on getting this run through our integration
> test
> >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
> >>
> >> Best,
> >> Andrew
> >>
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
John
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by John Zhuge <jo...@gmail.com>.
+1 (binding)
- Verified checksums and signatures of all tarballs
- Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
- Verified cloud connectors:
- All S3A integration tests
- All ADL live unit tests
- Deployed both binary and built source to a pseudo cluster, passed the
following sanity tests in insecure, SSL, and SSL+Kerberos mode:
- HDFS basic and ACL
- DistCp basic
- MapReduce wordcount (only failed in SSL+Kerberos mode for binary
tarball, probably unrelated)
- KMS and HttpFS basic
- Balancer start/stop
Hit the following errors but they don't seem to be blocking:
== Missing dependencies during build ==
> ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> v20170502.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
== Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
servlet /conf, /stacks, and /logLevel ==
One example below:
> Connecting to
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer
> Exception in thread "main"
> org.apache.hadoop.security.authentication.client.AuthenticationException:
> Authentication failed, URL:
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer&user.name=jzhuge,
> status: 403, message: GSSException: Failure unspecified at GSS-API level
> (Mechanism level: Request is a replay (34))
The /logLevel failure will affect command "hadoop daemonlog".
On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Thanks for all the votes thus far! We've gotten the binding +1's to close
> the release, though are there contributors who could kick the tires on
> S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> alpha4, so it'd be good to get some coverage.
>
>
>
> On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> >
> > Thanks Andrew.
> >
> > +1 (non binding)
> >
> > --Built from source
> > --installed 3 node HA cluster
> > --Verified shell commands and UI
> > --Ran wordcount/pic jobs
> >
> >
> >
> >
> > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Let me start, as always, by thanking the many, many contributors who
> >> helped
> >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >>
> >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >>
> >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> >>
> >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> >> improvements, and feature enhancements. Notable additions include the
> >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> >> shaded client, and HDFS erasure coding pluggable policy support.
> >>
> >> I've done the traditional testing of running a Pi job on a pseudo
> cluster.
> >> My +1 to start.
> >>
> >> We're working internally on getting this run through our integration
> test
> >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
> >>
> >> Best,
> >> Andrew
> >>
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
John
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by John Zhuge <jo...@gmail.com>.
+1 (binding)
- Verified checksums and signatures of all tarballs
- Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
- Verified cloud connectors:
- All S3A integration tests
- All ADL live unit tests
- Deployed both binary and built source to a pseudo cluster, passed the
following sanity tests in insecure, SSL, and SSL+Kerberos mode:
- HDFS basic and ACL
- DistCp basic
- MapReduce wordcount (only failed in SSL+Kerberos mode for binary
tarball, probably unrelated)
- KMS and HttpFS basic
- Balancer start/stop
Hit the following errors but they don't seem to be blocking:
== Missing dependencies during build ==
> ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> v20170502.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
== Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
servlet /conf, /stacks, and /logLevel ==
One example below:
> Connecting to
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer
> Exception in thread "main"
> org.apache.hadoop.security.authentication.client.AuthenticationException:
> Authentication failed, URL:
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer&user.name=jzhuge,
> status: 403, message: GSSException: Failure unspecified at GSS-API level
> (Mechanism level: Request is a replay (34))
The /logLevel failure will affect command "hadoop daemonlog".
On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Thanks for all the votes thus far! We've gotten the binding +1's to close
> the release, though are there contributors who could kick the tires on
> S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> alpha4, so it'd be good to get some coverage.
>
>
>
> On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> >
> > Thanks Andrew.
> >
> > +1 (non binding)
> >
> > --Built from source
> > --installed 3 node HA cluster
> > --Verified shell commands and UI
> > --Ran wordcount/pic jobs
> >
> >
> >
> >
> > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Let me start, as always, by thanking the many, many contributors who
> >> helped
> >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >>
> >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >>
> >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> >>
> >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> >> improvements, and feature enhancements. Notable additions include the
> >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> >> shaded client, and HDFS erasure coding pluggable policy support.
> >>
> >> I've done the traditional testing of running a Pi job on a pseudo
> cluster.
> >> My +1 to start.
> >>
> >> We're working internally on getting this run through our integration
> test
> >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
> >>
> >> Best,
> >> Andrew
> >>
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
John
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by John Zhuge <jo...@gmail.com>.
+1 (binding)
- Verified checksums and signatures of all tarballs
- Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6
- Verified cloud connectors:
- All S3A integration tests
- All ADL live unit tests
- Deployed both binary and built source to a pseudo cluster, passed the
following sanity tests in insecure, SSL, and SSL+Kerberos mode:
- HDFS basic and ACL
- DistCp basic
- MapReduce wordcount (only failed in SSL+Kerberos mode for binary
tarball, probably unrelated)
- KMS and HttpFS basic
- Balancer start/stop
Hit the following errors but they don't seem to be blocking:
== Missing dependencies during build ==
> ERROR: hadoop-aliyun has missing dependencies: json-lib-jdk15.jar
> ERROR: hadoop-azure has missing dependencies: jetty-util-ajax-9.3.19.
> v20170502.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okhttp-2.4.0.jar
> ERROR: hadoop-azure-datalake has missing dependencies: okio-1.4.0.jar
Filed HADOOP-14923, HADOOP-14924, and HADOOP-14925.
== Unit tests failed in Kerberos+SSL mode for KMS and HttpFs default HTTP
servlet /conf, /stacks, and /logLevel ==
One example below:
> Connecting to
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer
> Exception in thread "main"
> org.apache.hadoop.security.authentication.client.AuthenticationException:
> Authentication failed, URL:
> https://localhost:14000/logLevel?log=org.apache.hadoop.fs.http.server.HttpFSServer&user.name=jzhuge,
> status: 403, message: GSSException: Failure unspecified at GSS-API level
> (Mechanism level: Request is a replay (34))
The /logLevel failure will affect command "hadoop daemonlog".
On Tue, Oct 3, 2017 at 10:56 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Thanks for all the votes thus far! We've gotten the binding +1's to close
> the release, though are there contributors who could kick the tires on
> S3Guard and YARN TSv2 alpha2? These are the two new features merged since
> alpha4, so it'd be good to get some coverage.
>
>
>
> On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> >
> > Thanks Andrew.
> >
> > +1 (non binding)
> >
> > --Built from source
> > --installed 3 node HA cluster
> > --Verified shell commands and UI
> > --Ran wordcount/pic jobs
> >
> >
> >
> >
> > On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> > wrote:
> >
> >> Hi all,
> >>
> >> Let me start, as always, by thanking the many, many contributors who
> >> helped
> >> with this release! I've prepared an RC0 for 3.0.0-beta1:
> >>
> >> http://home.apache.org/~wang/3.0.0-beta1-RC0/
> >>
> >> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
> >>
> >> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> >> improvements, and feature enhancements. Notable additions include the
> >> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> >> shaded client, and HDFS erasure coding pluggable policy support.
> >>
> >> I've done the traditional testing of running a Pi job on a pseudo
> cluster.
> >> My +1 to start.
> >>
> >> We're working internally on getting this run through our integration
> test
> >> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
> >>
> >> Best,
> >> Andrew
> >>
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
John
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for all the votes thus far! We've gotten the binding +1's to close
the release, though are there contributors who could kick the tires on
S3Guard and YARN TSv2 alpha2? These are the two new features merged since
alpha4, so it'd be good to get some coverage.
On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
wrote:
>
> Thanks Andrew.
>
> +1 (non binding)
>
> --Built from source
> --installed 3 node HA cluster
> --Verified shell commands and UI
> --Ran wordcount/pic jobs
>
>
>
>
> On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
>> Hi all,
>>
>> Let me start, as always, by thanking the many, many contributors who
>> helped
>> with this release! I've prepared an RC0 for 3.0.0-beta1:
>>
>> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>>
>> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>>
>> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
>> improvements, and feature enhancements. Notable additions include the
>> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
>> shaded client, and HDFS erasure coding pluggable policy support.
>>
>> I've done the traditional testing of running a Pi job on a pseudo cluster.
>> My +1 to start.
>>
>> We're working internally on getting this run through our integration test
>> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>>
>> Best,
>> Andrew
>>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for all the votes thus far! We've gotten the binding +1's to close
the release, though are there contributors who could kick the tires on
S3Guard and YARN TSv2 alpha2? These are the two new features merged since
alpha4, so it'd be good to get some coverage.
On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
wrote:
>
> Thanks Andrew.
>
> +1 (non binding)
>
> --Built from source
> --installed 3 node HA cluster
> --Verified shell commands and UI
> --Ran wordcount/pic jobs
>
>
>
>
> On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
>> Hi all,
>>
>> Let me start, as always, by thanking the many, many contributors who
>> helped
>> with this release! I've prepared an RC0 for 3.0.0-beta1:
>>
>> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>>
>> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>>
>> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
>> improvements, and feature enhancements. Notable additions include the
>> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
>> shaded client, and HDFS erasure coding pluggable policy support.
>>
>> I've done the traditional testing of running a Pi job on a pseudo cluster.
>> My +1 to start.
>>
>> We're working internally on getting this run through our integration test
>> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>>
>> Best,
>> Andrew
>>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for all the votes thus far! We've gotten the binding +1's to close
the release, though are there contributors who could kick the tires on
S3Guard and YARN TSv2 alpha2? These are the two new features merged since
alpha4, so it'd be good to get some coverage.
On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
wrote:
>
> Thanks Andrew.
>
> +1 (non binding)
>
> --Built from source
> --installed 3 node HA cluster
> --Verified shell commands and UI
> --Ran wordcount/pic jobs
>
>
>
>
> On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
>> Hi all,
>>
>> Let me start, as always, by thanking the many, many contributors who
>> helped
>> with this release! I've prepared an RC0 for 3.0.0-beta1:
>>
>> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>>
>> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>>
>> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
>> improvements, and feature enhancements. Notable additions include the
>> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
>> shaded client, and HDFS erasure coding pluggable policy support.
>>
>> I've done the traditional testing of running a Pi job on a pseudo cluster.
>> My +1 to start.
>>
>> We're working internally on getting this run through our integration test
>> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>>
>> Best,
>> Andrew
>>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Andrew Wang <an...@cloudera.com>.
Thanks for all the votes thus far! We've gotten the binding +1's to close
the release, though are there contributors who could kick the tires on
S3Guard and YARN TSv2 alpha2? These are the two new features merged since
alpha4, so it'd be good to get some coverage.
On Tue, Oct 3, 2017 at 9:45 AM, Brahma Reddy Battula <br...@apache.org>
wrote:
>
> Thanks Andrew.
>
> +1 (non binding)
>
> --Built from source
> --installed 3 node HA cluster
> --Verified shell commands and UI
> --Ran wordcount/pic jobs
>
>
>
>
> On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
> wrote:
>
>> Hi all,
>>
>> Let me start, as always, by thanking the many, many contributors who
>> helped
>> with this release! I've prepared an RC0 for 3.0.0-beta1:
>>
>> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>>
>> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>>
>> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
>> improvements, and feature enhancements. Notable additions include the
>> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
>> shaded client, and HDFS erasure coding pluggable policy support.
>>
>> I've done the traditional testing of running a Pi job on a pseudo cluster.
>> My +1 to start.
>>
>> We're working internally on getting this run through our integration test
>> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>>
>> Best,
>> Andrew
>>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Andrew.
+1 (non binding)
--Built from source
--installed 3 node HA cluster
--Verified shell commands and UI
--Ran wordcount/pic jobs
On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
--
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Vijaya Krishna Kalluru Subbarao <vi...@cloudera.com>.
+1 non-binding.
Ran Smokes and BVTs covering basic sanity testing(10+ tests ran) for all
these components:
Mapreduce(compression, archives, pipes, JHS),
Avro(AvroMapreduce, HadoopAvro, HiveAvro, SqoopAvro),
HBase(Balancer, compression, ImportExport, Snapshots, Schema change),
Oozie(Hive, Pig, Spark),
Pig(PigAvro, PigParquet, PigCompression),
Search(SolrCtlBasic, SolrRequestForwading, SolrSSLConfiguration).
Regards,
Vijay
On Mon, Oct 2, 2017 at 9:43 AM, Eric Payne <er...@yahoo.com.invalid>
wrote:
> +1 (binding)
> Thanks Andrew for all of your very diligent efforts.
> Build from source, installed on a 6-node pseudo cluster, and successfully
> tested the following manual use cases:
> o MapReduce sleep job
> o MapReduce streaming jobœ
> o Cross-queue (inter-queue) preemption
> o In-queue (intra-queue) preemption, both USERFIRST and PRIORITYFIRST
> o User weights not equals to 1
> o User weights in conjunction with in-queue preemption.
> -Eric Payne
>
> From: Andrew Wang <an...@cloudera.com>
> To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>; "
> hdfs-dev@hadoop.apache.org" <hd...@hadoop.apache.org>; "
> mapreduce-dev@hadoop.apache.org" <ma...@hadoop.apache.org>; "
> yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>
> Sent: Thursday, September 28, 2017 7:04 PM
> Subject: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
>
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
>
>
>
--
Thanks,
Vijay
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
+1 (binding)
Thanks Andrew for all of your very diligent efforts.
Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases:
o MapReduce sleep job
o MapReduce streaming jobœ
o Cross-queue (inter-queue) preemption
o In-queue (intra-queue) preemption, both USERFIRST and PRIORITYFIRST
o User weights not equals to 1
o User weights in conjunction with in-queue preemption.
-Eric Payne
From: Andrew Wang <an...@cloudera.com>
To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>; "hdfs-dev@hadoop.apache.org" <hd...@hadoop.apache.org>; "mapreduce-dev@hadoop.apache.org" <ma...@hadoop.apache.org>; "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>
Sent: Thursday, September 28, 2017 7:04 PM
Subject: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Hi all,
Let me start, as always, by thanking the many, many contributors who helped
with this release! I've prepared an RC0 for 3.0.0-beta1:
http://home.apache.org/~wang/3.0.0-beta1-RC0/
This vote will run five days, ending on Nov 3rd at 5PM Pacific.
beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
improvements, and feature enhancements. Notable additions include the
addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
shaded client, and HDFS erasure coding pluggable policy support.
I've done the traditional testing of running a Pi job on a pseudo cluster.
My +1 to start.
We're working internally on getting this run through our integration test
rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
Best,
Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Xiao Chen <xi...@cloudera.com>.
Thanks Andrew!
+1 (binding)
- Verified md5 matches
- Built from src tarball
- Started pseudo-distributed hdfs cluster with kms, ran basic operations
- Sanity checked logs and NN webui
P.S. Obviously Andrew meant to say Oct. 3rd, not November. :)
-Xiao
On Thu, Sep 28, 2017 at 5:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by "Marton, Elek" <hd...@anzix.net>.
+1 (non-binding)
* Built from the source
* Installed dockerized YARN/HADOOP cluster to a 20 node cluster
(scheduled with nomad, configured from consul, docker host networking)
* Started example yarn jobs (teragen/terasort) and hdfs dfs commands +
checking UIs
I noticed only two very minor issues (changelog of HADOOP-9902 didn't
mention that I need a writable 'logs' dir, even with custom
log4j.properties; and there was a space typo in yarn error message
https://issues.apache.org/jira/browse/YARN-7279)
Marton
On 09/29/2017 02:04 AM, Andrew Wang wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rushabh Shah <ru...@oath.com.INVALID>.
Thank you Andrew for all your efforts.
+1 non-binding.
Built from source.
Started 1 node pseudo cluster.
Ran sleep and pi job.
Except for YARN-6999 <https://issues.apache.org/jira/browse/YARN-6999> I
didn't face any issues.
On Thu, Sep 28, 2017 at 7:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
+1 (binding)
Thanks Andrew for all of your very diligent efforts.
Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases:
o MapReduce sleep job
o MapReduce streaming jobœ
o Cross-queue (inter-queue) preemption
o In-queue (intra-queue) preemption, both USERFIRST and PRIORITYFIRST
o User weights not equals to 1
o User weights in conjunction with in-queue preemption.
-Eric Payne
From: Andrew Wang <an...@cloudera.com>
To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>; "hdfs-dev@hadoop.apache.org" <hd...@hadoop.apache.org>; "mapreduce-dev@hadoop.apache.org" <ma...@hadoop.apache.org>; "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>
Sent: Thursday, September 28, 2017 7:04 PM
Subject: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Hi all,
Let me start, as always, by thanking the many, many contributors who helped
with this release! I've prepared an RC0 for 3.0.0-beta1:
http://home.apache.org/~wang/3.0.0-beta1-RC0/
This vote will run five days, ending on Nov 3rd at 5PM Pacific.
beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
improvements, and feature enhancements. Notable additions include the
addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
shaded client, and HDFS erasure coding pluggable policy support.
I've done the traditional testing of running a Pi job on a pseudo cluster.
My +1 to start.
We're working internally on getting this run through our integration test
rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
Best,
Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Rushabh Shah <ru...@oath.com.INVALID>.
Thank you Andrew for all your efforts.
+1 non-binding.
Built from source.
Started 1 node pseudo cluster.
Ran sleep and pi job.
Except for YARN-6999 <https://issues.apache.org/jira/browse/YARN-6999> I
didn't face any issues.
On Thu, Sep 28, 2017 at 7:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Xiao Chen <xi...@cloudera.com>.
Thanks Andrew!
+1 (binding)
- Verified md5 matches
- Built from src tarball
- Started pseudo-distributed hdfs cluster with kms, ran basic operations
- Sanity checked logs and NN webui
P.S. Obviously Andrew meant to say Oct. 3rd, not November. :)
-Xiao
On Thu, Sep 28, 2017 at 5:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Andrew.
+1 (non binding)
--Built from source
--installed 3 node HA cluster
--Verified shell commands and UI
--Ran wordcount/pic jobs
On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
--
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by "Marton, Elek" <hd...@anzix.net>.
+1 (non-binding)
* Built from the source
* Installed dockerized YARN/HADOOP cluster to a 20 node cluster
(scheduled with nomad, configured from consul, docker host networking)
* Started example yarn jobs (teragen/terasort) and hdfs dfs commands +
checking UIs
I noticed only two very minor issues (changelog of HADOOP-9902 didn't
mention that I need a writable 'logs' dir, even with custom
log4j.properties; and there was a space typo in yarn error message
https://issues.apache.org/jira/browse/YARN-7279)
Marton
On 09/29/2017 02:04 AM, Andrew Wang wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Andrew.
+1 (non binding)
--Built from source
--installed 3 node HA cluster
--Verified shell commands and UI
--Ran wordcount/pic jobs
On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
--
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Xiao Chen <xi...@cloudera.com>.
Thanks Andrew!
+1 (binding)
- Verified md5 matches
- Built from src tarball
- Started pseudo-distributed hdfs cluster with kms, ran basic operations
- Sanity checked logs and NN webui
P.S. Obviously Andrew meant to say Oct. 3rd, not November. :)
-Xiao
On Thu, Sep 28, 2017 at 5:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
+1 (binding)
Thanks Andrew for all of your very diligent efforts.
Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases:
o MapReduce sleep job
o MapReduce streaming jobœ
o Cross-queue (inter-queue) preemption
o In-queue (intra-queue) preemption, both USERFIRST and PRIORITYFIRST
o User weights not equals to 1
o User weights in conjunction with in-queue preemption.
-Eric Payne
From: Andrew Wang <an...@cloudera.com>
To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>; "hdfs-dev@hadoop.apache.org" <hd...@hadoop.apache.org>; "mapreduce-dev@hadoop.apache.org" <ma...@hadoop.apache.org>; "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>
Sent: Thursday, September 28, 2017 7:04 PM
Subject: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Hi all,
Let me start, as always, by thanking the many, many contributors who helped
with this release! I've prepared an RC0 for 3.0.0-beta1:
http://home.apache.org/~wang/3.0.0-beta1-RC0/
This vote will run five days, ending on Nov 3rd at 5PM Pacific.
beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
improvements, and feature enhancements. Notable additions include the
addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
shaded client, and HDFS erasure coding pluggable policy support.
I've done the traditional testing of running a Pi job on a pseudo cluster.
My +1 to start.
We're working internally on getting this run through our integration test
rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
Best,
Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Eric Payne <er...@yahoo.com.INVALID>.
+1 (binding)
Thanks Andrew for all of your very diligent efforts.
Build from source, installed on a 6-node pseudo cluster, and successfully tested the following manual use cases:
o MapReduce sleep job
o MapReduce streaming jobœ
o Cross-queue (inter-queue) preemption
o In-queue (intra-queue) preemption, both USERFIRST and PRIORITYFIRST
o User weights not equals to 1
o User weights in conjunction with in-queue preemption.
-Eric Payne
From: Andrew Wang <an...@cloudera.com>
To: "common-dev@hadoop.apache.org" <co...@hadoop.apache.org>; "hdfs-dev@hadoop.apache.org" <hd...@hadoop.apache.org>; "mapreduce-dev@hadoop.apache.org" <ma...@hadoop.apache.org>; "yarn-dev@hadoop.apache.org" <ya...@hadoop.apache.org>
Sent: Thursday, September 28, 2017 7:04 PM
Subject: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Hi all,
Let me start, as always, by thanking the many, many contributors who helped
with this release! I've prepared an RC0 for 3.0.0-beta1:
http://home.apache.org/~wang/3.0.0-beta1-RC0/
This vote will run five days, ending on Nov 3rd at 5PM Pacific.
beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
improvements, and feature enhancements. Notable additions include the
addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
shaded client, and HDFS erasure coding pluggable policy support.
I've done the traditional testing of running a Pi job on a pseudo cluster.
My +1 to start.
We're working internally on getting this run through our integration test
rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
Best,
Andrew
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Xiao Chen <xi...@cloudera.com>.
Thanks Andrew!
+1 (binding)
- Verified md5 matches
- Built from src tarball
- Started pseudo-distributed hdfs cluster with kms, ran basic operations
- Sanity checked logs and NN webui
P.S. Obviously Andrew meant to say Oct. 3rd, not November. :)
-Xiao
On Thu, Sep 28, 2017 at 5:04 PM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by "Marton, Elek" <hd...@anzix.net>.
+1 (non-binding)
* Built from the source
* Installed dockerized YARN/HADOOP cluster to a 20 node cluster
(scheduled with nomad, configured from consul, docker host networking)
* Started example yarn jobs (teragen/terasort) and hdfs dfs commands +
checking UIs
I noticed only two very minor issues (changelog of HADOOP-9902 didn't
mention that I need a writable 'logs' dir, even with custom
log4j.properties; and there was a space typo in yarn error message
https://issues.apache.org/jira/browse/YARN-7279)
Marton
On 09/29/2017 02:04 AM, Andrew Wang wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by "Marton, Elek" <hd...@anzix.net>.
+1 (non-binding)
* Built from the source
* Installed dockerized YARN/HADOOP cluster to a 20 node cluster
(scheduled with nomad, configured from consul, docker host networking)
* Started example yarn jobs (teragen/terasort) and hdfs dfs commands +
checking UIs
I noticed only two very minor issues (changelog of HADOOP-9902 didn't
mention that I need a writable 'logs' dir, even with custom
log4j.properties; and there was a space typo in yarn error message
https://issues.apache.org/jira/browse/YARN-7279)
Marton
On 09/29/2017 02:04 AM, Andrew Wang wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Andrew.
+1 (non binding)
--Built from source
--installed 3 node HA cluster
--Verified shell commands and UI
--Ran wordcount/pic jobs
On Fri, 29 Sep 2017 at 5:34 AM, Andrew Wang <an...@cloudera.com>
wrote:
> Hi all,
>
> Let me start, as always, by thanking the many, many contributors who helped
> with this release! I've prepared an RC0 for 3.0.0-beta1:
>
> http://home.apache.org/~wang/3.0.0-beta1-RC0/
>
> This vote will run five days, ending on Nov 3rd at 5PM Pacific.
>
> beta1 contains 576 fixed JIRA issues comprising a number of bug fixes,
> improvements, and feature enhancements. Notable additions include the
> addition of YARN Timeline Service v2 alpha2, S3Guard, completion of the
> shaded client, and HDFS erasure coding pluggable policy support.
>
> I've done the traditional testing of running a Pi job on a pseudo cluster.
> My +1 to start.
>
> We're working internally on getting this run through our integration test
> rig. I'm hoping Vijay or Ray can ring in with a +1 once that's complete.
>
> Best,
> Andrew
>
--
--Brahma Reddy Battula