You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Rohith Sharma K S <ro...@apache.org> on 2019/09/11 07:26:21 UTC
[VOTE] Release Apache Hadoop 3.2.1 - RC0
Hi folks,
I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
The RC is available at:
http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
The RC tag in git is release-3.2.1-RC0:
https://github.com/apache/hadoop/tree/release-3.2.1-RC0
The maven artifacts are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1226/
You can find my public key at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
PST.
I have done testing with a pseudo cluster and distributed shell job. My +1
to start.
Thanks & Regards
Rohith Sharma K S
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Dinesh Chitlangia <dc...@cloudera.com.INVALID>.
+1 (non-binding)
- built from the source on centos7
- verified signatures & sha512 checksums
- verified basic HDFS operations with CLI
As Steve already mentioned, we must mention about Guava.
Thanks for organizing the release Rohit.
Thanks,
Dinesh
On Wed, Sep 18, 2019 at 2:20 PM Steve Loughran <st...@cloudera.com.invalid>
wrote:
> On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <
> rohithsharmaks@apache.org>
> wrote:
>
> > Thanks Steve for detailed verification. Inline comment
> >
> > On Wed, 18 Sep 2019 at 20:34, Steve Loughran <stevel@cloudera.com.invalid
> >
> > wrote:
> >
> > > >
> > > > +1 binding.
> > > >
> > > > One caveat: warn people that guava is now at 27.0 -and that if you
> run
> > > > with an older version of Guava things will inevitably break.
> > >
> > >>>>>: Could you please suggest what is the process to follow now If I
> want
> > to add into release notes? Should I withdraw RC0 and recreate RC1 with
> > updated Release note in corresponding JIRA so that release script will
> pick
> > up that? Or any other way?
> >
>
>
> no, just remember to mention it to people. Though they'll find out soon
> enough...
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Prabhu Joseph <pr...@gmail.com>.
Have setup Hadoop-3.2.1 Cluster with ATSV2 and Hbase-2.0.6. Have verified
ATSV2 setup and REST Api as per below doc and it works as expected.
https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html
+1 (non-binding)
On Wed, Sep 18, 2019 at 11:50 PM Steve Loughran <st...@cloudera.com.invalid>
wrote:
> On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <
> rohithsharmaks@apache.org>
> wrote:
>
> > Thanks Steve for detailed verification. Inline comment
> >
> > On Wed, 18 Sep 2019 at 20:34, Steve Loughran <stevel@cloudera.com.invalid
> >
> > wrote:
> >
> > > >
> > > > +1 binding.
> > > >
> > > > One caveat: warn people that guava is now at 27.0 -and that if you
> run
> > > > with an older version of Guava things will inevitably break.
> > >
> > >>>>>: Could you please suggest what is the process to follow now If I
> want
> > to add into release notes? Should I withdraw RC0 and recreate RC1 with
> > updated Release note in corresponding JIRA so that release script will
> pick
> > up that? Or any other way?
> >
>
>
> no, just remember to mention it to people. Though they'll find out soon
> enough...
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Dinesh Chitlangia <dc...@cloudera.com.INVALID>.
+1 (non-binding)
- built from the source on centos7
- verified signatures & sha512 checksums
- verified basic HDFS operations with CLI
As Steve already mentioned, we must mention about Guava.
Thanks for organizing the release Rohit.
Thanks,
Dinesh
On Wed, Sep 18, 2019 at 2:20 PM Steve Loughran <st...@cloudera.com.invalid>
wrote:
> On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <
> rohithsharmaks@apache.org>
> wrote:
>
> > Thanks Steve for detailed verification. Inline comment
> >
> > On Wed, 18 Sep 2019 at 20:34, Steve Loughran <stevel@cloudera.com.invalid
> >
> > wrote:
> >
> > > >
> > > > +1 binding.
> > > >
> > > > One caveat: warn people that guava is now at 27.0 -and that if you
> run
> > > > with an older version of Guava things will inevitably break.
> > >
> > >>>>>: Could you please suggest what is the process to follow now If I
> want
> > to add into release notes? Should I withdraw RC0 and recreate RC1 with
> > updated Release note in corresponding JIRA so that release script will
> pick
> > up that? Or any other way?
> >
>
>
> no, just remember to mention it to people. Though they'll find out soon
> enough...
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Dinesh Chitlangia <dc...@cloudera.com.INVALID>.
+1 (non-binding)
- built from the source on centos7
- verified signatures & sha512 checksums
- verified basic HDFS operations with CLI
As Steve already mentioned, we must mention about Guava.
Thanks for organizing the release Rohit.
Thanks,
Dinesh
On Wed, Sep 18, 2019 at 2:20 PM Steve Loughran <st...@cloudera.com.invalid>
wrote:
> On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <
> rohithsharmaks@apache.org>
> wrote:
>
> > Thanks Steve for detailed verification. Inline comment
> >
> > On Wed, 18 Sep 2019 at 20:34, Steve Loughran <stevel@cloudera.com.invalid
> >
> > wrote:
> >
> > > >
> > > > +1 binding.
> > > >
> > > > One caveat: warn people that guava is now at 27.0 -and that if you
> run
> > > > with an older version of Guava things will inevitably break.
> > >
> > >>>>>: Could you please suggest what is the process to follow now If I
> want
> > to add into release notes? Should I withdraw RC0 and recreate RC1 with
> > updated Release note in corresponding JIRA so that release script will
> pick
> > up that? Or any other way?
> >
>
>
> no, just remember to mention it to people. Though they'll find out soon
> enough...
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Steve for detailed verification. Inline comment
>
> On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
> wrote:
>
> > >
> > > +1 binding.
> > >
> > > One caveat: warn people that guava is now at 27.0 -and that if you run
> > > with an older version of Guava things will inevitably break.
> >
> >>>>>: Could you please suggest what is the process to follow now If I want
> to add into release notes? Should I withdraw RC0 and recreate RC1 with
> updated Release note in corresponding JIRA so that release script will pick
> up that? Or any other way?
>
no, just remember to mention it to people. Though they'll find out soon
enough...
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Steve for detailed verification. Inline comment
>
> On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
> wrote:
>
> > >
> > > +1 binding.
> > >
> > > One caveat: warn people that guava is now at 27.0 -and that if you run
> > > with an older version of Guava things will inevitably break.
> >
> >>>>>: Could you please suggest what is the process to follow now If I want
> to add into release notes? Should I withdraw RC0 and recreate RC1 with
> updated Release note in corresponding JIRA so that release script will pick
> up that? Or any other way?
>
no, just remember to mention it to people. Though they'll find out soon
enough...
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Steve for detailed verification. Inline comment
>
> On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
> wrote:
>
> > >
> > > +1 binding.
> > >
> > > One caveat: warn people that guava is now at 27.0 -and that if you run
> > > with an older version of Guava things will inevitably break.
> >
> >>>>>: Could you please suggest what is the process to follow now If I want
> to add into release notes? Should I withdraw RC0 and recreate RC1 with
> updated Release note in corresponding JIRA so that release script will pick
> up that? Or any other way?
>
no, just remember to mention it to people. Though they'll find out soon
enough...
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
On Wed, Sep 18, 2019 at 6:04 PM Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Steve for detailed verification. Inline comment
>
> On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
> wrote:
>
> > >
> > > +1 binding.
> > >
> > > One caveat: warn people that guava is now at 27.0 -and that if you run
> > > with an older version of Guava things will inevitably break.
> >
> >>>>>: Could you please suggest what is the process to follow now If I want
> to add into release notes? Should I withdraw RC0 and recreate RC1 with
> updated Release note in corresponding JIRA so that release script will pick
> up that? Or any other way?
>
no, just remember to mention it to people. Though they'll find out soon
enough...
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Steve for detailed verification. Inline comment
On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
wrote:
> >
> > +1 binding.
> >
> > One caveat: warn people that guava is now at 27.0 -and that if you run
> > with an older version of Guava things will inevitably break.
>
>>>>>: Could you please suggest what is the process to follow now If I want
to add into release notes? Should I withdraw RC0 and recreate RC1 with
updated Release note in corresponding JIRA so that release script will pick
up that? Or any other way?
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Steve for detailed verification. Inline comment
On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
wrote:
> >
> > +1 binding.
> >
> > One caveat: warn people that guava is now at 27.0 -and that if you run
> > with an older version of Guava things will inevitably break.
>
>>>>>: Could you please suggest what is the process to follow now If I want
to add into release notes? Should I withdraw RC0 and recreate RC1 with
updated Release note in corresponding JIRA so that release script will pick
up that? Or any other way?
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Steve for detailed verification. Inline comment
On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
wrote:
> >
> > +1 binding.
> >
> > One caveat: warn people that guava is now at 27.0 -and that if you run
> > with an older version of Guava things will inevitably break.
>
>>>>>: Could you please suggest what is the process to follow now If I want
to add into release notes? Should I withdraw RC0 and recreate RC1 with
updated Release note in corresponding JIRA so that release script will pick
up that? Or any other way?
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Steve for detailed verification. Inline comment
On Wed, 18 Sep 2019 at 20:34, Steve Loughran <st...@cloudera.com.invalid>
wrote:
> >
> > +1 binding.
> >
> > One caveat: warn people that guava is now at 27.0 -and that if you run
> > with an older version of Guava things will inevitably break.
>
>>>>>: Could you please suggest what is the process to follow now If I want
to add into release notes? Should I withdraw RC0 and recreate RC1 with
updated Release note in corresponding JIRA so that release script will pick
up that? Or any other way?
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
>
> +1 binding.
>
> One caveat: warn people that guava is now at 27.0 -and that if you run
> with an older version of Guava things will inevitably break.
>
>
> steps to validate
> ==================
>
> * downloaded src and binary artifacts
> * after import of KEYS and trusting Rohith's key, validate GPG signatures
> * test basic hadoop fs commands against s3a with s3guard and abfds
>
>
>
>
> Validating S3A connector
> ========================
>
> * grabbed the latest build of my cloudstore diagnostics JAR
> https://github.com/steveloughran/cloudstore/releases/tag/tag_2019-09-13
> * and set an env var to it:
> set -gx CLOUDSTORE cloudstore/target/cloudstore-0.1-SNAPSHOT.jar
>
> bin/hadoop jar $CLOUDSTORE storediag s3a://hwdev-steve-ireland-new
>
>
>
> Diagnostics for filesystem s3a://hwdev-steve-ireland-new/
> =========================================================
>
> S3A FileSystem connector
> ASF Filesystem Connector to Amazon S3 Storage and compatible stores
>
> https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: org.apache.hadoop.fs.s3a.S3AFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: com.amazonaws.services.s3.AmazonS3
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.ClientConfiguration
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
>
> Optional Classes
> ================
>
> These classes are needed in some versions of Hadoop.
> And/or for optional features to work.
>
> class: com.amazonaws.services.dynamodbv2.AmazonDynamoDB
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.services.securitytoken.AWSSecurityTokenServiceClient
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.fasterxml.jackson.annotation.JacksonAnnotation
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.fasterxml.jackson.core.JsonParseException
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectMapper
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: org.joda.time.Interval
> Not found on classpath: org.joda.time.Interval
> class: org.apache.hadoop.fs.s3a.s3guard.S3Guard
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.staging.StagingCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.Invoker
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
>
> then some classes which aren't in 3.2 and so which I didn't expect to
> see.
>
> class: org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> Not found on classpath:
> org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> class: com.amazonaws.services.s3.model.SelectObjectContentRequest
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: org.apache.hadoop.fs.s3a.select.SelectInputStream
> Not found on classpath:
> org.apache.hadoop.fs.s3a.select.SelectInputStream
> class: org.apache.hadoop.fs.s3a.impl.RenameOperation
> Not found on classpath:
> org.apache.hadoop.fs.s3a.impl.RenameOperation
>
>
>
> + the command then executed basic list/read/write operations; all good.
>
>
>
> Validating abfs connector
> =========================
>
> * set -gx HADOOP_OPTIONAL_TOOLS hadoop-azure
>
>
>
>
> Diagnostics for filesystem abfs://container@someone.dfs.core.windows.net/
>
> ============================================================================
>
> Azure Abfs connector
> ASF Filesystem Connector to Microsoft Azure ABFS Storage
> https://hadoop.apache.org/docs/current/hadoop-azure/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Environment Variables
> =====================
>
> HADOOP_HOME = "/Users/stevel/hadoop/candidates/hadoop-3.2.1"
> HADOOP_CONF_DIR = "/Users/stevel/hadoop-3.2.1/etc/hadoop"
> HADOOP_OPTIONAL_TOOLS =
> "hadoop-azure,hadoop-aws,hadoop-azure-datalake,hadoop-openstack"
> HADOOP_SHELL_SCRIPT_DEBUG = (unset)
> HADOOP_TOOLS_HOME = (unset)
> HADOOP_TOOLS_OPTIONS = (unset)
> HDP_VERSION = (unset)
> SPARK_HOME = (unset)
> SPARK_CONF_DIR = (unset)
> PYSPARK_DRIVER_PYTHON = (unset)
> SPARK_SCALA_VERSION = (unset)
> YARN_CONF_DIR = (unset)
> HADOOP_TOKEN_FILE_LOCATION = (unset)
> HADOOP_TOKEN = (unset)
>
>
>
> Hadoop Options
> ==============
>
> fs.defaultFS = "file:///" [core-default.xml]
> fs.default.name = "file:///"
> hdp.version = (unset)
> yarn.resourcemanager.address = "0.0.0.0:8032" [yarn-default.xml]
> yarn.resourcemanager.webapp.address = "0.0.0.0:8088" [yarn-default.xml]
> yarn.resourcemanager.webapp.https.address = "0.0.0.0:8090"
> [yarn-default.xml]
> mapreduce.input.fileinputformat.list-status.num-threads = "1"
> [mapred-default.xml]
>
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: com.fasterxml.jackson.annotation.JsonProperty
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.google.common.base.Preconditions
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/guava-27.0-jre.jar
> class: com.fasterxml.jackson.core.JsonFactory
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectReader
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: com.microsoft.azure.storage.StorageErrorCode
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/azure-storage-7.0.0.jar
> class: org.apache.http.client.utils.URIBuilder
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/httpclient-4.5.6.jar
> class: org.wildfly.openssl.OpenSSLProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/wildfly-openssl-1.0.7.Final.jar
> class: org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-azure-3.2.1.jar
>
> -again a full filesystem list/read/write/delete sequence was executed;
> again all good.
>
>
> -------------------------------------------
>
> spark
> =====
>
>
> (branch master; version 3.0.0-SNAPSHOT)
>
> After editing my maven settings to avoid our in-house nexus server, I did
> a clean build with the profiles:
>
> -Dhadoop.version=3.2.1 -Phive -Phive-thriftserver -Pyarn -Phadoop-3.2
> -Phadoop-cloud -Psnapshots-and-staging
>
>
> Downloading from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> Downloaded from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> (70 kB at 72 kB/s)
>
>
> For the record, three issues surfaced there
> * spark now demands mvn 3.6.2, so upgrade time there
> * for some reason the build decided to download all the other artifacts
> that maven central has ever hosted
> * spark's build hangs if you pass in the -T 1C argument to maven. Worth
> remembering.
> * and of couse you have to rebuild the next day.
>
> Spark compilation completed: I did not run its test suites.
>
> spark cloud integration tests
> =============================
>
> Once spark was built, I went with my downstream test suite.
> https://github.com/hortonworks-spark/cloud-integration
>
> Here here I got burned at runtime by the guava change; the module was set
> up to use guava 0.19, and Configuration.set() failed.
>
> S3ACommitBulkDataSuite:
> com.cloudera.spark.cloud.s3.commit.S3ACommitBulkDataSuite *** ABORTED ***
> java.lang.RuntimeException: Unable to load a Suite class that was
> discovered in the runpath:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2(CloudSuiteTrait.scala:145)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2$adapted(CloudSuiteTrait.scala:144)
> at scala.Option.foreach(Option.scala:274)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1(CloudSuiteTrait.scala:144)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1$adapted(CloudSuiteTrait.scala:143)
> at scala.collection.immutable.List.foreach(List.scala:392)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration(CloudSuiteTrait.scala:143)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration$(CloudSuiteTrait.scala:142)
> at
> com.cloudera.spark.cloud.common.CloudSuite$.overlayConfiguration(CloudSuite.scala:41)
> ...
>
> This is one of those things which was inevitable. I do think we'll need to
> warn people in the release notes.
>
> (I also discovered someone has deleted a test source data bucket of mine
> so some tests failed; not something I fixed today.)
>
> With the guava tests, other than a failure due to someone deleting a
> bucket of mine containing test source data, all tests against s3a and abfs
> were happy.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
Thanks Rohith the work with the release.
* built from the source (archlinux)
* verified signatures
* verified sha512 checksums
* started a docker-based pseudo cluster
* tested basic HDFS operations with CLI
* Checked if the sources are uploaded to the maven staging repo
Note 1: I haven't seen the ./patchprocess/gpgagent.conf file in earlier
releases and It seems to be included. But I don't think it's a blocker.
Note 2: *.sha512 files can be improved before uploading with removing
the absolute path (to make it easier to check with sha512sum -c).
Marton
On 9/18/19 4:25 PM, Ayush Saxena wrote:
> Thanks Rohith for driving the release.
>
> +1 (non binding)
>
> -Built from source on Ubuntu-18.04
> -Successful Native build.
> -Verified basic HDFS Commands.
> -Verified basic Erasure Coding Commands.
> -Verified basic RBF commands.
> -Browsed HDFS UI.
>
> Thanks
>
> -Ayush
>
> On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> Downloaded tarball, setup a pseudo cluster manually
>> Verified basic HDFS operations, copy/view files
>> Verified basic YARN operations, run sample DS jobs
>> Verified basic YARN restful APIs, e.g cluster/nodes info etc
>> Set and verified YARN node-attributes, including CLI
>>
>> Thanks
>> Weiwei
>> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
>> wrote:
>>> +1 (non-binding).
>>> Installed and verified it by running several Spark job and DS jobs.
>>>
>>> BR,
>>> Zhankun
>>>
>>> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
>>> naganarasimha_gr@apache.org> wrote:
>>>
>>>> Verified the source and the binary tar and the sha512 checksums
>>>> Installed and verified the basic hadoop operations (ran few MR tasks)
>>>>
>>>> +1.
>>>>
>>>> Thanks,
>>>> + Naga
>>>>
>>>> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
>>>> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
>>>> wrote:
>>>>>
>>>>>> +1 (non-binding)
>>>>>>
>>>>>> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
>>>>>> rohithsharmaks@apache.org> wrote:
>>>>>>
>>>>>>> Hi folks,
>>>>>>>
>>>>>>> I have put together a release candidate (RC0) for Apache Hadoop
>>>> 3.2.1.
>>>>>>>
>>>>>>> The RC is available at:
>>>>>>> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>>>>>>>
>>>>>>> The RC tag in git is release-3.2.1-RC0:
>>>>>>> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>>>>>>>
>>>>>>>
>>>>>>> The maven artifacts are staged at
>>>>>>>
>>>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>>>>>>>
>>>>>>> You can find my public key at:
>>>>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>>>>
>>>>>>> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
>>>> 11:59
>>>>>> pm
>>>>>>> PST.
>>>>>>>
>>>>>>> I have done testing with a pseudo cluster and distributed shell
>> job.
>>>> My
>>>>>> +1
>>>>>>> to start.
>>>>>>>
>>>>>>> Thanks & Regards
>>>>>>> Rohith Sharma K S
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks & Regards,
>>>>> Anil Sadineni
>>>>> Solutions Architect, Optlin Inc
>>>>> Ph: 571-438-1974 | www.optlin.com
>>>>>
>>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
Thanks Rohith the work with the release.
* built from the source (archlinux)
* verified signatures
* verified sha512 checksums
* started a docker-based pseudo cluster
* tested basic HDFS operations with CLI
* Checked if the sources are uploaded to the maven staging repo
Note 1: I haven't seen the ./patchprocess/gpgagent.conf file in earlier
releases and It seems to be included. But I don't think it's a blocker.
Note 2: *.sha512 files can be improved before uploading with removing
the absolute path (to make it easier to check with sha512sum -c).
Marton
On 9/18/19 4:25 PM, Ayush Saxena wrote:
> Thanks Rohith for driving the release.
>
> +1 (non binding)
>
> -Built from source on Ubuntu-18.04
> -Successful Native build.
> -Verified basic HDFS Commands.
> -Verified basic Erasure Coding Commands.
> -Verified basic RBF commands.
> -Browsed HDFS UI.
>
> Thanks
>
> -Ayush
>
> On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> Downloaded tarball, setup a pseudo cluster manually
>> Verified basic HDFS operations, copy/view files
>> Verified basic YARN operations, run sample DS jobs
>> Verified basic YARN restful APIs, e.g cluster/nodes info etc
>> Set and verified YARN node-attributes, including CLI
>>
>> Thanks
>> Weiwei
>> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
>> wrote:
>>> +1 (non-binding).
>>> Installed and verified it by running several Spark job and DS jobs.
>>>
>>> BR,
>>> Zhankun
>>>
>>> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
>>> naganarasimha_gr@apache.org> wrote:
>>>
>>>> Verified the source and the binary tar and the sha512 checksums
>>>> Installed and verified the basic hadoop operations (ran few MR tasks)
>>>>
>>>> +1.
>>>>
>>>> Thanks,
>>>> + Naga
>>>>
>>>> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
>>>> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
>>>> wrote:
>>>>>
>>>>>> +1 (non-binding)
>>>>>>
>>>>>> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
>>>>>> rohithsharmaks@apache.org> wrote:
>>>>>>
>>>>>>> Hi folks,
>>>>>>>
>>>>>>> I have put together a release candidate (RC0) for Apache Hadoop
>>>> 3.2.1.
>>>>>>>
>>>>>>> The RC is available at:
>>>>>>> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>>>>>>>
>>>>>>> The RC tag in git is release-3.2.1-RC0:
>>>>>>> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>>>>>>>
>>>>>>>
>>>>>>> The maven artifacts are staged at
>>>>>>>
>>>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>>>>>>>
>>>>>>> You can find my public key at:
>>>>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>>>>
>>>>>>> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
>>>> 11:59
>>>>>> pm
>>>>>>> PST.
>>>>>>>
>>>>>>> I have done testing with a pseudo cluster and distributed shell
>> job.
>>>> My
>>>>>> +1
>>>>>>> to start.
>>>>>>>
>>>>>>> Thanks & Regards
>>>>>>> Rohith Sharma K S
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks & Regards,
>>>>> Anil Sadineni
>>>>> Solutions Architect, Optlin Inc
>>>>> Ph: 571-438-1974 | www.optlin.com
>>>>>
>>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
Thanks Rohith the work with the release.
* built from the source (archlinux)
* verified signatures
* verified sha512 checksums
* started a docker-based pseudo cluster
* tested basic HDFS operations with CLI
* Checked if the sources are uploaded to the maven staging repo
Note 1: I haven't seen the ./patchprocess/gpgagent.conf file in earlier
releases and It seems to be included. But I don't think it's a blocker.
Note 2: *.sha512 files can be improved before uploading with removing
the absolute path (to make it easier to check with sha512sum -c).
Marton
On 9/18/19 4:25 PM, Ayush Saxena wrote:
> Thanks Rohith for driving the release.
>
> +1 (non binding)
>
> -Built from source on Ubuntu-18.04
> -Successful Native build.
> -Verified basic HDFS Commands.
> -Verified basic Erasure Coding Commands.
> -Verified basic RBF commands.
> -Browsed HDFS UI.
>
> Thanks
>
> -Ayush
>
> On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> Downloaded tarball, setup a pseudo cluster manually
>> Verified basic HDFS operations, copy/view files
>> Verified basic YARN operations, run sample DS jobs
>> Verified basic YARN restful APIs, e.g cluster/nodes info etc
>> Set and verified YARN node-attributes, including CLI
>>
>> Thanks
>> Weiwei
>> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
>> wrote:
>>> +1 (non-binding).
>>> Installed and verified it by running several Spark job and DS jobs.
>>>
>>> BR,
>>> Zhankun
>>>
>>> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
>>> naganarasimha_gr@apache.org> wrote:
>>>
>>>> Verified the source and the binary tar and the sha512 checksums
>>>> Installed and verified the basic hadoop operations (ran few MR tasks)
>>>>
>>>> +1.
>>>>
>>>> Thanks,
>>>> + Naga
>>>>
>>>> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
>>>> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
>>>> wrote:
>>>>>
>>>>>> +1 (non-binding)
>>>>>>
>>>>>> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
>>>>>> rohithsharmaks@apache.org> wrote:
>>>>>>
>>>>>>> Hi folks,
>>>>>>>
>>>>>>> I have put together a release candidate (RC0) for Apache Hadoop
>>>> 3.2.1.
>>>>>>>
>>>>>>> The RC is available at:
>>>>>>> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>>>>>>>
>>>>>>> The RC tag in git is release-3.2.1-RC0:
>>>>>>> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>>>>>>>
>>>>>>>
>>>>>>> The maven artifacts are staged at
>>>>>>>
>>>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>>>>>>>
>>>>>>> You can find my public key at:
>>>>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>>>>
>>>>>>> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
>>>> 11:59
>>>>>> pm
>>>>>>> PST.
>>>>>>>
>>>>>>> I have done testing with a pseudo cluster and distributed shell
>> job.
>>>> My
>>>>>> +1
>>>>>>> to start.
>>>>>>>
>>>>>>> Thanks & Regards
>>>>>>> Rohith Sharma K S
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks & Regards,
>>>>> Anil Sadineni
>>>>> Solutions Architect, Optlin Inc
>>>>> Ph: 571-438-1974 | www.optlin.com
>>>>>
>>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
Thanks Rohith the work with the release.
* built from the source (archlinux)
* verified signatures
* verified sha512 checksums
* started a docker-based pseudo cluster
* tested basic HDFS operations with CLI
* Checked if the sources are uploaded to the maven staging repo
Note 1: I haven't seen the ./patchprocess/gpgagent.conf file in earlier
releases and It seems to be included. But I don't think it's a blocker.
Note 2: *.sha512 files can be improved before uploading with removing
the absolute path (to make it easier to check with sha512sum -c).
Marton
On 9/18/19 4:25 PM, Ayush Saxena wrote:
> Thanks Rohith for driving the release.
>
> +1 (non binding)
>
> -Built from source on Ubuntu-18.04
> -Successful Native build.
> -Verified basic HDFS Commands.
> -Verified basic Erasure Coding Commands.
> -Verified basic RBF commands.
> -Browsed HDFS UI.
>
> Thanks
>
> -Ayush
>
> On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> Downloaded tarball, setup a pseudo cluster manually
>> Verified basic HDFS operations, copy/view files
>> Verified basic YARN operations, run sample DS jobs
>> Verified basic YARN restful APIs, e.g cluster/nodes info etc
>> Set and verified YARN node-attributes, including CLI
>>
>> Thanks
>> Weiwei
>> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
>> wrote:
>>> +1 (non-binding).
>>> Installed and verified it by running several Spark job and DS jobs.
>>>
>>> BR,
>>> Zhankun
>>>
>>> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
>>> naganarasimha_gr@apache.org> wrote:
>>>
>>>> Verified the source and the binary tar and the sha512 checksums
>>>> Installed and verified the basic hadoop operations (ran few MR tasks)
>>>>
>>>> +1.
>>>>
>>>> Thanks,
>>>> + Naga
>>>>
>>>> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
>>>> wrote:
>>>>
>>>>> +1 (non-binding)
>>>>>
>>>>> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
>>>> wrote:
>>>>>
>>>>>> +1 (non-binding)
>>>>>>
>>>>>> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
>>>>>> rohithsharmaks@apache.org> wrote:
>>>>>>
>>>>>>> Hi folks,
>>>>>>>
>>>>>>> I have put together a release candidate (RC0) for Apache Hadoop
>>>> 3.2.1.
>>>>>>>
>>>>>>> The RC is available at:
>>>>>>> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>>>>>>>
>>>>>>> The RC tag in git is release-3.2.1-RC0:
>>>>>>> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>>>>>>>
>>>>>>>
>>>>>>> The maven artifacts are staged at
>>>>>>>
>>>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>>>>>>>
>>>>>>> You can find my public key at:
>>>>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>>>>
>>>>>>> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
>>>> 11:59
>>>>>> pm
>>>>>>> PST.
>>>>>>>
>>>>>>> I have done testing with a pseudo cluster and distributed shell
>> job.
>>>> My
>>>>>> +1
>>>>>>> to start.
>>>>>>>
>>>>>>> Thanks & Regards
>>>>>>> Rohith Sharma K S
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks & Regards,
>>>>> Anil Sadineni
>>>>> Solutions Architect, Optlin Inc
>>>>> Ph: 571-438-1974 | www.optlin.com
>>>>>
>>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Ayush Saxena <ay...@gmail.com>.
Thanks Rohith for driving the release.
+1 (non binding)
-Built from source on Ubuntu-18.04
-Successful Native build.
-Verified basic HDFS Commands.
-Verified basic Erasure Coding Commands.
-Verified basic RBF commands.
-Browsed HDFS UI.
Thanks
-Ayush
On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
> +1 (binding)
>
> Downloaded tarball, setup a pseudo cluster manually
> Verified basic HDFS operations, copy/view files
> Verified basic YARN operations, run sample DS jobs
> Verified basic YARN restful APIs, e.g cluster/nodes info etc
> Set and verified YARN node-attributes, including CLI
>
> Thanks
> Weiwei
> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
> wrote:
> > +1 (non-binding).
> > Installed and verified it by running several Spark job and DS jobs.
> >
> > BR,
> > Zhankun
> >
> > On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> > naganarasimha_gr@apache.org> wrote:
> >
> > > Verified the source and the binary tar and the sha512 checksums
> > > Installed and verified the basic hadoop operations (ran few MR tasks)
> > >
> > > +1.
> > >
> > > Thanks,
> > > + Naga
> > >
> > > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > > rohithsharmaks@apache.org> wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > > 3.2.1.
> > > > > >
> > > > > > The RC is available at:
> > > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > > >
> > > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > > >
> > > > > >
> > > > > > The maven artifacts are staged at
> > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > > >
> > > > > > You can find my public key at:
> > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > > >
> > > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > > 11:59
> > > > > pm
> > > > > > PST.
> > > > > >
> > > > > > I have done testing with a pseudo cluster and distributed shell
> job.
> > > My
> > > > > +1
> > > > > > to start.
> > > > > >
> > > > > > Thanks & Regards
> > > > > > Rohith Sharma K S
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Sadineni
> > > > Solutions Architect, Optlin Inc
> > > > Ph: 571-438-1974 | www.optlin.com
> > > >
> > >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Ayush Saxena <ay...@gmail.com>.
Thanks Rohith for driving the release.
+1 (non binding)
-Built from source on Ubuntu-18.04
-Successful Native build.
-Verified basic HDFS Commands.
-Verified basic Erasure Coding Commands.
-Verified basic RBF commands.
-Browsed HDFS UI.
Thanks
-Ayush
On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
> +1 (binding)
>
> Downloaded tarball, setup a pseudo cluster manually
> Verified basic HDFS operations, copy/view files
> Verified basic YARN operations, run sample DS jobs
> Verified basic YARN restful APIs, e.g cluster/nodes info etc
> Set and verified YARN node-attributes, including CLI
>
> Thanks
> Weiwei
> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
> wrote:
> > +1 (non-binding).
> > Installed and verified it by running several Spark job and DS jobs.
> >
> > BR,
> > Zhankun
> >
> > On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> > naganarasimha_gr@apache.org> wrote:
> >
> > > Verified the source and the binary tar and the sha512 checksums
> > > Installed and verified the basic hadoop operations (ran few MR tasks)
> > >
> > > +1.
> > >
> > > Thanks,
> > > + Naga
> > >
> > > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > > rohithsharmaks@apache.org> wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > > 3.2.1.
> > > > > >
> > > > > > The RC is available at:
> > > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > > >
> > > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > > >
> > > > > >
> > > > > > The maven artifacts are staged at
> > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > > >
> > > > > > You can find my public key at:
> > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > > >
> > > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > > 11:59
> > > > > pm
> > > > > > PST.
> > > > > >
> > > > > > I have done testing with a pseudo cluster and distributed shell
> job.
> > > My
> > > > > +1
> > > > > > to start.
> > > > > >
> > > > > > Thanks & Regards
> > > > > > Rohith Sharma K S
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Sadineni
> > > > Solutions Architect, Optlin Inc
> > > > Ph: 571-438-1974 | www.optlin.com
> > > >
> > >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Ayush Saxena <ay...@gmail.com>.
Thanks Rohith for driving the release.
+1 (non binding)
-Built from source on Ubuntu-18.04
-Successful Native build.
-Verified basic HDFS Commands.
-Verified basic Erasure Coding Commands.
-Verified basic RBF commands.
-Browsed HDFS UI.
Thanks
-Ayush
On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
> +1 (binding)
>
> Downloaded tarball, setup a pseudo cluster manually
> Verified basic HDFS operations, copy/view files
> Verified basic YARN operations, run sample DS jobs
> Verified basic YARN restful APIs, e.g cluster/nodes info etc
> Set and verified YARN node-attributes, including CLI
>
> Thanks
> Weiwei
> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
> wrote:
> > +1 (non-binding).
> > Installed and verified it by running several Spark job and DS jobs.
> >
> > BR,
> > Zhankun
> >
> > On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> > naganarasimha_gr@apache.org> wrote:
> >
> > > Verified the source and the binary tar and the sha512 checksums
> > > Installed and verified the basic hadoop operations (ran few MR tasks)
> > >
> > > +1.
> > >
> > > Thanks,
> > > + Naga
> > >
> > > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > > rohithsharmaks@apache.org> wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > > 3.2.1.
> > > > > >
> > > > > > The RC is available at:
> > > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > > >
> > > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > > >
> > > > > >
> > > > > > The maven artifacts are staged at
> > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > > >
> > > > > > You can find my public key at:
> > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > > >
> > > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > > 11:59
> > > > > pm
> > > > > > PST.
> > > > > >
> > > > > > I have done testing with a pseudo cluster and distributed shell
> job.
> > > My
> > > > > +1
> > > > > > to start.
> > > > > >
> > > > > > Thanks & Regards
> > > > > > Rohith Sharma K S
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Sadineni
> > > > Solutions Architect, Optlin Inc
> > > > Ph: 571-438-1974 | www.optlin.com
> > > >
> > >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Ayush Saxena <ay...@gmail.com>.
Thanks Rohith for driving the release.
+1 (non binding)
-Built from source on Ubuntu-18.04
-Successful Native build.
-Verified basic HDFS Commands.
-Verified basic Erasure Coding Commands.
-Verified basic RBF commands.
-Browsed HDFS UI.
Thanks
-Ayush
On Wed, 18 Sep 2019 at 15:41, Weiwei Yang <ab...@gmail.com> wrote:
> +1 (binding)
>
> Downloaded tarball, setup a pseudo cluster manually
> Verified basic HDFS operations, copy/view files
> Verified basic YARN operations, run sample DS jobs
> Verified basic YARN restful APIs, e.g cluster/nodes info etc
> Set and verified YARN node-attributes, including CLI
>
> Thanks
> Weiwei
> On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>,
> wrote:
> > +1 (non-binding).
> > Installed and verified it by running several Spark job and DS jobs.
> >
> > BR,
> > Zhankun
> >
> > On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> > naganarasimha_gr@apache.org> wrote:
> >
> > > Verified the source and the binary tar and the sha512 checksums
> > > Installed and verified the basic hadoop operations (ran few MR tasks)
> > >
> > > +1.
> > >
> > > Thanks,
> > > + Naga
> > >
> > > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > > wrote:
> > > >
> > > > > +1 (non-binding)
> > > > >
> > > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > > rohithsharmaks@apache.org> wrote:
> > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > > 3.2.1.
> > > > > >
> > > > > > The RC is available at:
> > > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > > >
> > > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > > >
> > > > > >
> > > > > > The maven artifacts are staged at
> > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > > >
> > > > > > You can find my public key at:
> > > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > > >
> > > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > > 11:59
> > > > > pm
> > > > > > PST.
> > > > > >
> > > > > > I have done testing with a pseudo cluster and distributed shell
> job.
> > > My
> > > > > +1
> > > > > > to start.
> > > > > >
> > > > > > Thanks & Regards
> > > > > > Rohith Sharma K S
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Thanks & Regards,
> > > > Anil Sadineni
> > > > Solutions Architect, Optlin Inc
> > > > Ph: 571-438-1974 | www.optlin.com
> > > >
> > >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Weiwei Yang <ab...@gmail.com>.
+1 (binding)
Downloaded tarball, setup a pseudo cluster manually
Verified basic HDFS operations, copy/view files
Verified basic YARN operations, run sample DS jobs
Verified basic YARN restful APIs, e.g cluster/nodes info etc
Set and verified YARN node-attributes, including CLI
Thanks
Weiwei
On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>, wrote:
> +1 (non-binding).
> Installed and verified it by running several Spark job and DS jobs.
>
> BR,
> Zhankun
>
> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> naganarasimha_gr@apache.org> wrote:
>
> > Verified the source and the binary tar and the sha512 checksums
> > Installed and verified the basic hadoop operations (ran few MR tasks)
> >
> > +1.
> >
> > Thanks,
> > + Naga
> >
> > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > rohithsharmaks@apache.org> wrote:
> > > >
> > > > > Hi folks,
> > > > >
> > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > 3.2.1.
> > > > >
> > > > > The RC is available at:
> > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > >
> > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > >
> > > > >
> > > > > The maven artifacts are staged at
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > >
> > > > > You can find my public key at:
> > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > >
> > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > 11:59
> > > > pm
> > > > > PST.
> > > > >
> > > > > I have done testing with a pseudo cluster and distributed shell job.
> > My
> > > > +1
> > > > > to start.
> > > > >
> > > > > Thanks & Regards
> > > > > Rohith Sharma K S
> > > > >
> > > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Sadineni
> > > Solutions Architect, Optlin Inc
> > > Ph: 571-438-1974 | www.optlin.com
> > >
> >
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Weiwei Yang <ab...@gmail.com>.
+1 (binding)
Downloaded tarball, setup a pseudo cluster manually
Verified basic HDFS operations, copy/view files
Verified basic YARN operations, run sample DS jobs
Verified basic YARN restful APIs, e.g cluster/nodes info etc
Set and verified YARN node-attributes, including CLI
Thanks
Weiwei
On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>, wrote:
> +1 (non-binding).
> Installed and verified it by running several Spark job and DS jobs.
>
> BR,
> Zhankun
>
> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> naganarasimha_gr@apache.org> wrote:
>
> > Verified the source and the binary tar and the sha512 checksums
> > Installed and verified the basic hadoop operations (ran few MR tasks)
> >
> > +1.
> >
> > Thanks,
> > + Naga
> >
> > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > rohithsharmaks@apache.org> wrote:
> > > >
> > > > > Hi folks,
> > > > >
> > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > 3.2.1.
> > > > >
> > > > > The RC is available at:
> > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > >
> > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > >
> > > > >
> > > > > The maven artifacts are staged at
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > >
> > > > > You can find my public key at:
> > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > >
> > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > 11:59
> > > > pm
> > > > > PST.
> > > > >
> > > > > I have done testing with a pseudo cluster and distributed shell job.
> > My
> > > > +1
> > > > > to start.
> > > > >
> > > > > Thanks & Regards
> > > > > Rohith Sharma K S
> > > > >
> > > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Sadineni
> > > Solutions Architect, Optlin Inc
> > > Ph: 571-438-1974 | www.optlin.com
> > >
> >
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Weiwei Yang <ab...@gmail.com>.
+1 (binding)
Downloaded tarball, setup a pseudo cluster manually
Verified basic HDFS operations, copy/view files
Verified basic YARN operations, run sample DS jobs
Verified basic YARN restful APIs, e.g cluster/nodes info etc
Set and verified YARN node-attributes, including CLI
Thanks
Weiwei
On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>, wrote:
> +1 (non-binding).
> Installed and verified it by running several Spark job and DS jobs.
>
> BR,
> Zhankun
>
> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> naganarasimha_gr@apache.org> wrote:
>
> > Verified the source and the binary tar and the sha512 checksums
> > Installed and verified the basic hadoop operations (ran few MR tasks)
> >
> > +1.
> >
> > Thanks,
> > + Naga
> >
> > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > rohithsharmaks@apache.org> wrote:
> > > >
> > > > > Hi folks,
> > > > >
> > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > 3.2.1.
> > > > >
> > > > > The RC is available at:
> > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > >
> > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > >
> > > > >
> > > > > The maven artifacts are staged at
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > >
> > > > > You can find my public key at:
> > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > >
> > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > 11:59
> > > > pm
> > > > > PST.
> > > > >
> > > > > I have done testing with a pseudo cluster and distributed shell job.
> > My
> > > > +1
> > > > > to start.
> > > > >
> > > > > Thanks & Regards
> > > > > Rohith Sharma K S
> > > > >
> > > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Sadineni
> > > Solutions Architect, Optlin Inc
> > > Ph: 571-438-1974 | www.optlin.com
> > >
> >
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Weiwei Yang <ab...@gmail.com>.
+1 (binding)
Downloaded tarball, setup a pseudo cluster manually
Verified basic HDFS operations, copy/view files
Verified basic YARN operations, run sample DS jobs
Verified basic YARN restful APIs, e.g cluster/nodes info etc
Set and verified YARN node-attributes, including CLI
Thanks
Weiwei
On Sep 18, 2019, 11:41 AM +0800, zhankun tang <ta...@gmail.com>, wrote:
> +1 (non-binding).
> Installed and verified it by running several Spark job and DS jobs.
>
> BR,
> Zhankun
>
> On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
> naganarasimha_gr@apache.org> wrote:
>
> > Verified the source and the binary tar and the sha512 checksums
> > Installed and verified the basic hadoop operations (ran few MR tasks)
> >
> > +1.
> >
> > Thanks,
> > + Naga
> >
> > On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> > wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> > wrote:
> > >
> > > > +1 (non-binding)
> > > >
> > > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > > rohithsharmaks@apache.org> wrote:
> > > >
> > > > > Hi folks,
> > > > >
> > > > > I have put together a release candidate (RC0) for Apache Hadoop
> > 3.2.1.
> > > > >
> > > > > The RC is available at:
> > > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > > >
> > > > > The RC tag in git is release-3.2.1-RC0:
> > > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > > >
> > > > >
> > > > > The maven artifacts are staged at
> > > > >
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > > >
> > > > > You can find my public key at:
> > > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > > >
> > > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> > 11:59
> > > > pm
> > > > > PST.
> > > > >
> > > > > I have done testing with a pseudo cluster and distributed shell job.
> > My
> > > > +1
> > > > > to start.
> > > > >
> > > > > Thanks & Regards
> > > > > Rohith Sharma K S
> > > > >
> > > >
> > >
> > >
> > > --
> > > Thanks & Regards,
> > > Anil Sadineni
> > > Solutions Architect, Optlin Inc
> > > Ph: 571-438-1974 | www.optlin.com
> > >
> >
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by zhankun tang <ta...@gmail.com>.
+1 (non-binding).
Installed and verified it by running several Spark job and DS jobs.
BR,
Zhankun
On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
naganarasimha_gr@apache.org> wrote:
> Verified the source and the binary tar and the sha512 checksums
> Installed and verified the basic hadoop operations (ran few MR tasks)
>
> +1.
>
> Thanks,
> + Naga
>
> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> wrote:
>
> > +1 (non-binding)
> >
> > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > rohithsharmaks@apache.org> wrote:
> > >
> > > > Hi folks,
> > > >
> > > > I have put together a release candidate (RC0) for Apache Hadoop
> 3.2.1.
> > > >
> > > > The RC is available at:
> > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > >
> > > > The RC tag in git is release-3.2.1-RC0:
> > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > >
> > > >
> > > > The maven artifacts are staged at
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > >
> > > > You can find my public key at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59
> > > pm
> > > > PST.
> > > >
> > > > I have done testing with a pseudo cluster and distributed shell job.
> My
> > > +1
> > > > to start.
> > > >
> > > > Thanks & Regards
> > > > Rohith Sharma K S
> > > >
> > >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Sadineni
> > Solutions Architect, Optlin Inc
> > Ph: 571-438-1974 | www.optlin.com
> >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by zhankun tang <ta...@gmail.com>.
+1 (non-binding).
Installed and verified it by running several Spark job and DS jobs.
BR,
Zhankun
On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
naganarasimha_gr@apache.org> wrote:
> Verified the source and the binary tar and the sha512 checksums
> Installed and verified the basic hadoop operations (ran few MR tasks)
>
> +1.
>
> Thanks,
> + Naga
>
> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> wrote:
>
> > +1 (non-binding)
> >
> > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > rohithsharmaks@apache.org> wrote:
> > >
> > > > Hi folks,
> > > >
> > > > I have put together a release candidate (RC0) for Apache Hadoop
> 3.2.1.
> > > >
> > > > The RC is available at:
> > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > >
> > > > The RC tag in git is release-3.2.1-RC0:
> > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > >
> > > >
> > > > The maven artifacts are staged at
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > >
> > > > You can find my public key at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59
> > > pm
> > > > PST.
> > > >
> > > > I have done testing with a pseudo cluster and distributed shell job.
> My
> > > +1
> > > > to start.
> > > >
> > > > Thanks & Regards
> > > > Rohith Sharma K S
> > > >
> > >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Sadineni
> > Solutions Architect, Optlin Inc
> > Ph: 571-438-1974 | www.optlin.com
> >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by zhankun tang <ta...@gmail.com>.
+1 (non-binding).
Installed and verified it by running several Spark job and DS jobs.
BR,
Zhankun
On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
naganarasimha_gr@apache.org> wrote:
> Verified the source and the binary tar and the sha512 checksums
> Installed and verified the basic hadoop operations (ran few MR tasks)
>
> +1.
>
> Thanks,
> + Naga
>
> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> wrote:
>
> > +1 (non-binding)
> >
> > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > rohithsharmaks@apache.org> wrote:
> > >
> > > > Hi folks,
> > > >
> > > > I have put together a release candidate (RC0) for Apache Hadoop
> 3.2.1.
> > > >
> > > > The RC is available at:
> > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > >
> > > > The RC tag in git is release-3.2.1-RC0:
> > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > >
> > > >
> > > > The maven artifacts are staged at
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > >
> > > > You can find my public key at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59
> > > pm
> > > > PST.
> > > >
> > > > I have done testing with a pseudo cluster and distributed shell job.
> My
> > > +1
> > > > to start.
> > > >
> > > > Thanks & Regards
> > > > Rohith Sharma K S
> > > >
> > >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Sadineni
> > Solutions Architect, Optlin Inc
> > Ph: 571-438-1974 | www.optlin.com
> >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by zhankun tang <ta...@gmail.com>.
+1 (non-binding).
Installed and verified it by running several Spark job and DS jobs.
BR,
Zhankun
On Wed, 18 Sep 2019 at 08:05, Naganarasimha Garla <
naganarasimha_gr@apache.org> wrote:
> Verified the source and the binary tar and the sha512 checksums
> Installed and verified the basic hadoop operations (ran few MR tasks)
>
> +1.
>
> Thanks,
> + Naga
>
> On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com>
> wrote:
>
> > +1 (non-binding)
> >
> > On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com>
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > > rohithsharmaks@apache.org> wrote:
> > >
> > > > Hi folks,
> > > >
> > > > I have put together a release candidate (RC0) for Apache Hadoop
> 3.2.1.
> > > >
> > > > The RC is available at:
> > > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > > >
> > > > The RC tag in git is release-3.2.1-RC0:
> > > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > > >
> > > >
> > > > The maven artifacts are staged at
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > > >
> > > > You can find my public key at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59
> > > pm
> > > > PST.
> > > >
> > > > I have done testing with a pseudo cluster and distributed shell job.
> My
> > > +1
> > > > to start.
> > > >
> > > > Thanks & Regards
> > > > Rohith Sharma K S
> > > >
> > >
> >
> >
> > --
> > Thanks & Regards,
> > Anil Sadineni
> > Solutions Architect, Optlin Inc
> > Ph: 571-438-1974 | www.optlin.com
> >
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Naganarasimha Garla <na...@apache.org>.
Verified the source and the binary tar and the sha512 checksums
Installed and verified the basic hadoop operations (ran few MR tasks)
+1.
Thanks,
+ Naga
On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com> wrote:
> +1 (non-binding)
>
> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
>
> > +1 (non-binding)
> >
> > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > rohithsharmaks@apache.org> wrote:
> >
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> > >
> > > The RC is available at:
> > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > >
> > > The RC tag in git is release-3.2.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > >
> > >
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> > pm
> > > PST.
> > >
> > > I have done testing with a pseudo cluster and distributed shell job. My
> > +1
> > > to start.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> >
>
>
> --
> Thanks & Regards,
> Anil Sadineni
> Solutions Architect, Optlin Inc
> Ph: 571-438-1974 | www.optlin.com
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Naganarasimha Garla <na...@apache.org>.
Verified the source and the binary tar and the sha512 checksums
Installed and verified the basic hadoop operations (ran few MR tasks)
+1.
Thanks,
+ Naga
On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com> wrote:
> +1 (non-binding)
>
> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
>
> > +1 (non-binding)
> >
> > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > rohithsharmaks@apache.org> wrote:
> >
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> > >
> > > The RC is available at:
> > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > >
> > > The RC tag in git is release-3.2.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > >
> > >
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> > pm
> > > PST.
> > >
> > > I have done testing with a pseudo cluster and distributed shell job. My
> > +1
> > > to start.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> >
>
>
> --
> Thanks & Regards,
> Anil Sadineni
> Solutions Architect, Optlin Inc
> Ph: 571-438-1974 | www.optlin.com
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Naganarasimha Garla <na...@apache.org>.
Verified the source and the binary tar and the sha512 checksums
Installed and verified the basic hadoop operations (ran few MR tasks)
+1.
Thanks,
+ Naga
On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com> wrote:
> +1 (non-binding)
>
> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
>
> > +1 (non-binding)
> >
> > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > rohithsharmaks@apache.org> wrote:
> >
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> > >
> > > The RC is available at:
> > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > >
> > > The RC tag in git is release-3.2.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > >
> > >
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> > pm
> > > PST.
> > >
> > > I have done testing with a pseudo cluster and distributed shell job. My
> > +1
> > > to start.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> >
>
>
> --
> Thanks & Regards,
> Anil Sadineni
> Solutions Architect, Optlin Inc
> Ph: 571-438-1974 | www.optlin.com
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Naganarasimha Garla <na...@apache.org>.
Verified the source and the binary tar and the sha512 checksums
Installed and verified the basic hadoop operations (ran few MR tasks)
+1.
Thanks,
+ Naga
On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni <as...@optlin.com> wrote:
> +1 (non-binding)
>
> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
>
> > +1 (non-binding)
> >
> > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > rohithsharmaks@apache.org> wrote:
> >
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> > >
> > > The RC is available at:
> > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > >
> > > The RC tag in git is release-3.2.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > >
> > >
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> > pm
> > > PST.
> > >
> > > I have done testing with a pseudo cluster and distributed shell job. My
> > +1
> > > to start.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> >
>
>
> --
> Thanks & Regards,
> Anil Sadineni
> Solutions Architect, Optlin Inc
> Ph: 571-438-1974 | www.optlin.com
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Anil Sadineni <as...@optlin.com>.
+1 (non-binding)
On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
> +1 (non-binding)
>
> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Thanks & Regards,
Anil Sadineni
Solutions Architect, Optlin Inc
Ph: 571-438-1974 | www.optlin.com
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Anil Sadineni <as...@optlin.com>.
+1 (non-binding)
On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
> +1 (non-binding)
>
> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Thanks & Regards,
Anil Sadineni
Solutions Architect, Optlin Inc
Ph: 571-438-1974 | www.optlin.com
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Anil Sadineni <as...@optlin.com>.
+1 (non-binding)
On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella <ma...@gmail.com> wrote:
> +1 (non-binding)
>
> On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Thanks & Regards,
Anil Sadineni
Solutions Architect, Optlin Inc
Ph: 571-438-1974 | www.optlin.com
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Santosh Marella <ma...@gmail.com>.
+1 (non-binding)
On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks all who helped to verify and vote 3.2.1 release! I am concluding the
vote for 3.2.1 RC0.
Summary of votes for hadoop-3.2.1-RC0:
7 binding +1s, from:
--------------------------
Sunil Govindan, Brahma Reddy Battula, Steve Loughran, Elek, Marton, Weiwei
Yang, Naganarasimha Garla, Rohith Sharma K S
10 non-binding +1s, from:
-------------------------------
runlin zhang, Thomas Marquardt, Santosh Marella, Anil Sadineni, Jeffrey
Rodriguez, zhankun tang, Ayush Saxena, Dinesh Chitlangia, Prabhu Josep,
Abhishek Modi
1 non-binding with +0s from:
-------------------------------------
Masatake Iwasaki
and *no -1s*.
So I am glad to announce that the vote for 3.2.1 RC0 passes.
Thanks everyone listed above who tried the release candidate and vote, and
all who ever help with 3.2.1 release effort in all kinds of ways.
I'll push the release bits and send out an announcement for 3.2.1 soon.
Thanks,
Rohith Sharma K S
On Thu, 19 Sep 2019 at 14:34, Abhishek Modi <ab...@gmail.com> wrote:
> Hi Rohith,
>
> Thanks for driving this release.
>
> +1 (binding)
>
> - built from the source on windows machine.
> - created a pseudo cluster.
> - ran PI job.
> - checked basic metrics with ATSv2 enabled.
>
> On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
>
>> Hi Rohith
>>
>> Thanks for putting this together, appreciate the same.
>>
>> +1 (binding)
>>
>> - verified signature
>> - brought up a cluster from the tar ball
>> - Ran some basic MR jobs
>> - RM UI seems fine (old and new)
>>
>>
>> Thanks
>> Sunil
>>
>> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
>> rohithsharmaks@apache.org> wrote:
>>
>> > Hi folks,
>> >
>> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>> >
>> > The RC is available at:
>> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>> >
>> > The RC tag in git is release-3.2.1-RC0:
>> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>> >
>> >
>> > The maven artifacts are staged at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>> >
>> > You can find my public key at:
>> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> >
>> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
>> pm
>> > PST.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Thanks & Regards
>> > Rohith Sharma K S
>> >
>>
>
>
> --
> Regards,
> Abhishek Modi
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks all who helped to verify and vote 3.2.1 release! I am concluding the
vote for 3.2.1 RC0.
Summary of votes for hadoop-3.2.1-RC0:
7 binding +1s, from:
--------------------------
Sunil Govindan, Brahma Reddy Battula, Steve Loughran, Elek, Marton, Weiwei
Yang, Naganarasimha Garla, Rohith Sharma K S
10 non-binding +1s, from:
-------------------------------
runlin zhang, Thomas Marquardt, Santosh Marella, Anil Sadineni, Jeffrey
Rodriguez, zhankun tang, Ayush Saxena, Dinesh Chitlangia, Prabhu Josep,
Abhishek Modi
1 non-binding with +0s from:
-------------------------------------
Masatake Iwasaki
and *no -1s*.
So I am glad to announce that the vote for 3.2.1 RC0 passes.
Thanks everyone listed above who tried the release candidate and vote, and
all who ever help with 3.2.1 release effort in all kinds of ways.
I'll push the release bits and send out an announcement for 3.2.1 soon.
Thanks,
Rohith Sharma K S
On Thu, 19 Sep 2019 at 14:34, Abhishek Modi <ab...@gmail.com> wrote:
> Hi Rohith,
>
> Thanks for driving this release.
>
> +1 (binding)
>
> - built from the source on windows machine.
> - created a pseudo cluster.
> - ran PI job.
> - checked basic metrics with ATSv2 enabled.
>
> On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
>
>> Hi Rohith
>>
>> Thanks for putting this together, appreciate the same.
>>
>> +1 (binding)
>>
>> - verified signature
>> - brought up a cluster from the tar ball
>> - Ran some basic MR jobs
>> - RM UI seems fine (old and new)
>>
>>
>> Thanks
>> Sunil
>>
>> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
>> rohithsharmaks@apache.org> wrote:
>>
>> > Hi folks,
>> >
>> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>> >
>> > The RC is available at:
>> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>> >
>> > The RC tag in git is release-3.2.1-RC0:
>> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>> >
>> >
>> > The maven artifacts are staged at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>> >
>> > You can find my public key at:
>> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> >
>> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
>> pm
>> > PST.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Thanks & Regards
>> > Rohith Sharma K S
>> >
>>
>
>
> --
> Regards,
> Abhishek Modi
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks all who helped to verify and vote 3.2.1 release! I am concluding the
vote for 3.2.1 RC0.
Summary of votes for hadoop-3.2.1-RC0:
7 binding +1s, from:
--------------------------
Sunil Govindan, Brahma Reddy Battula, Steve Loughran, Elek, Marton, Weiwei
Yang, Naganarasimha Garla, Rohith Sharma K S
10 non-binding +1s, from:
-------------------------------
runlin zhang, Thomas Marquardt, Santosh Marella, Anil Sadineni, Jeffrey
Rodriguez, zhankun tang, Ayush Saxena, Dinesh Chitlangia, Prabhu Josep,
Abhishek Modi
1 non-binding with +0s from:
-------------------------------------
Masatake Iwasaki
and *no -1s*.
So I am glad to announce that the vote for 3.2.1 RC0 passes.
Thanks everyone listed above who tried the release candidate and vote, and
all who ever help with 3.2.1 release effort in all kinds of ways.
I'll push the release bits and send out an announcement for 3.2.1 soon.
Thanks,
Rohith Sharma K S
On Thu, 19 Sep 2019 at 14:34, Abhishek Modi <ab...@gmail.com> wrote:
> Hi Rohith,
>
> Thanks for driving this release.
>
> +1 (binding)
>
> - built from the source on windows machine.
> - created a pseudo cluster.
> - ran PI job.
> - checked basic metrics with ATSv2 enabled.
>
> On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
>
>> Hi Rohith
>>
>> Thanks for putting this together, appreciate the same.
>>
>> +1 (binding)
>>
>> - verified signature
>> - brought up a cluster from the tar ball
>> - Ran some basic MR jobs
>> - RM UI seems fine (old and new)
>>
>>
>> Thanks
>> Sunil
>>
>> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
>> rohithsharmaks@apache.org> wrote:
>>
>> > Hi folks,
>> >
>> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>> >
>> > The RC is available at:
>> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>> >
>> > The RC tag in git is release-3.2.1-RC0:
>> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>> >
>> >
>> > The maven artifacts are staged at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>> >
>> > You can find my public key at:
>> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> >
>> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
>> pm
>> > PST.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Thanks & Regards
>> > Rohith Sharma K S
>> >
>>
>
>
> --
> Regards,
> Abhishek Modi
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks all who helped to verify and vote 3.2.1 release! I am concluding the
vote for 3.2.1 RC0.
Summary of votes for hadoop-3.2.1-RC0:
7 binding +1s, from:
--------------------------
Sunil Govindan, Brahma Reddy Battula, Steve Loughran, Elek, Marton, Weiwei
Yang, Naganarasimha Garla, Rohith Sharma K S
10 non-binding +1s, from:
-------------------------------
runlin zhang, Thomas Marquardt, Santosh Marella, Anil Sadineni, Jeffrey
Rodriguez, zhankun tang, Ayush Saxena, Dinesh Chitlangia, Prabhu Josep,
Abhishek Modi
1 non-binding with +0s from:
-------------------------------------
Masatake Iwasaki
and *no -1s*.
So I am glad to announce that the vote for 3.2.1 RC0 passes.
Thanks everyone listed above who tried the release candidate and vote, and
all who ever help with 3.2.1 release effort in all kinds of ways.
I'll push the release bits and send out an announcement for 3.2.1 soon.
Thanks,
Rohith Sharma K S
On Thu, 19 Sep 2019 at 14:34, Abhishek Modi <ab...@gmail.com> wrote:
> Hi Rohith,
>
> Thanks for driving this release.
>
> +1 (binding)
>
> - built from the source on windows machine.
> - created a pseudo cluster.
> - ran PI job.
> - checked basic metrics with ATSv2 enabled.
>
> On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
>
>> Hi Rohith
>>
>> Thanks for putting this together, appreciate the same.
>>
>> +1 (binding)
>>
>> - verified signature
>> - brought up a cluster from the tar ball
>> - Ran some basic MR jobs
>> - RM UI seems fine (old and new)
>>
>>
>> Thanks
>> Sunil
>>
>> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
>> rohithsharmaks@apache.org> wrote:
>>
>> > Hi folks,
>> >
>> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>> >
>> > The RC is available at:
>> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>> >
>> > The RC tag in git is release-3.2.1-RC0:
>> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>> >
>> >
>> > The maven artifacts are staged at
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>> >
>> > You can find my public key at:
>> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> >
>> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
>> pm
>> > PST.
>> >
>> > I have done testing with a pseudo cluster and distributed shell job. My
>> +1
>> > to start.
>> >
>> > Thanks & Regards
>> > Rohith Sharma K S
>> >
>>
>
>
> --
> Regards,
> Abhishek Modi
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Abhishek Modi <ab...@gmail.com>.
Hi Rohith,
Thanks for driving this release.
+1 (binding)
- built from the source on windows machine.
- created a pseudo cluster.
- ran PI job.
- checked basic metrics with ATSv2 enabled.
On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
> Hi Rohith
>
> Thanks for putting this together, appreciate the same.
>
> +1 (binding)
>
> - verified signature
> - brought up a cluster from the tar ball
> - Ran some basic MR jobs
> - RM UI seems fine (old and new)
>
>
> Thanks
> Sunil
>
> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Regards,
Abhishek Modi
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Abhishek Modi <ab...@gmail.com>.
Hi Rohith,
Thanks for driving this release.
+1 (binding)
- built from the source on windows machine.
- created a pseudo cluster.
- ran PI job.
- checked basic metrics with ATSv2 enabled.
On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
> Hi Rohith
>
> Thanks for putting this together, appreciate the same.
>
> +1 (binding)
>
> - verified signature
> - brought up a cluster from the tar ball
> - Ran some basic MR jobs
> - RM UI seems fine (old and new)
>
>
> Thanks
> Sunil
>
> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Regards,
Abhishek Modi
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Abhishek Modi <ab...@gmail.com>.
Hi Rohith,
Thanks for driving this release.
+1 (binding)
- built from the source on windows machine.
- created a pseudo cluster.
- ran PI job.
- checked basic metrics with ATSv2 enabled.
On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
> Hi Rohith
>
> Thanks for putting this together, appreciate the same.
>
> +1 (binding)
>
> - verified signature
> - brought up a cluster from the tar ball
> - Ran some basic MR jobs
> - RM UI seems fine (old and new)
>
>
> Thanks
> Sunil
>
> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Regards,
Abhishek Modi
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Abhishek Modi <ab...@gmail.com>.
Hi Rohith,
Thanks for driving this release.
+1 (binding)
- built from the source on windows machine.
- created a pseudo cluster.
- ran PI job.
- checked basic metrics with ATSv2 enabled.
On Thu, Sep 19, 2019 at 12:30 PM Sunil Govindan <su...@apache.org> wrote:
> Hi Rohith
>
> Thanks for putting this together, appreciate the same.
>
> +1 (binding)
>
> - verified signature
> - brought up a cluster from the tar ball
> - Ran some basic MR jobs
> - RM UI seems fine (old and new)
>
>
> Thanks
> Sunil
>
> On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
> rohithsharmaks@apache.org> wrote:
>
> > Hi folks,
> >
> > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> >
> > The RC is available at:
> > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> >
> > The RC tag in git is release-3.2.1-RC0:
> > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> >
> >
> > The maven artifacts are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> >
> > You can find my public key at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> pm
> > PST.
> >
> > I have done testing with a pseudo cluster and distributed shell job. My
> +1
> > to start.
> >
> > Thanks & Regards
> > Rohith Sharma K S
> >
>
--
Regards,
Abhishek Modi
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Sunil Govindan <su...@apache.org>.
Hi Rohith
Thanks for putting this together, appreciate the same.
+1 (binding)
- verified signature
- brought up a cluster from the tar ball
- Ran some basic MR jobs
- RM UI seems fine (old and new)
Thanks
Sunil
On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Sunil Govindan <su...@apache.org>.
Hi Rohith
Thanks for putting this together, appreciate the same.
+1 (binding)
- verified signature
- brought up a cluster from the tar ball
- Ran some basic MR jobs
- RM UI seems fine (old and new)
Thanks
Sunil
On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+0
* built from source taball.
* launched 3-nodes cluster.
* ran some examplr MR jobs.
* ran some CLI file operations.
Same as 3.1.3 RC0, verbose INFO message is emitted on data transfer
operations.::
$ bin/hadoop fs -put README.txt '/c;d/'
2019-09-18 17:41:24,977 INFO sasl.SaslDataTransferClient: SASL
encryption trust check: localHostTrusted = false, remoteHostTrusted = false
This was already fixed by HDFS-14759.
It was cherry-picked to branch-3.2 and branch-3.1 yesterday.
While this might not be worth for sinking RC0, I would not like to
give bad impression about quality control of patch release.
Thanks,
Masatake Iwasaki
On 9/11/19 16:26, Rohith Sharma K S wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Sunil Govindan <su...@apache.org>.
Hi Rohith
Thanks for putting this together, appreciate the same.
+1 (binding)
- verified signature
- brought up a cluster from the tar ball
- Ran some basic MR jobs
- RM UI seems fine (old and new)
Thanks
Sunil
On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+0
* built from source taball.
* launched 3-nodes cluster.
* ran some examplr MR jobs.
* ran some CLI file operations.
Same as 3.1.3 RC0, verbose INFO message is emitted on data transfer
operations.::
$ bin/hadoop fs -put README.txt '/c;d/'
2019-09-18 17:41:24,977 INFO sasl.SaslDataTransferClient: SASL
encryption trust check: localHostTrusted = false, remoteHostTrusted = false
This was already fixed by HDFS-14759.
It was cherry-picked to branch-3.2 and branch-3.1 yesterday.
While this might not be worth for sinking RC0, I would not like to
give bad impression about quality control of patch release.
Thanks,
Masatake Iwasaki
On 9/11/19 16:26, Rohith Sharma K S wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+0
* built from source taball.
* launched 3-nodes cluster.
* ran some examplr MR jobs.
* ran some CLI file operations.
Same as 3.1.3 RC0, verbose INFO message is emitted on data transfer
operations.::
$ bin/hadoop fs -put README.txt '/c;d/'
2019-09-18 17:41:24,977 INFO sasl.SaslDataTransferClient: SASL
encryption trust check: localHostTrusted = false, remoteHostTrusted = false
This was already fixed by HDFS-14759.
It was cherry-picked to branch-3.2 and branch-3.1 yesterday.
While this might not be worth for sinking RC0, I would not like to
give bad impression about quality control of patch release.
Thanks,
Masatake Iwasaki
On 9/11/19 16:26, Rohith Sharma K S wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Thomas Marquardt <tm...@microsoft.com.INVALID>.
I built release-3.2.1-RC0 and verified that the hadoop-azure tests are passing, so WASB and ABFS look great. +1
-----Original Message-----
From: runlin zhang <ru...@gmail.com>
Sent: Thursday, September 12, 2019 1:06 AM
To: Rohith Sharma K S <ro...@apache.org>
Cc: Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; Hadoop Common <co...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> https://nam06.safelinks.protection.outlook.com/?url=http:%2F%2Fhome.ap
> ache.org%2F~rohithsharmaks%2Fhadoop-3.2.1-RC0%2F&data=02%7C01%7Ctm
> arq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86f14
> 1af91ab2d7cd011db47%7C1%7C1%7C637038723538965168&sdata=ItMaCqAX58U
> MR%2Bm8Tx5wCatU4j80rsLcGumldCUgwoE%3D&reserved=0
>
> The RC tag in git is release-3.2.1-RC0:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com%2Fapache%2Fhadoop%2Ftree%2Frelease-3.2.1-RC0&data=02%7C01%7
> Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86
> f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdata=2BrIY0xb
> 8D%2Bkx59R5jSfiMHpN8R72y3HaFlGFlZQwW0%3D&reserved=0
>
>
> The maven artifacts are staged at
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo
> sitory.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1226%2F&a
> mp;data=02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d73758
> 0754%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&a
> mp;sdata=Xdt%2FcPEGc7H%2BWrimqf4BIq4G44ejQ4uA4icsyn%2FjiII%3D&rese
> rved=0
>
> You can find my public key at:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist
> .apache.org%2Frepos%2Fdist%2Frelease%2Fhadoop%2Fcommon%2FKEYS&data
> =02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C
> 72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdat
> a=Ors%2BdrV8jVjaLSjc44Wwk2NSMVCkcrZDpPtH9f4FV84%3D&reserved=0
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59 pm PST.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1 to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Thomas Marquardt <tm...@microsoft.com.INVALID>.
I built release-3.2.1-RC0 and verified that the hadoop-azure tests are passing, so WASB and ABFS look great. +1
-----Original Message-----
From: runlin zhang <ru...@gmail.com>
Sent: Thursday, September 12, 2019 1:06 AM
To: Rohith Sharma K S <ro...@apache.org>
Cc: Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; Hadoop Common <co...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> https://nam06.safelinks.protection.outlook.com/?url=http:%2F%2Fhome.ap
> ache.org%2F~rohithsharmaks%2Fhadoop-3.2.1-RC0%2F&data=02%7C01%7Ctm
> arq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86f14
> 1af91ab2d7cd011db47%7C1%7C1%7C637038723538965168&sdata=ItMaCqAX58U
> MR%2Bm8Tx5wCatU4j80rsLcGumldCUgwoE%3D&reserved=0
>
> The RC tag in git is release-3.2.1-RC0:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com%2Fapache%2Fhadoop%2Ftree%2Frelease-3.2.1-RC0&data=02%7C01%7
> Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86
> f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdata=2BrIY0xb
> 8D%2Bkx59R5jSfiMHpN8R72y3HaFlGFlZQwW0%3D&reserved=0
>
>
> The maven artifacts are staged at
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo
> sitory.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1226%2F&a
> mp;data=02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d73758
> 0754%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&a
> mp;sdata=Xdt%2FcPEGc7H%2BWrimqf4BIq4G44ejQ4uA4icsyn%2FjiII%3D&rese
> rved=0
>
> You can find my public key at:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist
> .apache.org%2Frepos%2Fdist%2Frelease%2Fhadoop%2Fcommon%2FKEYS&data
> =02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C
> 72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdat
> a=Ors%2BdrV8jVjaLSjc44Wwk2NSMVCkcrZDpPtH9f4FV84%3D&reserved=0
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59 pm PST.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1 to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Thomas Marquardt <tm...@microsoft.com.INVALID>.
I built release-3.2.1-RC0 and verified that the hadoop-azure tests are passing, so WASB and ABFS look great. +1
-----Original Message-----
From: runlin zhang <ru...@gmail.com>
Sent: Thursday, September 12, 2019 1:06 AM
To: Rohith Sharma K S <ro...@apache.org>
Cc: Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; Hadoop Common <co...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> https://nam06.safelinks.protection.outlook.com/?url=http:%2F%2Fhome.ap
> ache.org%2F~rohithsharmaks%2Fhadoop-3.2.1-RC0%2F&data=02%7C01%7Ctm
> arq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86f14
> 1af91ab2d7cd011db47%7C1%7C1%7C637038723538965168&sdata=ItMaCqAX58U
> MR%2Bm8Tx5wCatU4j80rsLcGumldCUgwoE%3D&reserved=0
>
> The RC tag in git is release-3.2.1-RC0:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com%2Fapache%2Fhadoop%2Ftree%2Frelease-3.2.1-RC0&data=02%7C01%7
> Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86
> f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdata=2BrIY0xb
> 8D%2Bkx59R5jSfiMHpN8R72y3HaFlGFlZQwW0%3D&reserved=0
>
>
> The maven artifacts are staged at
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo
> sitory.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1226%2F&a
> mp;data=02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d73758
> 0754%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&a
> mp;sdata=Xdt%2FcPEGc7H%2BWrimqf4BIq4G44ejQ4uA4icsyn%2FjiII%3D&rese
> rved=0
>
> You can find my public key at:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist
> .apache.org%2Frepos%2Fdist%2Frelease%2Fhadoop%2Fcommon%2FKEYS&data
> =02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C
> 72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdat
> a=Ors%2BdrV8jVjaLSjc44Wwk2NSMVCkcrZDpPtH9f4FV84%3D&reserved=0
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59 pm PST.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1 to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Thomas Marquardt <tm...@microsoft.com.INVALID>.
I built release-3.2.1-RC0 and verified that the hadoop-azure tests are passing, so WASB and ABFS look great. +1
-----Original Message-----
From: runlin zhang <ru...@gmail.com>
Sent: Thursday, September 12, 2019 1:06 AM
To: Rohith Sharma K S <ro...@apache.org>
Cc: Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>; Hadoop Common <co...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> https://nam06.safelinks.protection.outlook.com/?url=http:%2F%2Fhome.ap
> ache.org%2F~rohithsharmaks%2Fhadoop-3.2.1-RC0%2F&data=02%7C01%7Ctm
> arq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86f14
> 1af91ab2d7cd011db47%7C1%7C1%7C637038723538965168&sdata=ItMaCqAX58U
> MR%2Bm8Tx5wCatU4j80rsLcGumldCUgwoE%3D&reserved=0
>
> The RC tag in git is release-3.2.1-RC0:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgith
> ub.com%2Fapache%2Fhadoop%2Ftree%2Frelease-3.2.1-RC0&data=02%7C01%7
> Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C72f988bf86
> f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdata=2BrIY0xb
> 8D%2Bkx59R5jSfiMHpN8R72y3HaFlGFlZQwW0%3D&reserved=0
>
>
> The maven artifacts are staged at
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepo
> sitory.apache.org%2Fcontent%2Frepositories%2Forgapachehadoop-1226%2F&a
> mp;data=02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d73758
> 0754%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&a
> mp;sdata=Xdt%2FcPEGc7H%2BWrimqf4BIq4G44ejQ4uA4icsyn%2FjiII%3D&rese
> rved=0
>
> You can find my public key at:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist
> .apache.org%2Frepos%2Fdist%2Frelease%2Fhadoop%2Fcommon%2FKEYS&data
> =02%7C01%7Ctmarq%40microsoft.com%7Cd987fa2749894f6556c108d737580754%7C
> 72f988bf86f141af91ab2d7cd011db47%7C1%7C1%7C637038723538975159&sdat
> a=Ors%2BdrV8jVjaLSjc44Wwk2NSMVCkcrZDpPtH9f4FV84%3D&reserved=0
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at
> 11:59 pm PST.
>
> I have done testing with a pseudo cluster and distributed shell job.
> My +1 to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by runlin zhang <ru...@gmail.com>.
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Santosh Marella <ma...@gmail.com>.
+1 (non-binding)
On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+0
* built from source taball.
* launched 3-nodes cluster.
* ran some examplr MR jobs.
* ran some CLI file operations.
Same as 3.1.3 RC0, verbose INFO message is emitted on data transfer
operations.::
$ bin/hadoop fs -put README.txt '/c;d/'
2019-09-18 17:41:24,977 INFO sasl.SaslDataTransferClient: SASL
encryption trust check: localHostTrusted = false, remoteHostTrusted = false
This was already fixed by HDFS-14759.
It was cherry-picked to branch-3.2 and branch-3.1 yesterday.
While this might not be worth for sinking RC0, I would not like to
give bad impression about quality control of patch release.
Thanks,
Masatake Iwasaki
On 9/11/19 16:26, Rohith Sharma K S wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
>
> +1 binding.
>
> One caveat: warn people that guava is now at 27.0 -and that if you run
> with an older version of Guava things will inevitably break.
>
>
> steps to validate
> ==================
>
> * downloaded src and binary artifacts
> * after import of KEYS and trusting Rohith's key, validate GPG signatures
> * test basic hadoop fs commands against s3a with s3guard and abfds
>
>
>
>
> Validating S3A connector
> ========================
>
> * grabbed the latest build of my cloudstore diagnostics JAR
> https://github.com/steveloughran/cloudstore/releases/tag/tag_2019-09-13
> * and set an env var to it:
> set -gx CLOUDSTORE cloudstore/target/cloudstore-0.1-SNAPSHOT.jar
>
> bin/hadoop jar $CLOUDSTORE storediag s3a://hwdev-steve-ireland-new
>
>
>
> Diagnostics for filesystem s3a://hwdev-steve-ireland-new/
> =========================================================
>
> S3A FileSystem connector
> ASF Filesystem Connector to Amazon S3 Storage and compatible stores
>
> https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: org.apache.hadoop.fs.s3a.S3AFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: com.amazonaws.services.s3.AmazonS3
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.ClientConfiguration
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
>
> Optional Classes
> ================
>
> These classes are needed in some versions of Hadoop.
> And/or for optional features to work.
>
> class: com.amazonaws.services.dynamodbv2.AmazonDynamoDB
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.services.securitytoken.AWSSecurityTokenServiceClient
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.fasterxml.jackson.annotation.JacksonAnnotation
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.fasterxml.jackson.core.JsonParseException
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectMapper
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: org.joda.time.Interval
> Not found on classpath: org.joda.time.Interval
> class: org.apache.hadoop.fs.s3a.s3guard.S3Guard
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.staging.StagingCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.Invoker
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
>
> then some classes which aren't in 3.2 and so which I didn't expect to
> see.
>
> class: org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> Not found on classpath:
> org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> class: com.amazonaws.services.s3.model.SelectObjectContentRequest
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: org.apache.hadoop.fs.s3a.select.SelectInputStream
> Not found on classpath:
> org.apache.hadoop.fs.s3a.select.SelectInputStream
> class: org.apache.hadoop.fs.s3a.impl.RenameOperation
> Not found on classpath:
> org.apache.hadoop.fs.s3a.impl.RenameOperation
>
>
>
> + the command then executed basic list/read/write operations; all good.
>
>
>
> Validating abfs connector
> =========================
>
> * set -gx HADOOP_OPTIONAL_TOOLS hadoop-azure
>
>
>
>
> Diagnostics for filesystem abfs://container@someone.dfs.core.windows.net/
>
> ============================================================================
>
> Azure Abfs connector
> ASF Filesystem Connector to Microsoft Azure ABFS Storage
> https://hadoop.apache.org/docs/current/hadoop-azure/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Environment Variables
> =====================
>
> HADOOP_HOME = "/Users/stevel/hadoop/candidates/hadoop-3.2.1"
> HADOOP_CONF_DIR = "/Users/stevel/hadoop-3.2.1/etc/hadoop"
> HADOOP_OPTIONAL_TOOLS =
> "hadoop-azure,hadoop-aws,hadoop-azure-datalake,hadoop-openstack"
> HADOOP_SHELL_SCRIPT_DEBUG = (unset)
> HADOOP_TOOLS_HOME = (unset)
> HADOOP_TOOLS_OPTIONS = (unset)
> HDP_VERSION = (unset)
> SPARK_HOME = (unset)
> SPARK_CONF_DIR = (unset)
> PYSPARK_DRIVER_PYTHON = (unset)
> SPARK_SCALA_VERSION = (unset)
> YARN_CONF_DIR = (unset)
> HADOOP_TOKEN_FILE_LOCATION = (unset)
> HADOOP_TOKEN = (unset)
>
>
>
> Hadoop Options
> ==============
>
> fs.defaultFS = "file:///" [core-default.xml]
> fs.default.name = "file:///"
> hdp.version = (unset)
> yarn.resourcemanager.address = "0.0.0.0:8032" [yarn-default.xml]
> yarn.resourcemanager.webapp.address = "0.0.0.0:8088" [yarn-default.xml]
> yarn.resourcemanager.webapp.https.address = "0.0.0.0:8090"
> [yarn-default.xml]
> mapreduce.input.fileinputformat.list-status.num-threads = "1"
> [mapred-default.xml]
>
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: com.fasterxml.jackson.annotation.JsonProperty
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.google.common.base.Preconditions
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/guava-27.0-jre.jar
> class: com.fasterxml.jackson.core.JsonFactory
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectReader
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: com.microsoft.azure.storage.StorageErrorCode
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/azure-storage-7.0.0.jar
> class: org.apache.http.client.utils.URIBuilder
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/httpclient-4.5.6.jar
> class: org.wildfly.openssl.OpenSSLProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/wildfly-openssl-1.0.7.Final.jar
> class: org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-azure-3.2.1.jar
>
> -again a full filesystem list/read/write/delete sequence was executed;
> again all good.
>
>
> -------------------------------------------
>
> spark
> =====
>
>
> (branch master; version 3.0.0-SNAPSHOT)
>
> After editing my maven settings to avoid our in-house nexus server, I did
> a clean build with the profiles:
>
> -Dhadoop.version=3.2.1 -Phive -Phive-thriftserver -Pyarn -Phadoop-3.2
> -Phadoop-cloud -Psnapshots-and-staging
>
>
> Downloading from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> Downloaded from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> (70 kB at 72 kB/s)
>
>
> For the record, three issues surfaced there
> * spark now demands mvn 3.6.2, so upgrade time there
> * for some reason the build decided to download all the other artifacts
> that maven central has ever hosted
> * spark's build hangs if you pass in the -T 1C argument to maven. Worth
> remembering.
> * and of couse you have to rebuild the next day.
>
> Spark compilation completed: I did not run its test suites.
>
> spark cloud integration tests
> =============================
>
> Once spark was built, I went with my downstream test suite.
> https://github.com/hortonworks-spark/cloud-integration
>
> Here here I got burned at runtime by the guava change; the module was set
> up to use guava 0.19, and Configuration.set() failed.
>
> S3ACommitBulkDataSuite:
> com.cloudera.spark.cloud.s3.commit.S3ACommitBulkDataSuite *** ABORTED ***
> java.lang.RuntimeException: Unable to load a Suite class that was
> discovered in the runpath:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2(CloudSuiteTrait.scala:145)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2$adapted(CloudSuiteTrait.scala:144)
> at scala.Option.foreach(Option.scala:274)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1(CloudSuiteTrait.scala:144)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1$adapted(CloudSuiteTrait.scala:143)
> at scala.collection.immutable.List.foreach(List.scala:392)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration(CloudSuiteTrait.scala:143)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration$(CloudSuiteTrait.scala:142)
> at
> com.cloudera.spark.cloud.common.CloudSuite$.overlayConfiguration(CloudSuite.scala:41)
> ...
>
> This is one of those things which was inevitable. I do think we'll need to
> warn people in the release notes.
>
> (I also discovered someone has deleted a test source data bucket of mine
> so some tests failed; not something I fixed today.)
>
> With the guava tests, other than a failure due to someone deleting a
> bucket of mine containing test source data, all tests against s3a and abfs
> were happy.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Santosh Marella <ma...@gmail.com>.
+1 (non-binding)
On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Sunil Govindan <su...@apache.org>.
Hi Rohith
Thanks for putting this together, appreciate the same.
+1 (binding)
- verified signature
- brought up a cluster from the tar ball
- Ran some basic MR jobs
- RM UI seems fine (old and new)
Thanks
Sunil
On Wed, Sep 11, 2019 at 12:56 PM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
>
> +1 binding.
>
> One caveat: warn people that guava is now at 27.0 -and that if you run
> with an older version of Guava things will inevitably break.
>
>
> steps to validate
> ==================
>
> * downloaded src and binary artifacts
> * after import of KEYS and trusting Rohith's key, validate GPG signatures
> * test basic hadoop fs commands against s3a with s3guard and abfds
>
>
>
>
> Validating S3A connector
> ========================
>
> * grabbed the latest build of my cloudstore diagnostics JAR
> https://github.com/steveloughran/cloudstore/releases/tag/tag_2019-09-13
> * and set an env var to it:
> set -gx CLOUDSTORE cloudstore/target/cloudstore-0.1-SNAPSHOT.jar
>
> bin/hadoop jar $CLOUDSTORE storediag s3a://hwdev-steve-ireland-new
>
>
>
> Diagnostics for filesystem s3a://hwdev-steve-ireland-new/
> =========================================================
>
> S3A FileSystem connector
> ASF Filesystem Connector to Amazon S3 Storage and compatible stores
>
> https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: org.apache.hadoop.fs.s3a.S3AFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: com.amazonaws.services.s3.AmazonS3
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.ClientConfiguration
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
>
> Optional Classes
> ================
>
> These classes are needed in some versions of Hadoop.
> And/or for optional features to work.
>
> class: com.amazonaws.services.dynamodbv2.AmazonDynamoDB
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.services.securitytoken.AWSSecurityTokenServiceClient
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.fasterxml.jackson.annotation.JacksonAnnotation
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.fasterxml.jackson.core.JsonParseException
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectMapper
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: org.joda.time.Interval
> Not found on classpath: org.joda.time.Interval
> class: org.apache.hadoop.fs.s3a.s3guard.S3Guard
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.staging.StagingCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.Invoker
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
>
> then some classes which aren't in 3.2 and so which I didn't expect to
> see.
>
> class: org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> Not found on classpath:
> org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> class: com.amazonaws.services.s3.model.SelectObjectContentRequest
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: org.apache.hadoop.fs.s3a.select.SelectInputStream
> Not found on classpath:
> org.apache.hadoop.fs.s3a.select.SelectInputStream
> class: org.apache.hadoop.fs.s3a.impl.RenameOperation
> Not found on classpath:
> org.apache.hadoop.fs.s3a.impl.RenameOperation
>
>
>
> + the command then executed basic list/read/write operations; all good.
>
>
>
> Validating abfs connector
> =========================
>
> * set -gx HADOOP_OPTIONAL_TOOLS hadoop-azure
>
>
>
>
> Diagnostics for filesystem abfs://container@someone.dfs.core.windows.net/
>
> ============================================================================
>
> Azure Abfs connector
> ASF Filesystem Connector to Microsoft Azure ABFS Storage
> https://hadoop.apache.org/docs/current/hadoop-azure/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Environment Variables
> =====================
>
> HADOOP_HOME = "/Users/stevel/hadoop/candidates/hadoop-3.2.1"
> HADOOP_CONF_DIR = "/Users/stevel/hadoop-3.2.1/etc/hadoop"
> HADOOP_OPTIONAL_TOOLS =
> "hadoop-azure,hadoop-aws,hadoop-azure-datalake,hadoop-openstack"
> HADOOP_SHELL_SCRIPT_DEBUG = (unset)
> HADOOP_TOOLS_HOME = (unset)
> HADOOP_TOOLS_OPTIONS = (unset)
> HDP_VERSION = (unset)
> SPARK_HOME = (unset)
> SPARK_CONF_DIR = (unset)
> PYSPARK_DRIVER_PYTHON = (unset)
> SPARK_SCALA_VERSION = (unset)
> YARN_CONF_DIR = (unset)
> HADOOP_TOKEN_FILE_LOCATION = (unset)
> HADOOP_TOKEN = (unset)
>
>
>
> Hadoop Options
> ==============
>
> fs.defaultFS = "file:///" [core-default.xml]
> fs.default.name = "file:///"
> hdp.version = (unset)
> yarn.resourcemanager.address = "0.0.0.0:8032" [yarn-default.xml]
> yarn.resourcemanager.webapp.address = "0.0.0.0:8088" [yarn-default.xml]
> yarn.resourcemanager.webapp.https.address = "0.0.0.0:8090"
> [yarn-default.xml]
> mapreduce.input.fileinputformat.list-status.num-threads = "1"
> [mapred-default.xml]
>
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: com.fasterxml.jackson.annotation.JsonProperty
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.google.common.base.Preconditions
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/guava-27.0-jre.jar
> class: com.fasterxml.jackson.core.JsonFactory
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectReader
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: com.microsoft.azure.storage.StorageErrorCode
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/azure-storage-7.0.0.jar
> class: org.apache.http.client.utils.URIBuilder
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/httpclient-4.5.6.jar
> class: org.wildfly.openssl.OpenSSLProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/wildfly-openssl-1.0.7.Final.jar
> class: org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-azure-3.2.1.jar
>
> -again a full filesystem list/read/write/delete sequence was executed;
> again all good.
>
>
> -------------------------------------------
>
> spark
> =====
>
>
> (branch master; version 3.0.0-SNAPSHOT)
>
> After editing my maven settings to avoid our in-house nexus server, I did
> a clean build with the profiles:
>
> -Dhadoop.version=3.2.1 -Phive -Phive-thriftserver -Pyarn -Phadoop-3.2
> -Phadoop-cloud -Psnapshots-and-staging
>
>
> Downloading from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> Downloaded from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> (70 kB at 72 kB/s)
>
>
> For the record, three issues surfaced there
> * spark now demands mvn 3.6.2, so upgrade time there
> * for some reason the build decided to download all the other artifacts
> that maven central has ever hosted
> * spark's build hangs if you pass in the -T 1C argument to maven. Worth
> remembering.
> * and of couse you have to rebuild the next day.
>
> Spark compilation completed: I did not run its test suites.
>
> spark cloud integration tests
> =============================
>
> Once spark was built, I went with my downstream test suite.
> https://github.com/hortonworks-spark/cloud-integration
>
> Here here I got burned at runtime by the guava change; the module was set
> up to use guava 0.19, and Configuration.set() failed.
>
> S3ACommitBulkDataSuite:
> com.cloudera.spark.cloud.s3.commit.S3ACommitBulkDataSuite *** ABORTED ***
> java.lang.RuntimeException: Unable to load a Suite class that was
> discovered in the runpath:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2(CloudSuiteTrait.scala:145)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2$adapted(CloudSuiteTrait.scala:144)
> at scala.Option.foreach(Option.scala:274)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1(CloudSuiteTrait.scala:144)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1$adapted(CloudSuiteTrait.scala:143)
> at scala.collection.immutable.List.foreach(List.scala:392)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration(CloudSuiteTrait.scala:143)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration$(CloudSuiteTrait.scala:142)
> at
> com.cloudera.spark.cloud.common.CloudSuite$.overlayConfiguration(CloudSuite.scala:41)
> ...
>
> This is one of those things which was inevitable. I do think we'll need to
> warn people in the release notes.
>
> (I also discovered someone has deleted a test source data bucket of mine
> so some tests failed; not something I fixed today.)
>
> With the guava tests, other than a failure due to someone deleting a
> bucket of mine containing test source data, all tests against s3a and abfs
> were happy.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by runlin zhang <ru...@gmail.com>.
+1
> 在 2019年9月11日，下午3:26，Rohith Sharma K S <ro...@apache.org> 写道：
>
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
>
> +1 binding.
>
> One caveat: warn people that guava is now at 27.0 -and that if you run
> with an older version of Guava things will inevitably break.
>
>
> steps to validate
> ==================
>
> * downloaded src and binary artifacts
> * after import of KEYS and trusting Rohith's key, validate GPG signatures
> * test basic hadoop fs commands against s3a with s3guard and abfds
>
>
>
>
> Validating S3A connector
> ========================
>
> * grabbed the latest build of my cloudstore diagnostics JAR
> https://github.com/steveloughran/cloudstore/releases/tag/tag_2019-09-13
> * and set an env var to it:
> set -gx CLOUDSTORE cloudstore/target/cloudstore-0.1-SNAPSHOT.jar
>
> bin/hadoop jar $CLOUDSTORE storediag s3a://hwdev-steve-ireland-new
>
>
>
> Diagnostics for filesystem s3a://hwdev-steve-ireland-new/
> =========================================================
>
> S3A FileSystem connector
> ASF Filesystem Connector to Amazon S3 Storage and compatible stores
>
> https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: org.apache.hadoop.fs.s3a.S3AFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: com.amazonaws.services.s3.AmazonS3
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.ClientConfiguration
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
>
> Optional Classes
> ================
>
> These classes are needed in some versions of Hadoop.
> And/or for optional features to work.
>
> class: com.amazonaws.services.dynamodbv2.AmazonDynamoDB
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.amazonaws.services.securitytoken.AWSSecurityTokenServiceClient
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: com.fasterxml.jackson.annotation.JacksonAnnotation
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.fasterxml.jackson.core.JsonParseException
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectMapper
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: org.joda.time.Interval
> Not found on classpath: org.joda.time.Interval
> class: org.apache.hadoop.fs.s3a.s3guard.S3Guard
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.staging.StagingCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.Invoker
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
> class: org.apache.hadoop.fs.s3a.auth.AssumedRoleCredentialProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-aws-3.2.1.jar
>
> then some classes which aren't in 3.2 and so which I didn't expect to
> see.
>
> class: org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> Not found on classpath:
> org.apache.hadoop.fs.s3a.auth.delegation.S3ADelegationTokens
> class: com.amazonaws.services.s3.model.SelectObjectContentRequest
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/aws-java-sdk-bundle-1.11.375.jar
> class: org.apache.hadoop.fs.s3a.select.SelectInputStream
> Not found on classpath:
> org.apache.hadoop.fs.s3a.select.SelectInputStream
> class: org.apache.hadoop.fs.s3a.impl.RenameOperation
> Not found on classpath:
> org.apache.hadoop.fs.s3a.impl.RenameOperation
>
>
>
> + the command then executed basic list/read/write operations; all good.
>
>
>
> Validating abfs connector
> =========================
>
> * set -gx HADOOP_OPTIONAL_TOOLS hadoop-azure
>
>
>
>
> Diagnostics for filesystem abfs://container@someone.dfs.core.windows.net/
>
> ============================================================================
>
> Azure Abfs connector
> ASF Filesystem Connector to Microsoft Azure ABFS Storage
> https://hadoop.apache.org/docs/current/hadoop-azure/index.html
>
> Hadoop information
> ==================
>
> Hadoop 3.2.1
> Compiled by rohithsharmaks on 2019-09-10T15:56Z
> Compiled with protoc 2.5.0
> From source with checksum 776eaf9eee9c0ffc370bcbc1888737
>
> Environment Variables
> =====================
>
> HADOOP_HOME = "/Users/stevel/hadoop/candidates/hadoop-3.2.1"
> HADOOP_CONF_DIR = "/Users/stevel/hadoop-3.2.1/etc/hadoop"
> HADOOP_OPTIONAL_TOOLS =
> "hadoop-azure,hadoop-aws,hadoop-azure-datalake,hadoop-openstack"
> HADOOP_SHELL_SCRIPT_DEBUG = (unset)
> HADOOP_TOOLS_HOME = (unset)
> HADOOP_TOOLS_OPTIONS = (unset)
> HDP_VERSION = (unset)
> SPARK_HOME = (unset)
> SPARK_CONF_DIR = (unset)
> PYSPARK_DRIVER_PYTHON = (unset)
> SPARK_SCALA_VERSION = (unset)
> YARN_CONF_DIR = (unset)
> HADOOP_TOKEN_FILE_LOCATION = (unset)
> HADOOP_TOKEN = (unset)
>
>
>
> Hadoop Options
> ==============
>
> fs.defaultFS = "file:///" [core-default.xml]
> fs.default.name = "file:///"
> hdp.version = (unset)
> yarn.resourcemanager.address = "0.0.0.0:8032" [yarn-default.xml]
> yarn.resourcemanager.webapp.address = "0.0.0.0:8088" [yarn-default.xml]
> yarn.resourcemanager.webapp.https.address = "0.0.0.0:8090"
> [yarn-default.xml]
> mapreduce.input.fileinputformat.list-status.num-threads = "1"
> [mapred-default.xml]
>
>
> Required Classes
> ================
>
> All these classes must be on the classpath
>
> class: com.fasterxml.jackson.annotation.JsonProperty
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-annotations-2.9.8.jar
> class: com.google.common.base.Preconditions
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/guava-27.0-jre.jar
> class: com.fasterxml.jackson.core.JsonFactory
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-core-2.9.8.jar
> class: com.fasterxml.jackson.databind.ObjectReader
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/jackson-databind-2.9.8.jar
> class: com.microsoft.azure.storage.StorageErrorCode
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/azure-storage-7.0.0.jar
> class: org.apache.http.client.utils.URIBuilder
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/common/lib/httpclient-4.5.6.jar
> class: org.wildfly.openssl.OpenSSLProvider
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/wildfly-openssl-1.0.7.Final.jar
> class: org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem
>
> file:/Users/stevel/hadoop-3.2.1/share/hadoop/tools/lib/hadoop-azure-3.2.1.jar
>
> -again a full filesystem list/read/write/delete sequence was executed;
> again all good.
>
>
> -------------------------------------------
>
> spark
> =====
>
>
> (branch master; version 3.0.0-SNAPSHOT)
>
> After editing my maven settings to avoid our in-house nexus server, I did
> a clean build with the profiles:
>
> -Dhadoop.version=3.2.1 -Phive -Phive-thriftserver -Pyarn -Phadoop-3.2
> -Phadoop-cloud -Psnapshots-and-staging
>
>
> Downloading from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> Downloaded from ASF Staging:
> https://repository.apache.org/content/groups/staging/org/apache/hadoop/hadoop-project/3.2.1/hadoop-project-3.2.1.pom
> (70 kB at 72 kB/s)
>
>
> For the record, three issues surfaced there
> * spark now demands mvn 3.6.2, so upgrade time there
> * for some reason the build decided to download all the other artifacts
> that maven central has ever hosted
> * spark's build hangs if you pass in the -T 1C argument to maven. Worth
> remembering.
> * and of couse you have to rebuild the next day.
>
> Spark compilation completed: I did not run its test suites.
>
> spark cloud integration tests
> =============================
>
> Once spark was built, I went with my downstream test suite.
> https://github.com/hortonworks-spark/cloud-integration
>
> Here here I got burned at runtime by the guava change; the module was set
> up to use guava 0.19, and Configuration.set() failed.
>
> S3ACommitBulkDataSuite:
> com.cloudera.spark.cloud.s3.commit.S3ACommitBulkDataSuite *** ABORTED ***
> java.lang.RuntimeException: Unable to load a Suite class that was
> discovered in the runpath:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2(CloudSuiteTrait.scala:145)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$2$adapted(CloudSuiteTrait.scala:144)
> at scala.Option.foreach(Option.scala:274)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1(CloudSuiteTrait.scala:144)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.$anonfun$overlayConfiguration$1$adapted(CloudSuiteTrait.scala:143)
> at scala.collection.immutable.List.foreach(List.scala:392)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration(CloudSuiteTrait.scala:143)
> at
> com.cloudera.spark.cloud.common.CloudSuiteTrait.overlayConfiguration$(CloudSuiteTrait.scala:142)
> at
> com.cloudera.spark.cloud.common.CloudSuite$.overlayConfiguration(CloudSuite.scala:41)
> ...
>
> This is one of those things which was inevitable. I do think we'll need to
> warn people in the release notes.
>
> (I also discovered someone has deleted a test source data bucket of mine
> so some tests failed; not something I fixed today.)
>
> With the guava tests, other than a failure due to someone deleting a
> bucket of mine containing test source data, all tests against s3a and abfs
> were happy.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Santosh Marella <ma...@gmail.com>.
+1 (non-binding)
On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
rohithsharmaks@apache.org> wrote:
> Hi folks,
>
> I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
>
> The RC is available at:
> http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
>
> The RC tag in git is release-3.2.1-RC0:
> https://github.com/apache/hadoop/tree/release-3.2.1-RC0
>
>
> The maven artifacts are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
>
> You can find my public key at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59 pm
> PST.
>
> I have done testing with a pseudo cluster and distributed shell job. My +1
> to start.
>
> Thanks & Regards
> Rohith Sharma K S
>
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Inline comments
On Thu, 19 Sep 2019 at 11:51, Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Brahma for voting and bringing this to my attention!
>
> On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
> wrote:
>
>> RohithThanks for driving the release
>>
>> +1 (Binding).
>>
>> --Built from the source
>> --Installed pseudo cluster
>> --Verified Basic hdfs shell command
>> --Ran Pi jobs
>> --Browsed the UI
>>
>>
>> *Rolling Upgrade:*
>> Following issue could have been merged.With out this, need to disable
>> token till rolling upgrade finalised. (Since one of main rolling upgrade
>> issue already merged (HDFS-13596)).
>> https://issues.apache.org/jira/browse/HDFS-14509
>>
> This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
> folks confirms this whether is is blocker for *hadoop-3.2.1* release?
>
>>>> IMO, it is not a blocker for 3.2.1 release. And I haven't heard any
feedback on this from HDFS folks. Hence I am moving forward with release
3.2.1 activities. I will be closing the voting thread today
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Inline comments
On Thu, 19 Sep 2019 at 11:51, Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Brahma for voting and bringing this to my attention!
>
> On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
> wrote:
>
>> RohithThanks for driving the release
>>
>> +1 (Binding).
>>
>> --Built from the source
>> --Installed pseudo cluster
>> --Verified Basic hdfs shell command
>> --Ran Pi jobs
>> --Browsed the UI
>>
>>
>> *Rolling Upgrade:*
>> Following issue could have been merged.With out this, need to disable
>> token till rolling upgrade finalised. (Since one of main rolling upgrade
>> issue already merged (HDFS-13596)).
>> https://issues.apache.org/jira/browse/HDFS-14509
>>
> This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
> folks confirms this whether is is blocker for *hadoop-3.2.1* release?
>
>>>> IMO, it is not a blocker for 3.2.1 release. And I haven't heard any
feedback on this from HDFS folks. Hence I am moving forward with release
3.2.1 activities. I will be closing the voting thread today
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Inline comments
On Thu, 19 Sep 2019 at 11:51, Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Brahma for voting and bringing this to my attention!
>
> On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
> wrote:
>
>> RohithThanks for driving the release
>>
>> +1 (Binding).
>>
>> --Built from the source
>> --Installed pseudo cluster
>> --Verified Basic hdfs shell command
>> --Ran Pi jobs
>> --Browsed the UI
>>
>>
>> *Rolling Upgrade:*
>> Following issue could have been merged.With out this, need to disable
>> token till rolling upgrade finalised. (Since one of main rolling upgrade
>> issue already merged (HDFS-13596)).
>> https://issues.apache.org/jira/browse/HDFS-14509
>>
> This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
> folks confirms this whether is is blocker for *hadoop-3.2.1* release?
>
>>>> IMO, it is not a blocker for 3.2.1 release. And I haven't heard any
feedback on this from HDFS folks. Hence I am moving forward with release
3.2.1 activities. I will be closing the voting thread today
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Inline comments
On Thu, 19 Sep 2019 at 11:51, Rohith Sharma K S <ro...@apache.org>
wrote:
> Thanks Brahma for voting and bringing this to my attention!
>
> On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
> wrote:
>
>> RohithThanks for driving the release
>>
>> +1 (Binding).
>>
>> --Built from the source
>> --Installed pseudo cluster
>> --Verified Basic hdfs shell command
>> --Ran Pi jobs
>> --Browsed the UI
>>
>>
>> *Rolling Upgrade:*
>> Following issue could have been merged.With out this, need to disable
>> token till rolling upgrade finalised. (Since one of main rolling upgrade
>> issue already merged (HDFS-13596)).
>> https://issues.apache.org/jira/browse/HDFS-14509
>>
> This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
> folks confirms this whether is is blocker for *hadoop-3.2.1* release?
>
>>>> IMO, it is not a blocker for 3.2.1 release. And I haven't heard any
feedback on this from HDFS folks. Hence I am moving forward with release
3.2.1 activities. I will be closing the voting thread today
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Brahma for voting and bringing this to my attention!
On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
wrote:
> RohithThanks for driving the release
>
> +1 (Binding).
>
> --Built from the source
> --Installed pseudo cluster
> --Verified Basic hdfs shell command
> --Ran Pi jobs
> --Browsed the UI
>
>
> *Rolling Upgrade:*
> Following issue could have been merged.With out this, need to disable
> token till rolling upgrade finalised. (Since one of main rolling upgrade
> issue already merged (HDFS-13596)).
> https://issues.apache.org/jira/browse/HDFS-14509
>
This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
folks confirms this whether is is blocker for *hadoop-3.2.1* release?
-Rohith Sharma K S
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Brahma for voting and bringing this to my attention!
On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
wrote:
> RohithThanks for driving the release
>
> +1 (Binding).
>
> --Built from the source
> --Installed pseudo cluster
> --Verified Basic hdfs shell command
> --Ran Pi jobs
> --Browsed the UI
>
>
> *Rolling Upgrade:*
> Following issue could have been merged.With out this, need to disable
> token till rolling upgrade finalised. (Since one of main rolling upgrade
> issue already merged (HDFS-13596)).
> https://issues.apache.org/jira/browse/HDFS-14509
>
This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
folks confirms this whether is is blocker for *hadoop-3.2.1* release?
-Rohith Sharma K S
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Brahma for voting and bringing this to my attention!
On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
wrote:
> RohithThanks for driving the release
>
> +1 (Binding).
>
> --Built from the source
> --Installed pseudo cluster
> --Verified Basic hdfs shell command
> --Ran Pi jobs
> --Browsed the UI
>
>
> *Rolling Upgrade:*
> Following issue could have been merged.With out this, need to disable
> token till rolling upgrade finalised. (Since one of main rolling upgrade
> issue already merged (HDFS-13596)).
> https://issues.apache.org/jira/browse/HDFS-14509
>
This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
folks confirms this whether is is blocker for *hadoop-3.2.1* release?
-Rohith Sharma K S
Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0
Posted by Rohith Sharma K S <ro...@apache.org>.
Thanks Brahma for voting and bringing this to my attention!
On Thu, 19 Sep 2019 at 11:28, Brahma Reddy Battula <br...@gmail.com>
wrote:
> RohithThanks for driving the release
>
> +1 (Binding).
>
> --Built from the source
> --Installed pseudo cluster
> --Verified Basic hdfs shell command
> --Ran Pi jobs
> --Browsed the UI
>
>
> *Rolling Upgrade:*
> Following issue could have been merged.With out this, need to disable
> token till rolling upgrade finalised. (Since one of main rolling upgrade
> issue already merged (HDFS-13596)).
> https://issues.apache.org/jira/browse/HDFS-14509
>
This issue marked as blocker for 2.10 and still open!. Can anyone HDFS
folks confirms this whether is is blocker for *hadoop-3.2.1* release?
-Rohith Sharma K S