You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Wei-Chiu Chuang <we...@apache.org> on 2023/06/19 00:52:37 UTC
[VOTE] Release Apache Hadoop 3.3.6 RC1
I am inviting anyone to try and vote on this release candidate.
Note:
This is exactly the same as RC0, except the CHANGELOG.
The RC is available at:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
Git tag: release-3.3.6-RC1
https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
Maven artifacts is built by x86 machine and are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1380/
My public key:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Changelog:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
Release notes:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
This is a relatively small release (by Hadoop standard) containing about
120 commits.
Please give it a try, this RC vote will run for 7 days.
Feature highlights:
SBOM artifacts
----------------------------------------
Starting from this release, Hadoop publishes Software Bill of Materials
(SBOM) using
CycloneDX Maven plugin. For more information about SBOM, please go to
[SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
HDFS RBF: RDBMS based token storage support
----------------------------------------
HDFS Router-Router Based Federation now supports storing delegation tokens
on MySQL,
[HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
which improves token operation through over the original Zookeeper-based
implementation.
New File System APIs
----------------------------------------
[HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
number of
HDFS-specific APIs to Hadoop Common to make it possible for certain
applications that
depend on HDFS semantics to run on other Hadoop compatible file systems.
In particular, recoverLease() and isFileClosed() are exposed through
LeaseRecoverable
interface. While setSafeMode() is exposed through SafeMode interface.
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Rat check (1.8.0_362): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_362): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
* Brought up pseudo-distributed mode cluster with hdfs, zk 3.7 and hbase 2.5
* Basic RBF tests look good
* S3A tests with input stream prefetch enabled: looks good
On Sun, Jun 18, 2023 at 5:53 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
Hi Wei-Chiu,
Thanks for driving the release.
+1 (binding)
Verified checksum and signature.
Built from source successfully.
Ran aws Itests
Ran azure Itests
Compiled hadoop-api-shim
Compiled google cloud storage.
I see two two test failures in GCS connector as seen by you. Created issue.
https://github.com/GoogleCloudDataproc/hadoop-connectors/issues/1014
On Wed, Jun 21, 2023 at 12:55 PM Wei-Chiu Chuang
<we...@cloudera.com.invalid> wrote:
> I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
> No issue for me.
>
> On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
>
> > Addendum:
> > A. Build the release from sources using: `mvn clean install package
> > -DskipTests=true -Dmaven.javadoc.skip=true`
> > B. It works well when using the same command to build from the
> > source branch trunk.
> >
> > On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > Hi,
> > >
> > > I met a fatal error when building from source on local Mac OSX. It
> > > could reproduce stably.
> > > Not sure if it is related to my local environment. Try to dig it, but
> not
> > > any conclusion right now.
> > > Will feedback once find reasons.
> > >
> > > Appendix system environment, some more stack information refer to the
> > > attachment please.
> > > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > > load average:13.99 12.30 8.96
> > >
> > > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> > >
> > > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64
> JRE
> > > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> > 4.2.1
> > > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> > >
> > > mvn version: Apache Maven 3.6.0
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > >
> > > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <
> taklwu@apache.org
> > >
> > > wrote:
> > >
> > >> +1 (non-binding), and thanks a lot for driving the vote.
> > >>
> > >> * Signature of sources and binaries: ok
> > >> * Checksum of sources and binaries: ok
> > >> * Rat check (1.8.0_362): okie
> > >> - mvn clean apache-rat:check
> > >> * Built from source (1.8.0_362): ok
> > >> - mvn clean install -DskipTests
> > >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> > >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> > >> * Run MR examples applications and check the result (1.8.0_362): ok
> > >> - bin/hadoop jar
> > >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> > >> output 'dfs[a-z.]+'
> > >>
> > >> -Stephen
> > >>
> > >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> > >> iwasakims@oss.nttdata.com>
> > >> wrote:
> > >>
> > >> > +1
> > >> >
> > >> > + verified the signature and checksum of the source tarball.
> > >> > + built from the source tarball on Rocky Linux 8 (x86_64) and
> OpenJDK
> > 8
> > >> > with native profile enabled.
> > >> > + launched pseudo distributed cluster including kms and httpfs
> with
> > >> > Kerberos and SSL enabled.
> > >> > + created encryption zone, put and read files via httpfs.
> > >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on
> Rocky
> > >> > Linux 8 (x86_64).
> > >> > + built HBase and Hive against Hadoop 3.3.6.
> > >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > >> > + skimmed the contents of site documentation.
> > >> >
> > >> > Thanks,
> > >> > Masatake Iwasaki
> > >> >
> > >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > >> > > Bumping this thread to the top.
> > >> > > If you are verifying the release, please vote on this thread. RC0
> > and
> > >> RC1
> > >> > > are exactly the same. The only material difference is the
> Changelog.
> > >> > >
> > >> > > Thanks!!
> > >> > >
> > >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <
> weichiu@apache.org
> > >
> > >> > wrote:
> > >> > >
> > >> > >> I am inviting anyone to try and vote on this release candidate.
> > >> > >>
> > >> > >> Note:
> > >> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >> > >>
> > >> > >> The RC is available at:
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> > amd64)
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> > arm64)
> > >> > >>
> > >> > >> Git tag: release-3.3.6-RC1
> > >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >> > >>
> > >> > >> Maven artifacts is built by x86 machine and are staged at
> > >> > >>
> > >> >
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >> > >>
> > >> > >> My public key:
> > >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >> > >>
> > >> > >> Changelog:
> > >> > >>
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >> > >>
> > >> > >> Release notes:
> > >> > >>
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >> > >>
> > >> > >> This is a relatively small release (by Hadoop standard)
> containing
> > >> about
> > >> > >> 120 commits.
> > >> > >> Please give it a try, this RC vote will run for 7 days.
> > >> > >>
> > >> > >>
> > >> > >> Feature highlights:
> > >> > >>
> > >> > >> SBOM artifacts
> > >> > >> ----------------------------------------
> > >> > >> Starting from this release, Hadoop publishes Software Bill of
> > >> Materials
> > >> > >> (SBOM) using
> > >> > >> CycloneDX Maven plugin. For more information about SBOM, please
> go
> > to
> > >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >> > >>
> > >> > >> HDFS RBF: RDBMS based token storage support
> > >> > >> ----------------------------------------
> > >> > >> HDFS Router-Router Based Federation now supports storing
> delegation
> > >> > tokens
> > >> > >> on MySQL,
> > >> > >> [HADOOP-18535](
> https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> > >> which improves token operation through over the original
> > >> Zookeeper-based
> > >> > >> implementation.
> > >> > >>
> > >> > >>
> > >> > >> New File System APIs
> > >> > >> ----------------------------------------
> > >> > >> [HADOOP-18671](
> https://issues.apache.org/jira/browse/HADOOP-18671)
> > >> > moved
> > >> > >> a number of
> > >> > >> HDFS-specific APIs to Hadoop Common to make it possible for
> certain
> > >> > >> applications that
> > >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> > >> systems.
> > >> > >>
> > >> > >> In particular, recoverLease() and isFileClosed() are exposed
> > through
> > >> > >> LeaseRecoverable
> > >> > >> interface. While setSafeMode() is exposed through SafeMode
> > interface.
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >
> > >> >
> > >> >
> ---------------------------------------------------------------------
> > >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >> >
> > >> >
> > >>
> > >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
Hi Wei-Chiu,
Thanks for driving the release.
+1 (binding)
Verified checksum and signature.
Built from source successfully.
Ran aws Itests
Ran azure Itests
Compiled hadoop-api-shim
Compiled google cloud storage.
I see two two test failures in GCS connector as seen by you. Created issue.
https://github.com/GoogleCloudDataproc/hadoop-connectors/issues/1014
On Wed, Jun 21, 2023 at 12:55 PM Wei-Chiu Chuang
<we...@cloudera.com.invalid> wrote:
> I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
> No issue for me.
>
> On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
>
> > Addendum:
> > A. Build the release from sources using: `mvn clean install package
> > -DskipTests=true -Dmaven.javadoc.skip=true`
> > B. It works well when using the same command to build from the
> > source branch trunk.
> >
> > On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > Hi,
> > >
> > > I met a fatal error when building from source on local Mac OSX. It
> > > could reproduce stably.
> > > Not sure if it is related to my local environment. Try to dig it, but
> not
> > > any conclusion right now.
> > > Will feedback once find reasons.
> > >
> > > Appendix system environment, some more stack information refer to the
> > > attachment please.
> > > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > > load average:13.99 12.30 8.96
> > >
> > > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> > >
> > > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64
> JRE
> > > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> > 4.2.1
> > > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> > >
> > > mvn version: Apache Maven 3.6.0
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > >
> > > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <
> taklwu@apache.org
> > >
> > > wrote:
> > >
> > >> +1 (non-binding), and thanks a lot for driving the vote.
> > >>
> > >> * Signature of sources and binaries: ok
> > >> * Checksum of sources and binaries: ok
> > >> * Rat check (1.8.0_362): okie
> > >> - mvn clean apache-rat:check
> > >> * Built from source (1.8.0_362): ok
> > >> - mvn clean install -DskipTests
> > >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> > >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> > >> * Run MR examples applications and check the result (1.8.0_362): ok
> > >> - bin/hadoop jar
> > >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> > >> output 'dfs[a-z.]+'
> > >>
> > >> -Stephen
> > >>
> > >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> > >> iwasakims@oss.nttdata.com>
> > >> wrote:
> > >>
> > >> > +1
> > >> >
> > >> > + verified the signature and checksum of the source tarball.
> > >> > + built from the source tarball on Rocky Linux 8 (x86_64) and
> OpenJDK
> > 8
> > >> > with native profile enabled.
> > >> > + launched pseudo distributed cluster including kms and httpfs
> with
> > >> > Kerberos and SSL enabled.
> > >> > + created encryption zone, put and read files via httpfs.
> > >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on
> Rocky
> > >> > Linux 8 (x86_64).
> > >> > + built HBase and Hive against Hadoop 3.3.6.
> > >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > >> > + skimmed the contents of site documentation.
> > >> >
> > >> > Thanks,
> > >> > Masatake Iwasaki
> > >> >
> > >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > >> > > Bumping this thread to the top.
> > >> > > If you are verifying the release, please vote on this thread. RC0
> > and
> > >> RC1
> > >> > > are exactly the same. The only material difference is the
> Changelog.
> > >> > >
> > >> > > Thanks!!
> > >> > >
> > >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <
> weichiu@apache.org
> > >
> > >> > wrote:
> > >> > >
> > >> > >> I am inviting anyone to try and vote on this release candidate.
> > >> > >>
> > >> > >> Note:
> > >> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >> > >>
> > >> > >> The RC is available at:
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> > amd64)
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> > arm64)
> > >> > >>
> > >> > >> Git tag: release-3.3.6-RC1
> > >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >> > >>
> > >> > >> Maven artifacts is built by x86 machine and are staged at
> > >> > >>
> > >> >
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >> > >>
> > >> > >> My public key:
> > >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >> > >>
> > >> > >> Changelog:
> > >> > >>
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >> > >>
> > >> > >> Release notes:
> > >> > >>
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >> > >>
> > >> > >> This is a relatively small release (by Hadoop standard)
> containing
> > >> about
> > >> > >> 120 commits.
> > >> > >> Please give it a try, this RC vote will run for 7 days.
> > >> > >>
> > >> > >>
> > >> > >> Feature highlights:
> > >> > >>
> > >> > >> SBOM artifacts
> > >> > >> ----------------------------------------
> > >> > >> Starting from this release, Hadoop publishes Software Bill of
> > >> Materials
> > >> > >> (SBOM) using
> > >> > >> CycloneDX Maven plugin. For more information about SBOM, please
> go
> > to
> > >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >> > >>
> > >> > >> HDFS RBF: RDBMS based token storage support
> > >> > >> ----------------------------------------
> > >> > >> HDFS Router-Router Based Federation now supports storing
> delegation
> > >> > tokens
> > >> > >> on MySQL,
> > >> > >> [HADOOP-18535](
> https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> > >> which improves token operation through over the original
> > >> Zookeeper-based
> > >> > >> implementation.
> > >> > >>
> > >> > >>
> > >> > >> New File System APIs
> > >> > >> ----------------------------------------
> > >> > >> [HADOOP-18671](
> https://issues.apache.org/jira/browse/HADOOP-18671)
> > >> > moved
> > >> > >> a number of
> > >> > >> HDFS-specific APIs to Hadoop Common to make it possible for
> certain
> > >> > >> applications that
> > >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> > >> systems.
> > >> > >>
> > >> > >> In particular, recoverLease() and isFileClosed() are exposed
> > through
> > >> > >> LeaseRecoverable
> > >> > >> interface. While setSafeMode() is exposed through SafeMode
> > interface.
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >
> > >> >
> > >> >
> ---------------------------------------------------------------------
> > >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >> >
> > >> >
> > >>
> > >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
Hi Wei-Chiu,
Thanks for driving the release.
+1 (binding)
Verified checksum and signature.
Built from source successfully.
Ran aws Itests
Ran azure Itests
Compiled hadoop-api-shim
Compiled google cloud storage.
I see two two test failures in GCS connector as seen by you. Created issue.
https://github.com/GoogleCloudDataproc/hadoop-connectors/issues/1014
On Wed, Jun 21, 2023 at 12:55 PM Wei-Chiu Chuang
<we...@cloudera.com.invalid> wrote:
> I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
> No issue for me.
>
> On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
>
> > Addendum:
> > A. Build the release from sources using: `mvn clean install package
> > -DskipTests=true -Dmaven.javadoc.skip=true`
> > B. It works well when using the same command to build from the
> > source branch trunk.
> >
> > On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > Hi,
> > >
> > > I met a fatal error when building from source on local Mac OSX. It
> > > could reproduce stably.
> > > Not sure if it is related to my local environment. Try to dig it, but
> not
> > > any conclusion right now.
> > > Will feedback once find reasons.
> > >
> > > Appendix system environment, some more stack information refer to the
> > > attachment please.
> > > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > > load average:13.99 12.30 8.96
> > >
> > > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> > >
> > > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64
> JRE
> > > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> > 4.2.1
> > > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> > >
> > > mvn version: Apache Maven 3.6.0
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > >
> > > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <
> taklwu@apache.org
> > >
> > > wrote:
> > >
> > >> +1 (non-binding), and thanks a lot for driving the vote.
> > >>
> > >> * Signature of sources and binaries: ok
> > >> * Checksum of sources and binaries: ok
> > >> * Rat check (1.8.0_362): okie
> > >> - mvn clean apache-rat:check
> > >> * Built from source (1.8.0_362): ok
> > >> - mvn clean install -DskipTests
> > >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> > >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> > >> * Run MR examples applications and check the result (1.8.0_362): ok
> > >> - bin/hadoop jar
> > >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> > >> output 'dfs[a-z.]+'
> > >>
> > >> -Stephen
> > >>
> > >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> > >> iwasakims@oss.nttdata.com>
> > >> wrote:
> > >>
> > >> > +1
> > >> >
> > >> > + verified the signature and checksum of the source tarball.
> > >> > + built from the source tarball on Rocky Linux 8 (x86_64) and
> OpenJDK
> > 8
> > >> > with native profile enabled.
> > >> > + launched pseudo distributed cluster including kms and httpfs
> with
> > >> > Kerberos and SSL enabled.
> > >> > + created encryption zone, put and read files via httpfs.
> > >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on
> Rocky
> > >> > Linux 8 (x86_64).
> > >> > + built HBase and Hive against Hadoop 3.3.6.
> > >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > >> > + skimmed the contents of site documentation.
> > >> >
> > >> > Thanks,
> > >> > Masatake Iwasaki
> > >> >
> > >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > >> > > Bumping this thread to the top.
> > >> > > If you are verifying the release, please vote on this thread. RC0
> > and
> > >> RC1
> > >> > > are exactly the same. The only material difference is the
> Changelog.
> > >> > >
> > >> > > Thanks!!
> > >> > >
> > >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <
> weichiu@apache.org
> > >
> > >> > wrote:
> > >> > >
> > >> > >> I am inviting anyone to try and vote on this release candidate.
> > >> > >>
> > >> > >> Note:
> > >> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >> > >>
> > >> > >> The RC is available at:
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> > amd64)
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> > arm64)
> > >> > >>
> > >> > >> Git tag: release-3.3.6-RC1
> > >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >> > >>
> > >> > >> Maven artifacts is built by x86 machine and are staged at
> > >> > >>
> > >> >
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >> > >>
> > >> > >> My public key:
> > >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >> > >>
> > >> > >> Changelog:
> > >> > >>
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >> > >>
> > >> > >> Release notes:
> > >> > >>
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >> > >>
> > >> > >> This is a relatively small release (by Hadoop standard)
> containing
> > >> about
> > >> > >> 120 commits.
> > >> > >> Please give it a try, this RC vote will run for 7 days.
> > >> > >>
> > >> > >>
> > >> > >> Feature highlights:
> > >> > >>
> > >> > >> SBOM artifacts
> > >> > >> ----------------------------------------
> > >> > >> Starting from this release, Hadoop publishes Software Bill of
> > >> Materials
> > >> > >> (SBOM) using
> > >> > >> CycloneDX Maven plugin. For more information about SBOM, please
> go
> > to
> > >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >> > >>
> > >> > >> HDFS RBF: RDBMS based token storage support
> > >> > >> ----------------------------------------
> > >> > >> HDFS Router-Router Based Federation now supports storing
> delegation
> > >> > tokens
> > >> > >> on MySQL,
> > >> > >> [HADOOP-18535](
> https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> > >> which improves token operation through over the original
> > >> Zookeeper-based
> > >> > >> implementation.
> > >> > >>
> > >> > >>
> > >> > >> New File System APIs
> > >> > >> ----------------------------------------
> > >> > >> [HADOOP-18671](
> https://issues.apache.org/jira/browse/HADOOP-18671)
> > >> > moved
> > >> > >> a number of
> > >> > >> HDFS-specific APIs to Hadoop Common to make it possible for
> certain
> > >> > >> applications that
> > >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> > >> systems.
> > >> > >>
> > >> > >> In particular, recoverLease() and isFileClosed() are exposed
> > through
> > >> > >> LeaseRecoverable
> > >> > >> interface. While setSafeMode() is exposed through SafeMode
> > interface.
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >
> > >> >
> > >> >
> ---------------------------------------------------------------------
> > >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >> >
> > >> >
> > >>
> > >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
Hi Wei-Chiu,
Thanks for driving the release.
+1 (binding)
Verified checksum and signature.
Built from source successfully.
Ran aws Itests
Ran azure Itests
Compiled hadoop-api-shim
Compiled google cloud storage.
I see two two test failures in GCS connector as seen by you. Created issue.
https://github.com/GoogleCloudDataproc/hadoop-connectors/issues/1014
On Wed, Jun 21, 2023 at 12:55 PM Wei-Chiu Chuang
<we...@cloudera.com.invalid> wrote:
> I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
> No issue for me.
>
> On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
>
> > Addendum:
> > A. Build the release from sources using: `mvn clean install package
> > -DskipTests=true -Dmaven.javadoc.skip=true`
> > B. It works well when using the same command to build from the
> > source branch trunk.
> >
> > On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > Hi,
> > >
> > > I met a fatal error when building from source on local Mac OSX. It
> > > could reproduce stably.
> > > Not sure if it is related to my local environment. Try to dig it, but
> not
> > > any conclusion right now.
> > > Will feedback once find reasons.
> > >
> > > Appendix system environment, some more stack information refer to the
> > > attachment please.
> > > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > > load average:13.99 12.30 8.96
> > >
> > > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> > >
> > > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64
> JRE
> > > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> > 4.2.1
> > > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> > >
> > > mvn version: Apache Maven 3.6.0
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > >
> > > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <
> taklwu@apache.org
> > >
> > > wrote:
> > >
> > >> +1 (non-binding), and thanks a lot for driving the vote.
> > >>
> > >> * Signature of sources and binaries: ok
> > >> * Checksum of sources and binaries: ok
> > >> * Rat check (1.8.0_362): okie
> > >> - mvn clean apache-rat:check
> > >> * Built from source (1.8.0_362): ok
> > >> - mvn clean install -DskipTests
> > >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> > >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> > >> * Run MR examples applications and check the result (1.8.0_362): ok
> > >> - bin/hadoop jar
> > >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> > >> output 'dfs[a-z.]+'
> > >>
> > >> -Stephen
> > >>
> > >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> > >> iwasakims@oss.nttdata.com>
> > >> wrote:
> > >>
> > >> > +1
> > >> >
> > >> > + verified the signature and checksum of the source tarball.
> > >> > + built from the source tarball on Rocky Linux 8 (x86_64) and
> OpenJDK
> > 8
> > >> > with native profile enabled.
> > >> > + launched pseudo distributed cluster including kms and httpfs
> with
> > >> > Kerberos and SSL enabled.
> > >> > + created encryption zone, put and read files via httpfs.
> > >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on
> Rocky
> > >> > Linux 8 (x86_64).
> > >> > + built HBase and Hive against Hadoop 3.3.6.
> > >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > >> > + skimmed the contents of site documentation.
> > >> >
> > >> > Thanks,
> > >> > Masatake Iwasaki
> > >> >
> > >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > >> > > Bumping this thread to the top.
> > >> > > If you are verifying the release, please vote on this thread. RC0
> > and
> > >> RC1
> > >> > > are exactly the same. The only material difference is the
> Changelog.
> > >> > >
> > >> > > Thanks!!
> > >> > >
> > >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <
> weichiu@apache.org
> > >
> > >> > wrote:
> > >> > >
> > >> > >> I am inviting anyone to try and vote on this release candidate.
> > >> > >>
> > >> > >> Note:
> > >> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >> > >>
> > >> > >> The RC is available at:
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> > amd64)
> > >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> > arm64)
> > >> > >>
> > >> > >> Git tag: release-3.3.6-RC1
> > >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >> > >>
> > >> > >> Maven artifacts is built by x86 machine and are staged at
> > >> > >>
> > >> >
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >> > >>
> > >> > >> My public key:
> > >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >> > >>
> > >> > >> Changelog:
> > >> > >>
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >> > >>
> > >> > >> Release notes:
> > >> > >>
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >> > >>
> > >> > >> This is a relatively small release (by Hadoop standard)
> containing
> > >> about
> > >> > >> 120 commits.
> > >> > >> Please give it a try, this RC vote will run for 7 days.
> > >> > >>
> > >> > >>
> > >> > >> Feature highlights:
> > >> > >>
> > >> > >> SBOM artifacts
> > >> > >> ----------------------------------------
> > >> > >> Starting from this release, Hadoop publishes Software Bill of
> > >> Materials
> > >> > >> (SBOM) using
> > >> > >> CycloneDX Maven plugin. For more information about SBOM, please
> go
> > to
> > >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >> > >>
> > >> > >> HDFS RBF: RDBMS based token storage support
> > >> > >> ----------------------------------------
> > >> > >> HDFS Router-Router Based Federation now supports storing
> delegation
> > >> > tokens
> > >> > >> on MySQL,
> > >> > >> [HADOOP-18535](
> https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> > >> which improves token operation through over the original
> > >> Zookeeper-based
> > >> > >> implementation.
> > >> > >>
> > >> > >>
> > >> > >> New File System APIs
> > >> > >> ----------------------------------------
> > >> > >> [HADOOP-18671](
> https://issues.apache.org/jira/browse/HADOOP-18671)
> > >> > moved
> > >> > >> a number of
> > >> > >> HDFS-specific APIs to Hadoop Common to make it possible for
> certain
> > >> > >> applications that
> > >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> > >> systems.
> > >> > >>
> > >> > >> In particular, recoverLease() and isFileClosed() are exposed
> > through
> > >> > >> LeaseRecoverable
> > >> > >> interface. While setSafeMode() is exposed through SafeMode
> > interface.
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >
> > >> >
> > >> >
> ---------------------------------------------------------------------
> > >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> > >> >
> > >> >
> > >>
> > >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
No issue for me.
On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
> Addendum:
> A. Build the release from sources using: `mvn clean install package
> -DskipTests=true -Dmaven.javadoc.skip=true`
> B. It works well when using the same command to build from the
> source branch trunk.
>
> On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
>
> > Hi,
> >
> > I met a fatal error when building from source on local Mac OSX. It
> > could reproduce stably.
> > Not sure if it is related to my local environment. Try to dig it, but not
> > any conclusion right now.
> > Will feedback once find reasons.
> >
> > Appendix system environment, some more stack information refer to the
> > attachment please.
> > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > load average:13.99 12.30 8.96
> >
> > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> >
> > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> 4.2.1
> > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> >
> > mvn version: Apache Maven 3.6.0
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> >
> > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <taklwu@apache.org
> >
> > wrote:
> >
> >> +1 (non-binding), and thanks a lot for driving the vote.
> >>
> >> * Signature of sources and binaries: ok
> >> * Checksum of sources and binaries: ok
> >> * Rat check (1.8.0_362): okie
> >> - mvn clean apache-rat:check
> >> * Built from source (1.8.0_362): ok
> >> - mvn clean install -DskipTests
> >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> >> * Run MR examples applications and check the result (1.8.0_362): ok
> >> - bin/hadoop jar
> >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> >> output 'dfs[a-z.]+'
> >>
> >> -Stephen
> >>
> >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.com>
> >> wrote:
> >>
> >> > +1
> >> >
> >> > + verified the signature and checksum of the source tarball.
> >> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK
> 8
> >> > with native profile enabled.
> >> > + launched pseudo distributed cluster including kms and httpfs with
> >> > Kerberos and SSL enabled.
> >> > + created encryption zone, put and read files via httpfs.
> >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> >> > Linux 8 (x86_64).
> >> > + built HBase and Hive against Hadoop 3.3.6.
> >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> >> > + skimmed the contents of site documentation.
> >> >
> >> > Thanks,
> >> > Masatake Iwasaki
> >> >
> >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> >> > > Bumping this thread to the top.
> >> > > If you are verifying the release, please vote on this thread. RC0
> and
> >> RC1
> >> > > are exactly the same. The only material difference is the Changelog.
> >> > >
> >> > > Thanks!!
> >> > >
> >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <weichiu@apache.org
> >
> >> > wrote:
> >> > >
> >> > >> I am inviting anyone to try and vote on this release candidate.
> >> > >>
> >> > >> Note:
> >> > >> This is exactly the same as RC0, except the CHANGELOG.
> >> > >>
> >> > >> The RC is available at:
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> amd64)
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> arm64)
> >> > >>
> >> > >> Git tag: release-3.3.6-RC1
> >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >> > >>
> >> > >> Maven artifacts is built by x86 machine and are staged at
> >> > >>
> >> >
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >> > >>
> >> > >> My public key:
> >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >> > >>
> >> > >> Changelog:
> >> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >> > >>
> >> > >> Release notes:
> >> > >>
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >> > >>
> >> > >> This is a relatively small release (by Hadoop standard) containing
> >> about
> >> > >> 120 commits.
> >> > >> Please give it a try, this RC vote will run for 7 days.
> >> > >>
> >> > >>
> >> > >> Feature highlights:
> >> > >>
> >> > >> SBOM artifacts
> >> > >> ----------------------------------------
> >> > >> Starting from this release, Hadoop publishes Software Bill of
> >> Materials
> >> > >> (SBOM) using
> >> > >> CycloneDX Maven plugin. For more information about SBOM, please go
> to
> >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >> > >>
> >> > >> HDFS RBF: RDBMS based token storage support
> >> > >> ----------------------------------------
> >> > >> HDFS Router-Router Based Federation now supports storing delegation
> >> > tokens
> >> > >> on MySQL,
> >> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> > >> which improves token operation through over the original
> >> Zookeeper-based
> >> > >> implementation.
> >> > >>
> >> > >>
> >> > >> New File System APIs
> >> > >> ----------------------------------------
> >> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> >> > moved
> >> > >> a number of
> >> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> > >> applications that
> >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> >> systems.
> >> > >>
> >> > >> In particular, recoverLease() and isFileClosed() are exposed
> through
> >> > >> LeaseRecoverable
> >> > >> interface. While setSafeMode() is exposed through SafeMode
> interface.
> >> > >>
> >> > >>
> >> > >>
> >> > >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
No issue for me.
On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
> Addendum:
> A. Build the release from sources using: `mvn clean install package
> -DskipTests=true -Dmaven.javadoc.skip=true`
> B. It works well when using the same command to build from the
> source branch trunk.
>
> On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
>
> > Hi,
> >
> > I met a fatal error when building from source on local Mac OSX. It
> > could reproduce stably.
> > Not sure if it is related to my local environment. Try to dig it, but not
> > any conclusion right now.
> > Will feedback once find reasons.
> >
> > Appendix system environment, some more stack information refer to the
> > attachment please.
> > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > load average:13.99 12.30 8.96
> >
> > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> >
> > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> 4.2.1
> > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> >
> > mvn version: Apache Maven 3.6.0
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> >
> > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <taklwu@apache.org
> >
> > wrote:
> >
> >> +1 (non-binding), and thanks a lot for driving the vote.
> >>
> >> * Signature of sources and binaries: ok
> >> * Checksum of sources and binaries: ok
> >> * Rat check (1.8.0_362): okie
> >> - mvn clean apache-rat:check
> >> * Built from source (1.8.0_362): ok
> >> - mvn clean install -DskipTests
> >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> >> * Run MR examples applications and check the result (1.8.0_362): ok
> >> - bin/hadoop jar
> >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> >> output 'dfs[a-z.]+'
> >>
> >> -Stephen
> >>
> >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.com>
> >> wrote:
> >>
> >> > +1
> >> >
> >> > + verified the signature and checksum of the source tarball.
> >> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK
> 8
> >> > with native profile enabled.
> >> > + launched pseudo distributed cluster including kms and httpfs with
> >> > Kerberos and SSL enabled.
> >> > + created encryption zone, put and read files via httpfs.
> >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> >> > Linux 8 (x86_64).
> >> > + built HBase and Hive against Hadoop 3.3.6.
> >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> >> > + skimmed the contents of site documentation.
> >> >
> >> > Thanks,
> >> > Masatake Iwasaki
> >> >
> >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> >> > > Bumping this thread to the top.
> >> > > If you are verifying the release, please vote on this thread. RC0
> and
> >> RC1
> >> > > are exactly the same. The only material difference is the Changelog.
> >> > >
> >> > > Thanks!!
> >> > >
> >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <weichiu@apache.org
> >
> >> > wrote:
> >> > >
> >> > >> I am inviting anyone to try and vote on this release candidate.
> >> > >>
> >> > >> Note:
> >> > >> This is exactly the same as RC0, except the CHANGELOG.
> >> > >>
> >> > >> The RC is available at:
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> amd64)
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> arm64)
> >> > >>
> >> > >> Git tag: release-3.3.6-RC1
> >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >> > >>
> >> > >> Maven artifacts is built by x86 machine and are staged at
> >> > >>
> >> >
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >> > >>
> >> > >> My public key:
> >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >> > >>
> >> > >> Changelog:
> >> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >> > >>
> >> > >> Release notes:
> >> > >>
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >> > >>
> >> > >> This is a relatively small release (by Hadoop standard) containing
> >> about
> >> > >> 120 commits.
> >> > >> Please give it a try, this RC vote will run for 7 days.
> >> > >>
> >> > >>
> >> > >> Feature highlights:
> >> > >>
> >> > >> SBOM artifacts
> >> > >> ----------------------------------------
> >> > >> Starting from this release, Hadoop publishes Software Bill of
> >> Materials
> >> > >> (SBOM) using
> >> > >> CycloneDX Maven plugin. For more information about SBOM, please go
> to
> >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >> > >>
> >> > >> HDFS RBF: RDBMS based token storage support
> >> > >> ----------------------------------------
> >> > >> HDFS Router-Router Based Federation now supports storing delegation
> >> > tokens
> >> > >> on MySQL,
> >> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> > >> which improves token operation through over the original
> >> Zookeeper-based
> >> > >> implementation.
> >> > >>
> >> > >>
> >> > >> New File System APIs
> >> > >> ----------------------------------------
> >> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> >> > moved
> >> > >> a number of
> >> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> > >> applications that
> >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> >> systems.
> >> > >>
> >> > >> In particular, recoverLease() and isFileClosed() are exposed
> through
> >> > >> LeaseRecoverable
> >> > >> interface. While setSafeMode() is exposed through SafeMode
> interface.
> >> > >>
> >> > >>
> >> > >>
> >> > >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
No issue for me.
On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
> Addendum:
> A. Build the release from sources using: `mvn clean install package
> -DskipTests=true -Dmaven.javadoc.skip=true`
> B. It works well when using the same command to build from the
> source branch trunk.
>
> On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
>
> > Hi,
> >
> > I met a fatal error when building from source on local Mac OSX. It
> > could reproduce stably.
> > Not sure if it is related to my local environment. Try to dig it, but not
> > any conclusion right now.
> > Will feedback once find reasons.
> >
> > Appendix system environment, some more stack information refer to the
> > attachment please.
> > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > load average:13.99 12.30 8.96
> >
> > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> >
> > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> 4.2.1
> > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> >
> > mvn version: Apache Maven 3.6.0
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> >
> > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <taklwu@apache.org
> >
> > wrote:
> >
> >> +1 (non-binding), and thanks a lot for driving the vote.
> >>
> >> * Signature of sources and binaries: ok
> >> * Checksum of sources and binaries: ok
> >> * Rat check (1.8.0_362): okie
> >> - mvn clean apache-rat:check
> >> * Built from source (1.8.0_362): ok
> >> - mvn clean install -DskipTests
> >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> >> * Run MR examples applications and check the result (1.8.0_362): ok
> >> - bin/hadoop jar
> >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> >> output 'dfs[a-z.]+'
> >>
> >> -Stephen
> >>
> >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.com>
> >> wrote:
> >>
> >> > +1
> >> >
> >> > + verified the signature and checksum of the source tarball.
> >> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK
> 8
> >> > with native profile enabled.
> >> > + launched pseudo distributed cluster including kms and httpfs with
> >> > Kerberos and SSL enabled.
> >> > + created encryption zone, put and read files via httpfs.
> >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> >> > Linux 8 (x86_64).
> >> > + built HBase and Hive against Hadoop 3.3.6.
> >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> >> > + skimmed the contents of site documentation.
> >> >
> >> > Thanks,
> >> > Masatake Iwasaki
> >> >
> >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> >> > > Bumping this thread to the top.
> >> > > If you are verifying the release, please vote on this thread. RC0
> and
> >> RC1
> >> > > are exactly the same. The only material difference is the Changelog.
> >> > >
> >> > > Thanks!!
> >> > >
> >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <weichiu@apache.org
> >
> >> > wrote:
> >> > >
> >> > >> I am inviting anyone to try and vote on this release candidate.
> >> > >>
> >> > >> Note:
> >> > >> This is exactly the same as RC0, except the CHANGELOG.
> >> > >>
> >> > >> The RC is available at:
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> amd64)
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> arm64)
> >> > >>
> >> > >> Git tag: release-3.3.6-RC1
> >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >> > >>
> >> > >> Maven artifacts is built by x86 machine and are staged at
> >> > >>
> >> >
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >> > >>
> >> > >> My public key:
> >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >> > >>
> >> > >> Changelog:
> >> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >> > >>
> >> > >> Release notes:
> >> > >>
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >> > >>
> >> > >> This is a relatively small release (by Hadoop standard) containing
> >> about
> >> > >> 120 commits.
> >> > >> Please give it a try, this RC vote will run for 7 days.
> >> > >>
> >> > >>
> >> > >> Feature highlights:
> >> > >>
> >> > >> SBOM artifacts
> >> > >> ----------------------------------------
> >> > >> Starting from this release, Hadoop publishes Software Bill of
> >> Materials
> >> > >> (SBOM) using
> >> > >> CycloneDX Maven plugin. For more information about SBOM, please go
> to
> >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >> > >>
> >> > >> HDFS RBF: RDBMS based token storage support
> >> > >> ----------------------------------------
> >> > >> HDFS Router-Router Based Federation now supports storing delegation
> >> > tokens
> >> > >> on MySQL,
> >> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> > >> which improves token operation through over the original
> >> Zookeeper-based
> >> > >> implementation.
> >> > >>
> >> > >>
> >> > >> New File System APIs
> >> > >> ----------------------------------------
> >> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> >> > moved
> >> > >> a number of
> >> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> > >> applications that
> >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> >> systems.
> >> > >>
> >> > >> In particular, recoverLease() and isFileClosed() are exposed
> through
> >> > >> LeaseRecoverable
> >> > >> interface. While setSafeMode() is exposed through SafeMode
> interface.
> >> > >>
> >> > >>
> >> > >>
> >> > >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
I am using Maven 3.6.3 on Mac (x86), JDK 1.8.0_341
No issue for me.
On Wed, Jun 21, 2023 at 5:48 AM Xiaoqiao He <he...@apache.org> wrote:
> Addendum:
> A. Build the release from sources using: `mvn clean install package
> -DskipTests=true -Dmaven.javadoc.skip=true`
> B. It works well when using the same command to build from the
> source branch trunk.
>
> On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
>
> > Hi,
> >
> > I met a fatal error when building from source on local Mac OSX. It
> > could reproduce stably.
> > Not sure if it is related to my local environment. Try to dig it, but not
> > any conclusion right now.
> > Will feedback once find reasons.
> >
> > Appendix system environment, some more stack information refer to the
> > attachment please.
> > OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> > 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> > rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> > load average:13.99 12.30 8.96
> >
> > CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> > family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> > ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> > lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
> >
> > vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> > (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc
> 4.2.1
> > (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
> >
> > mvn version: Apache Maven 3.6.0
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> >
> > On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <taklwu@apache.org
> >
> > wrote:
> >
> >> +1 (non-binding), and thanks a lot for driving the vote.
> >>
> >> * Signature of sources and binaries: ok
> >> * Checksum of sources and binaries: ok
> >> * Rat check (1.8.0_362): okie
> >> - mvn clean apache-rat:check
> >> * Built from source (1.8.0_362): ok
> >> - mvn clean install -DskipTests
> >> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> >> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> >> * Run MR examples applications and check the result (1.8.0_362): ok
> >> - bin/hadoop jar
> >> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> >> output 'dfs[a-z.]+'
> >>
> >> -Stephen
> >>
> >> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.com>
> >> wrote:
> >>
> >> > +1
> >> >
> >> > + verified the signature and checksum of the source tarball.
> >> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK
> 8
> >> > with native profile enabled.
> >> > + launched pseudo distributed cluster including kms and httpfs with
> >> > Kerberos and SSL enabled.
> >> > + created encryption zone, put and read files via httpfs.
> >> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> >> > Linux 8 (x86_64).
> >> > + built HBase and Hive against Hadoop 3.3.6.
> >> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> >> > + skimmed the contents of site documentation.
> >> >
> >> > Thanks,
> >> > Masatake Iwasaki
> >> >
> >> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> >> > > Bumping this thread to the top.
> >> > > If you are verifying the release, please vote on this thread. RC0
> and
> >> RC1
> >> > > are exactly the same. The only material difference is the Changelog.
> >> > >
> >> > > Thanks!!
> >> > >
> >> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <weichiu@apache.org
> >
> >> > wrote:
> >> > >
> >> > >> I am inviting anyone to try and vote on this release candidate.
> >> > >>
> >> > >> Note:
> >> > >> This is exactly the same as RC0, except the CHANGELOG.
> >> > >>
> >> > >> The RC is available at:
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
> amd64)
> >> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
> arm64)
> >> > >>
> >> > >> Git tag: release-3.3.6-RC1
> >> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >> > >>
> >> > >> Maven artifacts is built by x86 machine and are staged at
> >> > >>
> >> >
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >> > >>
> >> > >> My public key:
> >> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >> > >>
> >> > >> Changelog:
> >> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >> > >>
> >> > >> Release notes:
> >> > >>
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >> > >>
> >> > >> This is a relatively small release (by Hadoop standard) containing
> >> about
> >> > >> 120 commits.
> >> > >> Please give it a try, this RC vote will run for 7 days.
> >> > >>
> >> > >>
> >> > >> Feature highlights:
> >> > >>
> >> > >> SBOM artifacts
> >> > >> ----------------------------------------
> >> > >> Starting from this release, Hadoop publishes Software Bill of
> >> Materials
> >> > >> (SBOM) using
> >> > >> CycloneDX Maven plugin. For more information about SBOM, please go
> to
> >> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >> > >>
> >> > >> HDFS RBF: RDBMS based token storage support
> >> > >> ----------------------------------------
> >> > >> HDFS Router-Router Based Federation now supports storing delegation
> >> > tokens
> >> > >> on MySQL,
> >> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> > >> which improves token operation through over the original
> >> Zookeeper-based
> >> > >> implementation.
> >> > >>
> >> > >>
> >> > >> New File System APIs
> >> > >> ----------------------------------------
> >> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> >> > moved
> >> > >> a number of
> >> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> > >> applications that
> >> > >> depend on HDFS semantics to run on other Hadoop compatible file
> >> systems.
> >> > >>
> >> > >> In particular, recoverLease() and isFileClosed() are exposed
> through
> >> > >> LeaseRecoverable
> >> > >> interface. While setSafeMode() is exposed through SafeMode
> interface.
> >> > >>
> >> > >>
> >> > >>
> >> > >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Addendum:
A. Build the release from sources using: `mvn clean install package
-DskipTests=true -Dmaven.javadoc.skip=true`
B. It works well when using the same command to build from the
source branch trunk.
On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
> Hi,
>
> I met a fatal error when building from source on local Mac OSX. It
> could reproduce stably.
> Not sure if it is related to my local environment. Try to dig it, but not
> any conclusion right now.
> Will feedback once find reasons.
>
> Appendix system environment, some more stack information refer to the
> attachment please.
> OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> load average:13.99 12.30 8.96
>
> CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
>
> vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
> (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
>
> mvn version: Apache Maven 3.6.0
>
> Best Regards,
> - He Xiaoqiao
>
>
> On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
> wrote:
>
>> +1 (non-binding), and thanks a lot for driving the vote.
>>
>> * Signature of sources and binaries: ok
>> * Checksum of sources and binaries: ok
>> * Rat check (1.8.0_362): okie
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_362): ok
>> - mvn clean install -DskipTests
>> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
>> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
>> * Run MR examples applications and check the result (1.8.0_362): ok
>> - bin/hadoop jar
>> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
>> output 'dfs[a-z.]+'
>>
>> -Stephen
>>
>> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.com>
>> wrote:
>>
>> > +1
>> >
>> > + verified the signature and checksum of the source tarball.
>> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
>> > with native profile enabled.
>> > + launched pseudo distributed cluster including kms and httpfs with
>> > Kerberos and SSL enabled.
>> > + created encryption zone, put and read files via httpfs.
>> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
>> > Linux 8 (x86_64).
>> > + built HBase and Hive against Hadoop 3.3.6.
>> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
>> > + skimmed the contents of site documentation.
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
>> > > Bumping this thread to the top.
>> > > If you are verifying the release, please vote on this thread. RC0 and
>> RC1
>> > > are exactly the same. The only material difference is the Changelog.
>> > >
>> > > Thanks!!
>> > >
>> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
>> > wrote:
>> > >
>> > >> I am inviting anyone to try and vote on this release candidate.
>> > >>
>> > >> Note:
>> > >> This is exactly the same as RC0, except the CHANGELOG.
>> > >>
>> > >> The RC is available at:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>> > >>
>> > >> Git tag: release-3.3.6-RC1
>> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > >>
>> > >> Maven artifacts is built by x86 machine and are staged at
>> > >>
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > >>
>> > >> My public key:
>> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > >>
>> > >> Changelog:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > >>
>> > >> Release notes:
>> > >>
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > >>
>> > >> This is a relatively small release (by Hadoop standard) containing
>> about
>> > >> 120 commits.
>> > >> Please give it a try, this RC vote will run for 7 days.
>> > >>
>> > >>
>> > >> Feature highlights:
>> > >>
>> > >> SBOM artifacts
>> > >> ----------------------------------------
>> > >> Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > >> (SBOM) using
>> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
>> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > >>
>> > >> HDFS RBF: RDBMS based token storage support
>> > >> ----------------------------------------
>> > >> HDFS Router-Router Based Federation now supports storing delegation
>> > tokens
>> > >> on MySQL,
>> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > >> which improves token operation through over the original
>> Zookeeper-based
>> > >> implementation.
>> > >>
>> > >>
>> > >> New File System APIs
>> > >> ----------------------------------------
>> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > moved
>> > >> a number of
>> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > >> applications that
>> > >> depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > >>
>> > >> In particular, recoverLease() and isFileClosed() are exposed through
>> > >> LeaseRecoverable
>> > >> interface. While setSafeMode() is exposed through SafeMode interface.
>> > >>
>> > >>
>> > >>
>> > >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Addendum:
A. Build the release from sources using: `mvn clean install package
-DskipTests=true -Dmaven.javadoc.skip=true`
B. It works well when using the same command to build from the
source branch trunk.
On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
> Hi,
>
> I met a fatal error when building from source on local Mac OSX. It
> could reproduce stably.
> Not sure if it is related to my local environment. Try to dig it, but not
> any conclusion right now.
> Will feedback once find reasons.
>
> Appendix system environment, some more stack information refer to the
> attachment please.
> OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> load average:13.99 12.30 8.96
>
> CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
>
> vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
> (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
>
> mvn version: Apache Maven 3.6.0
>
> Best Regards,
> - He Xiaoqiao
>
>
> On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
> wrote:
>
>> +1 (non-binding), and thanks a lot for driving the vote.
>>
>> * Signature of sources and binaries: ok
>> * Checksum of sources and binaries: ok
>> * Rat check (1.8.0_362): okie
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_362): ok
>> - mvn clean install -DskipTests
>> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
>> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
>> * Run MR examples applications and check the result (1.8.0_362): ok
>> - bin/hadoop jar
>> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
>> output 'dfs[a-z.]+'
>>
>> -Stephen
>>
>> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.com>
>> wrote:
>>
>> > +1
>> >
>> > + verified the signature and checksum of the source tarball.
>> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
>> > with native profile enabled.
>> > + launched pseudo distributed cluster including kms and httpfs with
>> > Kerberos and SSL enabled.
>> > + created encryption zone, put and read files via httpfs.
>> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
>> > Linux 8 (x86_64).
>> > + built HBase and Hive against Hadoop 3.3.6.
>> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
>> > + skimmed the contents of site documentation.
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
>> > > Bumping this thread to the top.
>> > > If you are verifying the release, please vote on this thread. RC0 and
>> RC1
>> > > are exactly the same. The only material difference is the Changelog.
>> > >
>> > > Thanks!!
>> > >
>> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
>> > wrote:
>> > >
>> > >> I am inviting anyone to try and vote on this release candidate.
>> > >>
>> > >> Note:
>> > >> This is exactly the same as RC0, except the CHANGELOG.
>> > >>
>> > >> The RC is available at:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>> > >>
>> > >> Git tag: release-3.3.6-RC1
>> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > >>
>> > >> Maven artifacts is built by x86 machine and are staged at
>> > >>
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > >>
>> > >> My public key:
>> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > >>
>> > >> Changelog:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > >>
>> > >> Release notes:
>> > >>
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > >>
>> > >> This is a relatively small release (by Hadoop standard) containing
>> about
>> > >> 120 commits.
>> > >> Please give it a try, this RC vote will run for 7 days.
>> > >>
>> > >>
>> > >> Feature highlights:
>> > >>
>> > >> SBOM artifacts
>> > >> ----------------------------------------
>> > >> Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > >> (SBOM) using
>> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
>> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > >>
>> > >> HDFS RBF: RDBMS based token storage support
>> > >> ----------------------------------------
>> > >> HDFS Router-Router Based Federation now supports storing delegation
>> > tokens
>> > >> on MySQL,
>> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > >> which improves token operation through over the original
>> Zookeeper-based
>> > >> implementation.
>> > >>
>> > >>
>> > >> New File System APIs
>> > >> ----------------------------------------
>> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > moved
>> > >> a number of
>> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > >> applications that
>> > >> depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > >>
>> > >> In particular, recoverLease() and isFileClosed() are exposed through
>> > >> LeaseRecoverable
>> > >> interface. While setSafeMode() is exposed through SafeMode interface.
>> > >>
>> > >>
>> > >>
>> > >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Addendum:
A. Build the release from sources using: `mvn clean install package
-DskipTests=true -Dmaven.javadoc.skip=true`
B. It works well when using the same command to build from the
source branch trunk.
On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
> Hi,
>
> I met a fatal error when building from source on local Mac OSX. It
> could reproduce stably.
> Not sure if it is related to my local environment. Try to dig it, but not
> any conclusion right now.
> Will feedback once find reasons.
>
> Appendix system environment, some more stack information refer to the
> attachment please.
> OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> load average:13.99 12.30 8.96
>
> CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
>
> vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
> (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
>
> mvn version: Apache Maven 3.6.0
>
> Best Regards,
> - He Xiaoqiao
>
>
> On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
> wrote:
>
>> +1 (non-binding), and thanks a lot for driving the vote.
>>
>> * Signature of sources and binaries: ok
>> * Checksum of sources and binaries: ok
>> * Rat check (1.8.0_362): okie
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_362): ok
>> - mvn clean install -DskipTests
>> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
>> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
>> * Run MR examples applications and check the result (1.8.0_362): ok
>> - bin/hadoop jar
>> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
>> output 'dfs[a-z.]+'
>>
>> -Stephen
>>
>> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.com>
>> wrote:
>>
>> > +1
>> >
>> > + verified the signature and checksum of the source tarball.
>> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
>> > with native profile enabled.
>> > + launched pseudo distributed cluster including kms and httpfs with
>> > Kerberos and SSL enabled.
>> > + created encryption zone, put and read files via httpfs.
>> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
>> > Linux 8 (x86_64).
>> > + built HBase and Hive against Hadoop 3.3.6.
>> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
>> > + skimmed the contents of site documentation.
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
>> > > Bumping this thread to the top.
>> > > If you are verifying the release, please vote on this thread. RC0 and
>> RC1
>> > > are exactly the same. The only material difference is the Changelog.
>> > >
>> > > Thanks!!
>> > >
>> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
>> > wrote:
>> > >
>> > >> I am inviting anyone to try and vote on this release candidate.
>> > >>
>> > >> Note:
>> > >> This is exactly the same as RC0, except the CHANGELOG.
>> > >>
>> > >> The RC is available at:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>> > >>
>> > >> Git tag: release-3.3.6-RC1
>> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > >>
>> > >> Maven artifacts is built by x86 machine and are staged at
>> > >>
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > >>
>> > >> My public key:
>> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > >>
>> > >> Changelog:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > >>
>> > >> Release notes:
>> > >>
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > >>
>> > >> This is a relatively small release (by Hadoop standard) containing
>> about
>> > >> 120 commits.
>> > >> Please give it a try, this RC vote will run for 7 days.
>> > >>
>> > >>
>> > >> Feature highlights:
>> > >>
>> > >> SBOM artifacts
>> > >> ----------------------------------------
>> > >> Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > >> (SBOM) using
>> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
>> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > >>
>> > >> HDFS RBF: RDBMS based token storage support
>> > >> ----------------------------------------
>> > >> HDFS Router-Router Based Federation now supports storing delegation
>> > tokens
>> > >> on MySQL,
>> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > >> which improves token operation through over the original
>> Zookeeper-based
>> > >> implementation.
>> > >>
>> > >>
>> > >> New File System APIs
>> > >> ----------------------------------------
>> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > moved
>> > >> a number of
>> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > >> applications that
>> > >> depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > >>
>> > >> In particular, recoverLease() and isFileClosed() are exposed through
>> > >> LeaseRecoverable
>> > >> interface. While setSafeMode() is exposed through SafeMode interface.
>> > >>
>> > >>
>> > >>
>> > >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Addendum:
A. Build the release from sources using: `mvn clean install package
-DskipTests=true -Dmaven.javadoc.skip=true`
B. It works well when using the same command to build from the
source branch trunk.
On Wed, Jun 21, 2023 at 8:44 PM Xiaoqiao He <he...@apache.org> wrote:
> Hi,
>
> I met a fatal error when building from source on local Mac OSX. It
> could reproduce stably.
> Not sure if it is related to my local environment. Try to dig it, but not
> any conclusion right now.
> Will feedback once find reasons.
>
> Appendix system environment, some more stack information refer to the
> attachment please.
> OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28
> 20:28:54 PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
> rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
> load average:13.99 12.30 8.96
>
> CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
> family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
> ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
> lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
>
> vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
> (1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
> (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
>
> mvn version: Apache Maven 3.6.0
>
> Best Regards,
> - He Xiaoqiao
>
>
> On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
> wrote:
>
>> +1 (non-binding), and thanks a lot for driving the vote.
>>
>> * Signature of sources and binaries: ok
>> * Checksum of sources and binaries: ok
>> * Rat check (1.8.0_362): okie
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_362): ok
>> - mvn clean install -DskipTests
>> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
>> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
>> * Run MR examples applications and check the result (1.8.0_362): ok
>> - bin/hadoop jar
>> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
>> output 'dfs[a-z.]+'
>>
>> -Stephen
>>
>> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.com>
>> wrote:
>>
>> > +1
>> >
>> > + verified the signature and checksum of the source tarball.
>> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
>> > with native profile enabled.
>> > + launched pseudo distributed cluster including kms and httpfs with
>> > Kerberos and SSL enabled.
>> > + created encryption zone, put and read files via httpfs.
>> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
>> > Linux 8 (x86_64).
>> > + built HBase and Hive against Hadoop 3.3.6.
>> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
>> > + skimmed the contents of site documentation.
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
>> > > Bumping this thread to the top.
>> > > If you are verifying the release, please vote on this thread. RC0 and
>> RC1
>> > > are exactly the same. The only material difference is the Changelog.
>> > >
>> > > Thanks!!
>> > >
>> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
>> > wrote:
>> > >
>> > >> I am inviting anyone to try and vote on this release candidate.
>> > >>
>> > >> Note:
>> > >> This is exactly the same as RC0, except the CHANGELOG.
>> > >>
>> > >> The RC is available at:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>> > >>
>> > >> Git tag: release-3.3.6-RC1
>> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > >>
>> > >> Maven artifacts is built by x86 machine and are staged at
>> > >>
>> >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > >>
>> > >> My public key:
>> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > >>
>> > >> Changelog:
>> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > >>
>> > >> Release notes:
>> > >>
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > >>
>> > >> This is a relatively small release (by Hadoop standard) containing
>> about
>> > >> 120 commits.
>> > >> Please give it a try, this RC vote will run for 7 days.
>> > >>
>> > >>
>> > >> Feature highlights:
>> > >>
>> > >> SBOM artifacts
>> > >> ----------------------------------------
>> > >> Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > >> (SBOM) using
>> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
>> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > >>
>> > >> HDFS RBF: RDBMS based token storage support
>> > >> ----------------------------------------
>> > >> HDFS Router-Router Based Federation now supports storing delegation
>> > tokens
>> > >> on MySQL,
>> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > >> which improves token operation through over the original
>> Zookeeper-based
>> > >> implementation.
>> > >>
>> > >>
>> > >> New File System APIs
>> > >> ----------------------------------------
>> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > moved
>> > >> a number of
>> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > >> applications that
>> > >> depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > >>
>> > >> In particular, recoverLease() and isFileClosed() are exposed through
>> > >> LeaseRecoverable
>> > >> interface. While setSafeMode() is exposed through SafeMode interface.
>> > >>
>> > >>
>> > >>
>> > >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Hi,
I met a fatal error when building from source on local Mac OSX. It
could reproduce stably.
Not sure if it is related to my local environment. Try to dig it, but not
any conclusion right now.
Will feedback once find reasons.
Appendix system environment, some more stack information refer to the
attachment please.
OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28 20:28:54
PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
load average:13.99 12.30 8.96
CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
(1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
(Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
mvn version: Apache Maven 3.6.0
Best Regards,
- He Xiaoqiao
On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
wrote:
> +1 (non-binding), and thanks a lot for driving the vote.
>
> * Signature of sources and binaries: ok
> * Checksum of sources and binaries: ok
> * Rat check (1.8.0_362): okie
> - mvn clean apache-rat:check
> * Built from source (1.8.0_362): ok
> - mvn clean install -DskipTests
> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> * Run MR examples applications and check the result (1.8.0_362): ok
> - bin/hadoop jar
> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> output 'dfs[a-z.]+'
>
> -Stephen
>
> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.com>
> wrote:
>
> > +1
> >
> > + verified the signature and checksum of the source tarball.
> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> > with native profile enabled.
> > + launched pseudo distributed cluster including kms and httpfs with
> > Kerberos and SSL enabled.
> > + created encryption zone, put and read files via httpfs.
> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> > Linux 8 (x86_64).
> > + built HBase and Hive against Hadoop 3.3.6.
> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > + skimmed the contents of site documentation.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > > Bumping this thread to the top.
> > > If you are verifying the release, please vote on this thread. RC0 and
> RC1
> > > are exactly the same. The only material difference is the Changelog.
> > >
> > > Thanks!!
> > >
> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> > wrote:
> > >
> > >> I am inviting anyone to try and vote on this release candidate.
> > >>
> > >> Note:
> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >>
> > >> The RC is available at:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > >>
> > >> Git tag: release-3.3.6-RC1
> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >>
> > >> Maven artifacts is built by x86 machine and are staged at
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >>
> > >> My public key:
> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >>
> > >> Changelog:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >>
> > >> Release notes:
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >>
> > >> This is a relatively small release (by Hadoop standard) containing
> about
> > >> 120 commits.
> > >> Please give it a try, this RC vote will run for 7 days.
> > >>
> > >>
> > >> Feature highlights:
> > >>
> > >> SBOM artifacts
> > >> ----------------------------------------
> > >> Starting from this release, Hadoop publishes Software Bill of
> Materials
> > >> (SBOM) using
> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >>
> > >> HDFS RBF: RDBMS based token storage support
> > >> ----------------------------------------
> > >> HDFS Router-Router Based Federation now supports storing delegation
> > tokens
> > >> on MySQL,
> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> which improves token operation through over the original
> Zookeeper-based
> > >> implementation.
> > >>
> > >>
> > >> New File System APIs
> > >> ----------------------------------------
> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > moved
> > >> a number of
> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> > >> applications that
> > >> depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > >>
> > >> In particular, recoverLease() and isFileClosed() are exposed through
> > >> LeaseRecoverable
> > >> interface. While setSafeMode() is exposed through SafeMode interface.
> > >>
> > >>
> > >>
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Hi,
I met a fatal error when building from source on local Mac OSX. It
could reproduce stably.
Not sure if it is related to my local environment. Try to dig it, but not
any conclusion right now.
Will feedback once find reasons.
Appendix system environment, some more stack information refer to the
attachment please.
OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28 20:28:54
PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
load average:13.99 12.30 8.96
CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
(1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
(Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
mvn version: Apache Maven 3.6.0
Best Regards,
- He Xiaoqiao
On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
wrote:
> +1 (non-binding), and thanks a lot for driving the vote.
>
> * Signature of sources and binaries: ok
> * Checksum of sources and binaries: ok
> * Rat check (1.8.0_362): okie
> - mvn clean apache-rat:check
> * Built from source (1.8.0_362): ok
> - mvn clean install -DskipTests
> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> * Run MR examples applications and check the result (1.8.0_362): ok
> - bin/hadoop jar
> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> output 'dfs[a-z.]+'
>
> -Stephen
>
> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.com>
> wrote:
>
> > +1
> >
> > + verified the signature and checksum of the source tarball.
> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> > with native profile enabled.
> > + launched pseudo distributed cluster including kms and httpfs with
> > Kerberos and SSL enabled.
> > + created encryption zone, put and read files via httpfs.
> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> > Linux 8 (x86_64).
> > + built HBase and Hive against Hadoop 3.3.6.
> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > + skimmed the contents of site documentation.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > > Bumping this thread to the top.
> > > If you are verifying the release, please vote on this thread. RC0 and
> RC1
> > > are exactly the same. The only material difference is the Changelog.
> > >
> > > Thanks!!
> > >
> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> > wrote:
> > >
> > >> I am inviting anyone to try and vote on this release candidate.
> > >>
> > >> Note:
> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >>
> > >> The RC is available at:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > >>
> > >> Git tag: release-3.3.6-RC1
> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >>
> > >> Maven artifacts is built by x86 machine and are staged at
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >>
> > >> My public key:
> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >>
> > >> Changelog:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >>
> > >> Release notes:
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >>
> > >> This is a relatively small release (by Hadoop standard) containing
> about
> > >> 120 commits.
> > >> Please give it a try, this RC vote will run for 7 days.
> > >>
> > >>
> > >> Feature highlights:
> > >>
> > >> SBOM artifacts
> > >> ----------------------------------------
> > >> Starting from this release, Hadoop publishes Software Bill of
> Materials
> > >> (SBOM) using
> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >>
> > >> HDFS RBF: RDBMS based token storage support
> > >> ----------------------------------------
> > >> HDFS Router-Router Based Federation now supports storing delegation
> > tokens
> > >> on MySQL,
> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> which improves token operation through over the original
> Zookeeper-based
> > >> implementation.
> > >>
> > >>
> > >> New File System APIs
> > >> ----------------------------------------
> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > moved
> > >> a number of
> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> > >> applications that
> > >> depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > >>
> > >> In particular, recoverLease() and isFileClosed() are exposed through
> > >> LeaseRecoverable
> > >> interface. While setSafeMode() is exposed through SafeMode interface.
> > >>
> > >>
> > >>
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Hi,
I met a fatal error when building from source on local Mac OSX. It
could reproduce stably.
Not sure if it is related to my local environment. Try to dig it, but not
any conclusion right now.
Will feedback once find reasons.
Appendix system environment, some more stack information refer to the
attachment please.
OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28 20:28:54
PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
load average:13.99 12.30 8.96
CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
(1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
(Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
mvn version: Apache Maven 3.6.0
Best Regards,
- He Xiaoqiao
On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
wrote:
> +1 (non-binding), and thanks a lot for driving the vote.
>
> * Signature of sources and binaries: ok
> * Checksum of sources and binaries: ok
> * Rat check (1.8.0_362): okie
> - mvn clean apache-rat:check
> * Built from source (1.8.0_362): ok
> - mvn clean install -DskipTests
> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> * Run MR examples applications and check the result (1.8.0_362): ok
> - bin/hadoop jar
> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> output 'dfs[a-z.]+'
>
> -Stephen
>
> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.com>
> wrote:
>
> > +1
> >
> > + verified the signature and checksum of the source tarball.
> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> > with native profile enabled.
> > + launched pseudo distributed cluster including kms and httpfs with
> > Kerberos and SSL enabled.
> > + created encryption zone, put and read files via httpfs.
> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> > Linux 8 (x86_64).
> > + built HBase and Hive against Hadoop 3.3.6.
> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > + skimmed the contents of site documentation.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > > Bumping this thread to the top.
> > > If you are verifying the release, please vote on this thread. RC0 and
> RC1
> > > are exactly the same. The only material difference is the Changelog.
> > >
> > > Thanks!!
> > >
> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> > wrote:
> > >
> > >> I am inviting anyone to try and vote on this release candidate.
> > >>
> > >> Note:
> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >>
> > >> The RC is available at:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > >>
> > >> Git tag: release-3.3.6-RC1
> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >>
> > >> Maven artifacts is built by x86 machine and are staged at
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >>
> > >> My public key:
> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >>
> > >> Changelog:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >>
> > >> Release notes:
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >>
> > >> This is a relatively small release (by Hadoop standard) containing
> about
> > >> 120 commits.
> > >> Please give it a try, this RC vote will run for 7 days.
> > >>
> > >>
> > >> Feature highlights:
> > >>
> > >> SBOM artifacts
> > >> ----------------------------------------
> > >> Starting from this release, Hadoop publishes Software Bill of
> Materials
> > >> (SBOM) using
> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >>
> > >> HDFS RBF: RDBMS based token storage support
> > >> ----------------------------------------
> > >> HDFS Router-Router Based Federation now supports storing delegation
> > tokens
> > >> on MySQL,
> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> which improves token operation through over the original
> Zookeeper-based
> > >> implementation.
> > >>
> > >>
> > >> New File System APIs
> > >> ----------------------------------------
> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > moved
> > >> a number of
> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> > >> applications that
> > >> depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > >>
> > >> In particular, recoverLease() and isFileClosed() are exposed through
> > >> LeaseRecoverable
> > >> interface. While setSafeMode() is exposed through SafeMode interface.
> > >>
> > >>
> > >>
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
Hi,
I met a fatal error when building from source on local Mac OSX. It
could reproduce stably.
Not sure if it is related to my local environment. Try to dig it, but not
any conclusion right now.
Will feedback once find reasons.
Appendix system environment, some more stack information refer to the
attachment please.
OS:Bsduname:Darwin 21.2.0 Darwin Kernel Version 21.2.0: Sun Nov 28 20:28:54
PST 2021; root:xnu-8019.61.5~1/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 2784, NOFILE 10240, AS infinity
load average:13.99 12.30 8.96
CPU:total 12 (initial active 12) (6 cores per cpu, 2 threads per core)
family 6 model 158 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3,
ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref,
lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx
vm_info: Java HotSpot(TM) 64-Bit Server VM (25.202-b08) for bsd-amd64 JRE
(1.8.0_202-b08), built on Dec 15 2018 20:16:16 by "java_re" with gcc 4.2.1
(Based on Apple Inc. build 5658) (LLVM build 2336.11.00)
mvn version: Apache Maven 3.6.0
Best Regards,
- He Xiaoqiao
On Wed, Jun 21, 2023 at 10:09 AM Tak Lon (Stephen) Wu <ta...@apache.org>
wrote:
> +1 (non-binding), and thanks a lot for driving the vote.
>
> * Signature of sources and binaries: ok
> * Checksum of sources and binaries: ok
> * Rat check (1.8.0_362): okie
> - mvn clean apache-rat:check
> * Built from source (1.8.0_362): ok
> - mvn clean install -DskipTests
> * Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
> * Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
> * Run MR examples applications and check the result (1.8.0_362): ok
> - bin/hadoop jar
> share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
> output 'dfs[a-z.]+'
>
> -Stephen
>
> On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.com>
> wrote:
>
> > +1
> >
> > + verified the signature and checksum of the source tarball.
> > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> > with native profile enabled.
> > + launched pseudo distributed cluster including kms and httpfs with
> > Kerberos and SSL enabled.
> > + created encryption zone, put and read files via httpfs.
> > + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> > Linux 8 (x86_64).
> > + built HBase and Hive against Hadoop 3.3.6.
> > + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> > + skimmed the contents of site documentation.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > > Bumping this thread to the top.
> > > If you are verifying the release, please vote on this thread. RC0 and
> RC1
> > > are exactly the same. The only material difference is the Changelog.
> > >
> > > Thanks!!
> > >
> > > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> > wrote:
> > >
> > >> I am inviting anyone to try and vote on this release candidate.
> > >>
> > >> Note:
> > >> This is exactly the same as RC0, except the CHANGELOG.
> > >>
> > >> The RC is available at:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > >>
> > >> Git tag: release-3.3.6-RC1
> > >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >>
> > >> Maven artifacts is built by x86 machine and are staged at
> > >>
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >>
> > >> My public key:
> > >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >>
> > >> Changelog:
> > >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >>
> > >> Release notes:
> > >>
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >>
> > >> This is a relatively small release (by Hadoop standard) containing
> about
> > >> 120 commits.
> > >> Please give it a try, this RC vote will run for 7 days.
> > >>
> > >>
> > >> Feature highlights:
> > >>
> > >> SBOM artifacts
> > >> ----------------------------------------
> > >> Starting from this release, Hadoop publishes Software Bill of
> Materials
> > >> (SBOM) using
> > >> CycloneDX Maven plugin. For more information about SBOM, please go to
> > >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >>
> > >> HDFS RBF: RDBMS based token storage support
> > >> ----------------------------------------
> > >> HDFS Router-Router Based Federation now supports storing delegation
> > tokens
> > >> on MySQL,
> > >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > >> which improves token operation through over the original
> Zookeeper-based
> > >> implementation.
> > >>
> > >>
> > >> New File System APIs
> > >> ----------------------------------------
> > >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > moved
> > >> a number of
> > >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> > >> applications that
> > >> depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > >>
> > >> In particular, recoverLease() and isFileClosed() are exposed through
> > >> LeaseRecoverable
> > >> interface. While setSafeMode() is exposed through SafeMode interface.
> > >>
> > >>
> > >>
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by "Tak Lon (Stephen) Wu" <ta...@apache.org>.
+1 (non-binding), and thanks a lot for driving the vote.
* Signature of sources and binaries: ok
* Checksum of sources and binaries: ok
* Rat check (1.8.0_362): okie
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
* Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
* Run MR examples applications and check the result (1.8.0_362): ok
- bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
output 'dfs[a-z.]+'
-Stephen
On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <iw...@oss.nttdata.com>
wrote:
> +1
>
> + verified the signature and checksum of the source tarball.
> + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> with native profile enabled.
> + launched pseudo distributed cluster including kms and httpfs with
> Kerberos and SSL enabled.
> + created encryption zone, put and read files via httpfs.
> + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> Linux 8 (x86_64).
> + built HBase and Hive against Hadoop 3.3.6.
> + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> + skimmed the contents of site documentation.
>
> Thanks,
> Masatake Iwasaki
>
> On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > Bumping this thread to the top.
> > If you are verifying the release, please vote on this thread. RC0 and RC1
> > are exactly the same. The only material difference is the Changelog.
> >
> > Thanks!!
> >
> > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> I am inviting anyone to try and vote on this release candidate.
> >>
> >> Note:
> >> This is exactly the same as RC0, except the CHANGELOG.
> >>
> >> The RC is available at:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >>
> >> Git tag: release-3.3.6-RC1
> >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >>
> >> Maven artifacts is built by x86 machine and are staged at
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >>
> >> My public key:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> Changelog:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >>
> >> Release notes:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >>
> >> This is a relatively small release (by Hadoop standard) containing about
> >> 120 commits.
> >> Please give it a try, this RC vote will run for 7 days.
> >>
> >>
> >> Feature highlights:
> >>
> >> SBOM artifacts
> >> ----------------------------------------
> >> Starting from this release, Hadoop publishes Software Bill of Materials
> >> (SBOM) using
> >> CycloneDX Maven plugin. For more information about SBOM, please go to
> >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >>
> >> HDFS RBF: RDBMS based token storage support
> >> ----------------------------------------
> >> HDFS Router-Router Based Federation now supports storing delegation
> tokens
> >> on MySQL,
> >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> which improves token operation through over the original Zookeeper-based
> >> implementation.
> >>
> >>
> >> New File System APIs
> >> ----------------------------------------
> >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved
> >> a number of
> >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> applications that
> >> depend on HDFS semantics to run on other Hadoop compatible file systems.
> >>
> >> In particular, recoverLease() and isFileClosed() are exposed through
> >> LeaseRecoverable
> >> interface. While setSafeMode() is exposed through SafeMode interface.
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by "Tak Lon (Stephen) Wu" <ta...@apache.org>.
+1 (non-binding), and thanks a lot for driving the vote.
* Signature of sources and binaries: ok
* Checksum of sources and binaries: ok
* Rat check (1.8.0_362): okie
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
* Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
* Run MR examples applications and check the result (1.8.0_362): ok
- bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
output 'dfs[a-z.]+'
-Stephen
On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <iw...@oss.nttdata.com>
wrote:
> +1
>
> + verified the signature and checksum of the source tarball.
> + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> with native profile enabled.
> + launched pseudo distributed cluster including kms and httpfs with
> Kerberos and SSL enabled.
> + created encryption zone, put and read files via httpfs.
> + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> Linux 8 (x86_64).
> + built HBase and Hive against Hadoop 3.3.6.
> + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> + skimmed the contents of site documentation.
>
> Thanks,
> Masatake Iwasaki
>
> On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > Bumping this thread to the top.
> > If you are verifying the release, please vote on this thread. RC0 and RC1
> > are exactly the same. The only material difference is the Changelog.
> >
> > Thanks!!
> >
> > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> I am inviting anyone to try and vote on this release candidate.
> >>
> >> Note:
> >> This is exactly the same as RC0, except the CHANGELOG.
> >>
> >> The RC is available at:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >>
> >> Git tag: release-3.3.6-RC1
> >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >>
> >> Maven artifacts is built by x86 machine and are staged at
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >>
> >> My public key:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> Changelog:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >>
> >> Release notes:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >>
> >> This is a relatively small release (by Hadoop standard) containing about
> >> 120 commits.
> >> Please give it a try, this RC vote will run for 7 days.
> >>
> >>
> >> Feature highlights:
> >>
> >> SBOM artifacts
> >> ----------------------------------------
> >> Starting from this release, Hadoop publishes Software Bill of Materials
> >> (SBOM) using
> >> CycloneDX Maven plugin. For more information about SBOM, please go to
> >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >>
> >> HDFS RBF: RDBMS based token storage support
> >> ----------------------------------------
> >> HDFS Router-Router Based Federation now supports storing delegation
> tokens
> >> on MySQL,
> >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> which improves token operation through over the original Zookeeper-based
> >> implementation.
> >>
> >>
> >> New File System APIs
> >> ----------------------------------------
> >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved
> >> a number of
> >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> applications that
> >> depend on HDFS semantics to run on other Hadoop compatible file systems.
> >>
> >> In particular, recoverLease() and isFileClosed() are exposed through
> >> LeaseRecoverable
> >> interface. While setSafeMode() is exposed through SafeMode interface.
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by "Tak Lon (Stephen) Wu" <ta...@apache.org>.
+1 (non-binding), and thanks a lot for driving the vote.
* Signature of sources and binaries: ok
* Checksum of sources and binaries: ok
* Rat check (1.8.0_362): okie
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
* Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
* Run MR examples applications and check the result (1.8.0_362): ok
- bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
output 'dfs[a-z.]+'
-Stephen
On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <iw...@oss.nttdata.com>
wrote:
> +1
>
> + verified the signature and checksum of the source tarball.
> + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> with native profile enabled.
> + launched pseudo distributed cluster including kms and httpfs with
> Kerberos and SSL enabled.
> + created encryption zone, put and read files via httpfs.
> + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> Linux 8 (x86_64).
> + built HBase and Hive against Hadoop 3.3.6.
> + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> + skimmed the contents of site documentation.
>
> Thanks,
> Masatake Iwasaki
>
> On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > Bumping this thread to the top.
> > If you are verifying the release, please vote on this thread. RC0 and RC1
> > are exactly the same. The only material difference is the Changelog.
> >
> > Thanks!!
> >
> > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> I am inviting anyone to try and vote on this release candidate.
> >>
> >> Note:
> >> This is exactly the same as RC0, except the CHANGELOG.
> >>
> >> The RC is available at:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >>
> >> Git tag: release-3.3.6-RC1
> >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >>
> >> Maven artifacts is built by x86 machine and are staged at
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >>
> >> My public key:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> Changelog:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >>
> >> Release notes:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >>
> >> This is a relatively small release (by Hadoop standard) containing about
> >> 120 commits.
> >> Please give it a try, this RC vote will run for 7 days.
> >>
> >>
> >> Feature highlights:
> >>
> >> SBOM artifacts
> >> ----------------------------------------
> >> Starting from this release, Hadoop publishes Software Bill of Materials
> >> (SBOM) using
> >> CycloneDX Maven plugin. For more information about SBOM, please go to
> >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >>
> >> HDFS RBF: RDBMS based token storage support
> >> ----------------------------------------
> >> HDFS Router-Router Based Federation now supports storing delegation
> tokens
> >> on MySQL,
> >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> which improves token operation through over the original Zookeeper-based
> >> implementation.
> >>
> >>
> >> New File System APIs
> >> ----------------------------------------
> >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved
> >> a number of
> >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> applications that
> >> depend on HDFS semantics to run on other Hadoop compatible file systems.
> >>
> >> In particular, recoverLease() and isFileClosed() are exposed through
> >> LeaseRecoverable
> >> interface. While setSafeMode() is exposed through SafeMode interface.
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by "Tak Lon (Stephen) Wu" <ta...@apache.org>.
+1 (non-binding), and thanks a lot for driving the vote.
* Signature of sources and binaries: ok
* Checksum of sources and binaries: ok
* Rat check (1.8.0_362): okie
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Run Pseudo-Distributed mode with HDFS and YARN (1.8.0_362): ok
* Run Shell command (mkdir/put/ls/get) (1.8.0_362) : ok
* Run MR examples applications and check the result (1.8.0_362): ok
- bin/hadoop jar
share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar grep input
output 'dfs[a-z.]+'
-Stephen
On Tue, Jun 20, 2023 at 6:56 PM Masatake Iwasaki <iw...@oss.nttdata.com>
wrote:
> +1
>
> + verified the signature and checksum of the source tarball.
> + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8
> with native profile enabled.
> + launched pseudo distributed cluster including kms and httpfs with
> Kerberos and SSL enabled.
> + created encryption zone, put and read files via httpfs.
> + built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky
> Linux 8 (x86_64).
> + built HBase and Hive against Hadoop 3.3.6.
> + ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
> + skimmed the contents of site documentation.
>
> Thanks,
> Masatake Iwasaki
>
> On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> > Bumping this thread to the top.
> > If you are verifying the release, please vote on this thread. RC0 and RC1
> > are exactly the same. The only material difference is the Changelog.
> >
> > Thanks!!
> >
> > On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> I am inviting anyone to try and vote on this release candidate.
> >>
> >> Note:
> >> This is exactly the same as RC0, except the CHANGELOG.
> >>
> >> The RC is available at:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >>
> >> Git tag: release-3.3.6-RC1
> >> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >>
> >> Maven artifacts is built by x86 machine and are staged at
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >>
> >> My public key:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> Changelog:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >>
> >> Release notes:
> >> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >>
> >> This is a relatively small release (by Hadoop standard) containing about
> >> 120 commits.
> >> Please give it a try, this RC vote will run for 7 days.
> >>
> >>
> >> Feature highlights:
> >>
> >> SBOM artifacts
> >> ----------------------------------------
> >> Starting from this release, Hadoop publishes Software Bill of Materials
> >> (SBOM) using
> >> CycloneDX Maven plugin. For more information about SBOM, please go to
> >> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >>
> >> HDFS RBF: RDBMS based token storage support
> >> ----------------------------------------
> >> HDFS Router-Router Based Federation now supports storing delegation
> tokens
> >> on MySQL,
> >> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> >> which improves token operation through over the original Zookeeper-based
> >> implementation.
> >>
> >>
> >> New File System APIs
> >> ----------------------------------------
> >> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved
> >> a number of
> >> HDFS-specific APIs to Hadoop Common to make it possible for certain
> >> applications that
> >> depend on HDFS semantics to run on other Hadoop compatible file systems.
> >>
> >> In particular, recoverLease() and isFileClosed() are exposed through
> >> LeaseRecoverable
> >> interface. While setSafeMode() is exposed through SafeMode interface.
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Masatake Iwasaki <iw...@oss.nttdata.com>.
+1
+ verified the signature and checksum of the source tarball.
+ built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8 with native profile enabled.
+ launched pseudo distributed cluster including kms and httpfs with Kerberos and SSL enabled.
+ created encryption zone, put and read files via httpfs.
+ built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64).
+ built HBase and Hive against Hadoop 3.3.6.
+ ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
+ skimmed the contents of site documentation.
Thanks,
Masatake Iwasaki
On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> Bumping this thread to the top.
> If you are verifying the release, please vote on this thread. RC0 and RC1
> are exactly the same. The only material difference is the Changelog.
>
> Thanks!!
>
> On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> I am inviting anyone to try and vote on this release candidate.
>>
>> Note:
>> This is exactly the same as RC0, except the CHANGELOG.
>>
>> The RC is available at:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>>
>> Git tag: release-3.3.6-RC1
>> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>>
>> Maven artifacts is built by x86 machine and are staged at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>>
>> My public key:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> Changelog:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>>
>> Release notes:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>>
>> This is a relatively small release (by Hadoop standard) containing about
>> 120 commits.
>> Please give it a try, this RC vote will run for 7 days.
>>
>>
>> Feature highlights:
>>
>> SBOM artifacts
>> ----------------------------------------
>> Starting from this release, Hadoop publishes Software Bill of Materials
>> (SBOM) using
>> CycloneDX Maven plugin. For more information about SBOM, please go to
>> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>>
>> HDFS RBF: RDBMS based token storage support
>> ----------------------------------------
>> HDFS Router-Router Based Federation now supports storing delegation tokens
>> on MySQL,
>> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> which improves token operation through over the original Zookeeper-based
>> implementation.
>>
>>
>> New File System APIs
>> ----------------------------------------
>> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
>> a number of
>> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> applications that
>> depend on HDFS semantics to run on other Hadoop compatible file systems.
>>
>> In particular, recoverLease() and isFileClosed() are exposed through
>> LeaseRecoverable
>> interface. While setSafeMode() is exposed through SafeMode interface.
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Masatake Iwasaki <iw...@oss.nttdata.com>.
+1
+ verified the signature and checksum of the source tarball.
+ built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8 with native profile enabled.
+ launched pseudo distributed cluster including kms and httpfs with Kerberos and SSL enabled.
+ created encryption zone, put and read files via httpfs.
+ built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64).
+ built HBase and Hive against Hadoop 3.3.6.
+ ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
+ skimmed the contents of site documentation.
Thanks,
Masatake Iwasaki
On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> Bumping this thread to the top.
> If you are verifying the release, please vote on this thread. RC0 and RC1
> are exactly the same. The only material difference is the Changelog.
>
> Thanks!!
>
> On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> I am inviting anyone to try and vote on this release candidate.
>>
>> Note:
>> This is exactly the same as RC0, except the CHANGELOG.
>>
>> The RC is available at:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>>
>> Git tag: release-3.3.6-RC1
>> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>>
>> Maven artifacts is built by x86 machine and are staged at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>>
>> My public key:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> Changelog:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>>
>> Release notes:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>>
>> This is a relatively small release (by Hadoop standard) containing about
>> 120 commits.
>> Please give it a try, this RC vote will run for 7 days.
>>
>>
>> Feature highlights:
>>
>> SBOM artifacts
>> ----------------------------------------
>> Starting from this release, Hadoop publishes Software Bill of Materials
>> (SBOM) using
>> CycloneDX Maven plugin. For more information about SBOM, please go to
>> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>>
>> HDFS RBF: RDBMS based token storage support
>> ----------------------------------------
>> HDFS Router-Router Based Federation now supports storing delegation tokens
>> on MySQL,
>> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> which improves token operation through over the original Zookeeper-based
>> implementation.
>>
>>
>> New File System APIs
>> ----------------------------------------
>> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
>> a number of
>> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> applications that
>> depend on HDFS semantics to run on other Hadoop compatible file systems.
>>
>> In particular, recoverLease() and isFileClosed() are exposed through
>> LeaseRecoverable
>> interface. While setSafeMode() is exposed through SafeMode interface.
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Masatake Iwasaki <iw...@oss.nttdata.com>.
+1
+ verified the signature and checksum of the source tarball.
+ built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8 with native profile enabled.
+ launched pseudo distributed cluster including kms and httpfs with Kerberos and SSL enabled.
+ created encryption zone, put and read files via httpfs.
+ built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64).
+ built HBase and Hive against Hadoop 3.3.6.
+ ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
+ skimmed the contents of site documentation.
Thanks,
Masatake Iwasaki
On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> Bumping this thread to the top.
> If you are verifying the release, please vote on this thread. RC0 and RC1
> are exactly the same. The only material difference is the Changelog.
>
> Thanks!!
>
> On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> I am inviting anyone to try and vote on this release candidate.
>>
>> Note:
>> This is exactly the same as RC0, except the CHANGELOG.
>>
>> The RC is available at:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>>
>> Git tag: release-3.3.6-RC1
>> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>>
>> Maven artifacts is built by x86 machine and are staged at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>>
>> My public key:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> Changelog:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>>
>> Release notes:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>>
>> This is a relatively small release (by Hadoop standard) containing about
>> 120 commits.
>> Please give it a try, this RC vote will run for 7 days.
>>
>>
>> Feature highlights:
>>
>> SBOM artifacts
>> ----------------------------------------
>> Starting from this release, Hadoop publishes Software Bill of Materials
>> (SBOM) using
>> CycloneDX Maven plugin. For more information about SBOM, please go to
>> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>>
>> HDFS RBF: RDBMS based token storage support
>> ----------------------------------------
>> HDFS Router-Router Based Federation now supports storing delegation tokens
>> on MySQL,
>> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> which improves token operation through over the original Zookeeper-based
>> implementation.
>>
>>
>> New File System APIs
>> ----------------------------------------
>> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
>> a number of
>> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> applications that
>> depend on HDFS semantics to run on other Hadoop compatible file systems.
>>
>> In particular, recoverLease() and isFileClosed() are exposed through
>> LeaseRecoverable
>> interface. While setSafeMode() is exposed through SafeMode interface.
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Masatake Iwasaki <iw...@oss.nttdata.com>.
+1
+ verified the signature and checksum of the source tarball.
+ built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK 8 with native profile enabled.
+ launched pseudo distributed cluster including kms and httpfs with Kerberos and SSL enabled.
+ created encryption zone, put and read files via httpfs.
+ built RPM packages by Bigtop (modified to use ZooKeepr 3.6) on Rocky Linux 8 (x86_64).
+ built HBase and Hive against Hadoop 3.3.6.
+ ran smoke-tests of hdfs, yarn, mapreduce, hbase and hive.
+ skimmed the contents of site documentation.
Thanks,
Masatake Iwasaki
On 2023/06/21 8:07, Wei-Chiu Chuang wrote:
> Bumping this thread to the top.
> If you are verifying the release, please vote on this thread. RC0 and RC1
> are exactly the same. The only material difference is the Changelog.
>
> Thanks!!
>
> On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> I am inviting anyone to try and vote on this release candidate.
>>
>> Note:
>> This is exactly the same as RC0, except the CHANGELOG.
>>
>> The RC is available at:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>>
>> Git tag: release-3.3.6-RC1
>> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>>
>> Maven artifacts is built by x86 machine and are staged at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>>
>> My public key:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> Changelog:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>>
>> Release notes:
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>>
>> This is a relatively small release (by Hadoop standard) containing about
>> 120 commits.
>> Please give it a try, this RC vote will run for 7 days.
>>
>>
>> Feature highlights:
>>
>> SBOM artifacts
>> ----------------------------------------
>> Starting from this release, Hadoop publishes Software Bill of Materials
>> (SBOM) using
>> CycloneDX Maven plugin. For more information about SBOM, please go to
>> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>>
>> HDFS RBF: RDBMS based token storage support
>> ----------------------------------------
>> HDFS Router-Router Based Federation now supports storing delegation tokens
>> on MySQL,
>> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> which improves token operation through over the original Zookeeper-based
>> implementation.
>>
>>
>> New File System APIs
>> ----------------------------------------
>> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
>> a number of
>> HDFS-specific APIs to Hadoop Common to make it possible for certain
>> applications that
>> depend on HDFS semantics to run on other Hadoop compatible file systems.
>>
>> In particular, recoverLease() and isFileClosed() are exposed through
>> LeaseRecoverable
>> interface. While setSafeMode() is exposed through SafeMode interface.
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Bumping this thread to the top.
If you are verifying the release, please vote on this thread. RC0 and RC1
are exactly the same. The only material difference is the Changelog.
Thanks!!
On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
> a number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Rat check (1.8.0_362): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_362): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
* Brought up pseudo-distributed mode cluster with hdfs, zk 3.7 and hbase 2.5
* Basic RBF tests look good
* S3A tests with input stream prefetch enabled: looks good
On Sun, Jun 18, 2023 at 5:53 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Bumping this thread to the top.
If you are verifying the release, please vote on this thread. RC0 and RC1
are exactly the same. The only material difference is the Changelog.
Thanks!!
On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
> a number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Bumping this thread to the top.
If you are verifying the release, please vote on this thread. RC0 and RC1
are exactly the same. The only material difference is the Changelog.
Thanks!!
On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
> a number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Thanks all!
The vote passed with 6 binding +1 votes, no +0, -1 votes and 4
non-binding +1 votes.
Publishing the release bits and updating webpage and user docs now.
Thanks
to the binding votes from Ayush, Xiaoqiao, Sammi, Mukund, Masatake
and non-binding votes from Nilotpal, Viraj, Stephen, George and Ahmar.
On Fri, Jun 23, 2023 at 11:48 PM Ayush Saxena <ay...@gmail.com> wrote:
> +1 (Binding)
>
> * Built from source (x86 & Arm)
> * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
> * Verified Checksums (x86 & Arm)
> * Verified Signatures (x86 & Arm)
> * Successful RAT check (x86 & Arm)
> * Verified the diff b/w the tag & the source tar
> * Built Ozone with 3.3.6, green build after a retrigger due to some OOM
> issues [1]
> * Built Tez with 3.3.6 green build [2]
> * Ran basic HDFS shell commands (Fs
> Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
> * Ran some basic Yarn shell commands.
> * Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
> * Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
> WordMean, Pi) (x86 & Arm)
> * Verified the output of `hadoop version` (x86 & Arm)
> * Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
> * Skimmed over the contents of site jar
> * Skimmed over the staging repo.
> * Checked the NOTICE & Licence files.
>
> Thanx Wei-Chiu for driving the release, Good Luck!!!
>
> -Ayush
>
>
> [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
> [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
>
> On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
> wrote:
>
>> +1 (Non-binding).
>> Thanks a lot Wei-Chiu for driving it.
>>
>> Thanks,
>> Nilotpal Nandi
>>
>> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
>> > +1 (binding)
>> >
>> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
>> not 7
>> > days. So technically the time is almost up.
>> > https://hadoop.apache.org/bylaws#Decision+Making
>> >
>> > If you plan to cast a vote, please do so soon. In the meantime, I'll
>> start
>> > to prepare to wrap up the release work.
>> >
>> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>> >
>> > > +1(binding)
>> > >
>> > > * Verified signature and checksum of all source tarballs.
>> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
>> > > -DskipTests -Pnative -Pdist -Dtar`.
>> > > * Setup pseudo cluster with HDFS and YARN.
>> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
>> > > * Run example mr applications and check the result - Pi & wordcount.
>> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
>> etc.
>> > > * Checked git and JIRA using dev-support tools
>> > > `git_jira_fix_version_check.py` .
>> > >
>> > > Thanks WeiChiu for your work.
>> > >
>> > > NOTE: I believe the build fatal error report from me above is only
>> related
>> > > to my own environment.
>> > >
>> > > Best Regards,
>> > > - He Xiaoqiao
>> > >
>> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com>
>> wrote:
>> > >
>> > > > Thanks Wei-Chiu for leading this effort !
>> > > >
>> > > > +1(Binding)
>> > > >
>> > > >
>> > > > + Verified the signature and checksum of all tarballs.
>> > > > + Started a web server and viewed documentation site.
>> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
>> > > > + Launched a pseudo distributed cluster using released binary
>> packages,
>> > > > done some HDFS dir/file basic opeations.
>> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>> > > >
>> > > > Bests,
>> > > > Sammi Chen
>> > > > ________________________________
>> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
>> > > > 发送时间: 2023年6月19日 8:52
>> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
>> > > > mapreduce-dev <ma...@hadoop.apache.org>
>> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>> > > >
>> > > > I am inviting anyone to try and vote on this release candidate.
>> > > >
>> > > > Note:
>> > > > This is exactly the same as RC0, except the CHANGELOG.
>> > > >
>> > > > The RC is available at:
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
>> amd64)
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
>> arm64)
>> > > >
>> > > > Git tag: release-3.3.6-RC1
>> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > > >
>> > > > Maven artifacts is built by x86 machine and are staged at
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > > >
>> > > > My public key:
>> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > > >
>> > > > Changelog:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > > >
>> > > > Release notes:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > > >
>> > > > This is a relatively small release (by Hadoop standard) containing
>> about
>> > > > 120 commits.
>> > > > Please give it a try, this RC vote will run for 7 days.
>> > > >
>> > > >
>> > > > Feature highlights:
>> > > >
>> > > > SBOM artifacts
>> > > > ----------------------------------------
>> > > > Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > > > (SBOM) using
>> > > > CycloneDX Maven plugin. For more information about SBOM, please go
>> to
>> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > > >
>> > > > HDFS RBF: RDBMS based token storage support
>> > > > ----------------------------------------
>> > > > HDFS Router-Router Based Federation now supports storing delegation
>> > > tokens
>> > > > on MySQL,
>> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > > > which improves token operation through over the original
>> Zookeeper-based
>> > > > implementation.
>> > > >
>> > > >
>> > > > New File System APIs
>> > > > ----------------------------------------
>> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > > moved a
>> > > > number of
>> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > > > applications that
>> > > > depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > > >
>> > > > In particular, recoverLease() and isFileClosed() are exposed through
>> > > > LeaseRecoverable
>> > > > interface. While setSafeMode() is exposed through SafeMode
>> interface.
>> > > >
>> > >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Thanks all!
The vote passed with 6 binding +1 votes, no +0, -1 votes and 4
non-binding +1 votes.
Publishing the release bits and updating webpage and user docs now.
Thanks
to the binding votes from Ayush, Xiaoqiao, Sammi, Mukund, Masatake
and non-binding votes from Nilotpal, Viraj, Stephen, George and Ahmar.
On Fri, Jun 23, 2023 at 11:48 PM Ayush Saxena <ay...@gmail.com> wrote:
> +1 (Binding)
>
> * Built from source (x86 & Arm)
> * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
> * Verified Checksums (x86 & Arm)
> * Verified Signatures (x86 & Arm)
> * Successful RAT check (x86 & Arm)
> * Verified the diff b/w the tag & the source tar
> * Built Ozone with 3.3.6, green build after a retrigger due to some OOM
> issues [1]
> * Built Tez with 3.3.6 green build [2]
> * Ran basic HDFS shell commands (Fs
> Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
> * Ran some basic Yarn shell commands.
> * Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
> * Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
> WordMean, Pi) (x86 & Arm)
> * Verified the output of `hadoop version` (x86 & Arm)
> * Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
> * Skimmed over the contents of site jar
> * Skimmed over the staging repo.
> * Checked the NOTICE & Licence files.
>
> Thanx Wei-Chiu for driving the release, Good Luck!!!
>
> -Ayush
>
>
> [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
> [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
>
> On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
> wrote:
>
>> +1 (Non-binding).
>> Thanks a lot Wei-Chiu for driving it.
>>
>> Thanks,
>> Nilotpal Nandi
>>
>> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
>> > +1 (binding)
>> >
>> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
>> not 7
>> > days. So technically the time is almost up.
>> > https://hadoop.apache.org/bylaws#Decision+Making
>> >
>> > If you plan to cast a vote, please do so soon. In the meantime, I'll
>> start
>> > to prepare to wrap up the release work.
>> >
>> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>> >
>> > > +1(binding)
>> > >
>> > > * Verified signature and checksum of all source tarballs.
>> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
>> > > -DskipTests -Pnative -Pdist -Dtar`.
>> > > * Setup pseudo cluster with HDFS and YARN.
>> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
>> > > * Run example mr applications and check the result - Pi & wordcount.
>> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
>> etc.
>> > > * Checked git and JIRA using dev-support tools
>> > > `git_jira_fix_version_check.py` .
>> > >
>> > > Thanks WeiChiu for your work.
>> > >
>> > > NOTE: I believe the build fatal error report from me above is only
>> related
>> > > to my own environment.
>> > >
>> > > Best Regards,
>> > > - He Xiaoqiao
>> > >
>> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com>
>> wrote:
>> > >
>> > > > Thanks Wei-Chiu for leading this effort !
>> > > >
>> > > > +1(Binding)
>> > > >
>> > > >
>> > > > + Verified the signature and checksum of all tarballs.
>> > > > + Started a web server and viewed documentation site.
>> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
>> > > > + Launched a pseudo distributed cluster using released binary
>> packages,
>> > > > done some HDFS dir/file basic opeations.
>> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>> > > >
>> > > > Bests,
>> > > > Sammi Chen
>> > > > ________________________________
>> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
>> > > > 发送时间: 2023年6月19日 8:52
>> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
>> > > > mapreduce-dev <ma...@hadoop.apache.org>
>> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>> > > >
>> > > > I am inviting anyone to try and vote on this release candidate.
>> > > >
>> > > > Note:
>> > > > This is exactly the same as RC0, except the CHANGELOG.
>> > > >
>> > > > The RC is available at:
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
>> amd64)
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
>> arm64)
>> > > >
>> > > > Git tag: release-3.3.6-RC1
>> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > > >
>> > > > Maven artifacts is built by x86 machine and are staged at
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > > >
>> > > > My public key:
>> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > > >
>> > > > Changelog:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > > >
>> > > > Release notes:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > > >
>> > > > This is a relatively small release (by Hadoop standard) containing
>> about
>> > > > 120 commits.
>> > > > Please give it a try, this RC vote will run for 7 days.
>> > > >
>> > > >
>> > > > Feature highlights:
>> > > >
>> > > > SBOM artifacts
>> > > > ----------------------------------------
>> > > > Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > > > (SBOM) using
>> > > > CycloneDX Maven plugin. For more information about SBOM, please go
>> to
>> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > > >
>> > > > HDFS RBF: RDBMS based token storage support
>> > > > ----------------------------------------
>> > > > HDFS Router-Router Based Federation now supports storing delegation
>> > > tokens
>> > > > on MySQL,
>> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > > > which improves token operation through over the original
>> Zookeeper-based
>> > > > implementation.
>> > > >
>> > > >
>> > > > New File System APIs
>> > > > ----------------------------------------
>> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > > moved a
>> > > > number of
>> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > > > applications that
>> > > > depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > > >
>> > > > In particular, recoverLease() and isFileClosed() are exposed through
>> > > > LeaseRecoverable
>> > > > interface. While setSafeMode() is exposed through SafeMode
>> interface.
>> > > >
>> > >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Thanks all!
The vote passed with 6 binding +1 votes, no +0, -1 votes and 4
non-binding +1 votes.
Publishing the release bits and updating webpage and user docs now.
Thanks
to the binding votes from Ayush, Xiaoqiao, Sammi, Mukund, Masatake
and non-binding votes from Nilotpal, Viraj, Stephen, George and Ahmar.
On Fri, Jun 23, 2023 at 11:48 PM Ayush Saxena <ay...@gmail.com> wrote:
> +1 (Binding)
>
> * Built from source (x86 & Arm)
> * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
> * Verified Checksums (x86 & Arm)
> * Verified Signatures (x86 & Arm)
> * Successful RAT check (x86 & Arm)
> * Verified the diff b/w the tag & the source tar
> * Built Ozone with 3.3.6, green build after a retrigger due to some OOM
> issues [1]
> * Built Tez with 3.3.6 green build [2]
> * Ran basic HDFS shell commands (Fs
> Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
> * Ran some basic Yarn shell commands.
> * Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
> * Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
> WordMean, Pi) (x86 & Arm)
> * Verified the output of `hadoop version` (x86 & Arm)
> * Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
> * Skimmed over the contents of site jar
> * Skimmed over the staging repo.
> * Checked the NOTICE & Licence files.
>
> Thanx Wei-Chiu for driving the release, Good Luck!!!
>
> -Ayush
>
>
> [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
> [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
>
> On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
> wrote:
>
>> +1 (Non-binding).
>> Thanks a lot Wei-Chiu for driving it.
>>
>> Thanks,
>> Nilotpal Nandi
>>
>> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
>> > +1 (binding)
>> >
>> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
>> not 7
>> > days. So technically the time is almost up.
>> > https://hadoop.apache.org/bylaws#Decision+Making
>> >
>> > If you plan to cast a vote, please do so soon. In the meantime, I'll
>> start
>> > to prepare to wrap up the release work.
>> >
>> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>> >
>> > > +1(binding)
>> > >
>> > > * Verified signature and checksum of all source tarballs.
>> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
>> > > -DskipTests -Pnative -Pdist -Dtar`.
>> > > * Setup pseudo cluster with HDFS and YARN.
>> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
>> > > * Run example mr applications and check the result - Pi & wordcount.
>> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
>> etc.
>> > > * Checked git and JIRA using dev-support tools
>> > > `git_jira_fix_version_check.py` .
>> > >
>> > > Thanks WeiChiu for your work.
>> > >
>> > > NOTE: I believe the build fatal error report from me above is only
>> related
>> > > to my own environment.
>> > >
>> > > Best Regards,
>> > > - He Xiaoqiao
>> > >
>> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com>
>> wrote:
>> > >
>> > > > Thanks Wei-Chiu for leading this effort !
>> > > >
>> > > > +1(Binding)
>> > > >
>> > > >
>> > > > + Verified the signature and checksum of all tarballs.
>> > > > + Started a web server and viewed documentation site.
>> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
>> > > > + Launched a pseudo distributed cluster using released binary
>> packages,
>> > > > done some HDFS dir/file basic opeations.
>> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>> > > >
>> > > > Bests,
>> > > > Sammi Chen
>> > > > ________________________________
>> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
>> > > > 发送时间: 2023年6月19日 8:52
>> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
>> > > > mapreduce-dev <ma...@hadoop.apache.org>
>> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>> > > >
>> > > > I am inviting anyone to try and vote on this release candidate.
>> > > >
>> > > > Note:
>> > > > This is exactly the same as RC0, except the CHANGELOG.
>> > > >
>> > > > The RC is available at:
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
>> amd64)
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
>> arm64)
>> > > >
>> > > > Git tag: release-3.3.6-RC1
>> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > > >
>> > > > Maven artifacts is built by x86 machine and are staged at
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > > >
>> > > > My public key:
>> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > > >
>> > > > Changelog:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > > >
>> > > > Release notes:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > > >
>> > > > This is a relatively small release (by Hadoop standard) containing
>> about
>> > > > 120 commits.
>> > > > Please give it a try, this RC vote will run for 7 days.
>> > > >
>> > > >
>> > > > Feature highlights:
>> > > >
>> > > > SBOM artifacts
>> > > > ----------------------------------------
>> > > > Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > > > (SBOM) using
>> > > > CycloneDX Maven plugin. For more information about SBOM, please go
>> to
>> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > > >
>> > > > HDFS RBF: RDBMS based token storage support
>> > > > ----------------------------------------
>> > > > HDFS Router-Router Based Federation now supports storing delegation
>> > > tokens
>> > > > on MySQL,
>> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > > > which improves token operation through over the original
>> Zookeeper-based
>> > > > implementation.
>> > > >
>> > > >
>> > > > New File System APIs
>> > > > ----------------------------------------
>> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > > moved a
>> > > > number of
>> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > > > applications that
>> > > > depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > > >
>> > > > In particular, recoverLease() and isFileClosed() are exposed through
>> > > > LeaseRecoverable
>> > > > interface. While setSafeMode() is exposed through SafeMode
>> interface.
>> > > >
>> > >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Thanks all!
The vote passed with 6 binding +1 votes, no +0, -1 votes and 4
non-binding +1 votes.
Publishing the release bits and updating webpage and user docs now.
Thanks
to the binding votes from Ayush, Xiaoqiao, Sammi, Mukund, Masatake
and non-binding votes from Nilotpal, Viraj, Stephen, George and Ahmar.
On Fri, Jun 23, 2023 at 11:48 PM Ayush Saxena <ay...@gmail.com> wrote:
> +1 (Binding)
>
> * Built from source (x86 & Arm)
> * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
> * Verified Checksums (x86 & Arm)
> * Verified Signatures (x86 & Arm)
> * Successful RAT check (x86 & Arm)
> * Verified the diff b/w the tag & the source tar
> * Built Ozone with 3.3.6, green build after a retrigger due to some OOM
> issues [1]
> * Built Tez with 3.3.6 green build [2]
> * Ran basic HDFS shell commands (Fs
> Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
> * Ran some basic Yarn shell commands.
> * Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
> * Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
> WordMean, Pi) (x86 & Arm)
> * Verified the output of `hadoop version` (x86 & Arm)
> * Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
> * Skimmed over the contents of site jar
> * Skimmed over the staging repo.
> * Checked the NOTICE & Licence files.
>
> Thanx Wei-Chiu for driving the release, Good Luck!!!
>
> -Ayush
>
>
> [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
> [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
>
> On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
> wrote:
>
>> +1 (Non-binding).
>> Thanks a lot Wei-Chiu for driving it.
>>
>> Thanks,
>> Nilotpal Nandi
>>
>> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
>> > +1 (binding)
>> >
>> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
>> not 7
>> > days. So technically the time is almost up.
>> > https://hadoop.apache.org/bylaws#Decision+Making
>> >
>> > If you plan to cast a vote, please do so soon. In the meantime, I'll
>> start
>> > to prepare to wrap up the release work.
>> >
>> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>> >
>> > > +1(binding)
>> > >
>> > > * Verified signature and checksum of all source tarballs.
>> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
>> > > -DskipTests -Pnative -Pdist -Dtar`.
>> > > * Setup pseudo cluster with HDFS and YARN.
>> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
>> > > * Run example mr applications and check the result - Pi & wordcount.
>> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
>> etc.
>> > > * Checked git and JIRA using dev-support tools
>> > > `git_jira_fix_version_check.py` .
>> > >
>> > > Thanks WeiChiu for your work.
>> > >
>> > > NOTE: I believe the build fatal error report from me above is only
>> related
>> > > to my own environment.
>> > >
>> > > Best Regards,
>> > > - He Xiaoqiao
>> > >
>> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com>
>> wrote:
>> > >
>> > > > Thanks Wei-Chiu for leading this effort !
>> > > >
>> > > > +1(Binding)
>> > > >
>> > > >
>> > > > + Verified the signature and checksum of all tarballs.
>> > > > + Started a web server and viewed documentation site.
>> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
>> > > > + Launched a pseudo distributed cluster using released binary
>> packages,
>> > > > done some HDFS dir/file basic opeations.
>> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>> > > >
>> > > > Bests,
>> > > > Sammi Chen
>> > > > ________________________________
>> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
>> > > > 发送时间: 2023年6月19日 8:52
>> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
>> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
>> > > > mapreduce-dev <ma...@hadoop.apache.org>
>> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>> > > >
>> > > > I am inviting anyone to try and vote on this release candidate.
>> > > >
>> > > > Note:
>> > > > This is exactly the same as RC0, except the CHANGELOG.
>> > > >
>> > > > The RC is available at:
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for
>> amd64)
>> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for
>> arm64)
>> > > >
>> > > > Git tag: release-3.3.6-RC1
>> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>> > > >
>> > > > Maven artifacts is built by x86 machine and are staged at
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>> > > >
>> > > > My public key:
>> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> > > >
>> > > > Changelog:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>> > > >
>> > > > Release notes:
>> > > >
>> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>> > > >
>> > > > This is a relatively small release (by Hadoop standard) containing
>> about
>> > > > 120 commits.
>> > > > Please give it a try, this RC vote will run for 7 days.
>> > > >
>> > > >
>> > > > Feature highlights:
>> > > >
>> > > > SBOM artifacts
>> > > > ----------------------------------------
>> > > > Starting from this release, Hadoop publishes Software Bill of
>> Materials
>> > > > (SBOM) using
>> > > > CycloneDX Maven plugin. For more information about SBOM, please go
>> to
>> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>> > > >
>> > > > HDFS RBF: RDBMS based token storage support
>> > > > ----------------------------------------
>> > > > HDFS Router-Router Based Federation now supports storing delegation
>> > > tokens
>> > > > on MySQL,
>> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
>> > > > which improves token operation through over the original
>> Zookeeper-based
>> > > > implementation.
>> > > >
>> > > >
>> > > > New File System APIs
>> > > > ----------------------------------------
>> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
>> > > moved a
>> > > > number of
>> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
>> > > > applications that
>> > > > depend on HDFS semantics to run on other Hadoop compatible file
>> systems.
>> > > >
>> > > > In particular, recoverLease() and isFileClosed() are exposed through
>> > > > LeaseRecoverable
>> > > > interface. While setSafeMode() is exposed through SafeMode
>> interface.
>> > > >
>> > >
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Ayush Saxena <ay...@gmail.com>.
+1 (Binding)
* Built from source (x86 & Arm)
* Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
* Verified Checksums (x86 & Arm)
* Verified Signatures (x86 & Arm)
* Successful RAT check (x86 & Arm)
* Verified the diff b/w the tag & the source tar
* Built Ozone with 3.3.6, green build after a retrigger due to some OOM
issues [1]
* Built Tez with 3.3.6 green build [2]
* Ran basic HDFS shell commands (Fs
Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
* Ran some basic Yarn shell commands.
* Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
* Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
WordMean, Pi) (x86 & Arm)
* Verified the output of `hadoop version` (x86 & Arm)
* Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
* Skimmed over the contents of site jar
* Skimmed over the staging repo.
* Checked the NOTICE & Licence files.
Thanx Wei-Chiu for driving the release, Good Luck!!!
-Ayush
[1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
[2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
wrote:
> +1 (Non-binding).
> Thanks a lot Wei-Chiu for driving it.
>
> Thanks,
> Nilotpal Nandi
>
> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
> > +1 (binding)
> >
> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
> not 7
> > days. So technically the time is almost up.
> > https://hadoop.apache.org/bylaws#Decision+Making
> >
> > If you plan to cast a vote, please do so soon. In the meantime, I'll
> start
> > to prepare to wrap up the release work.
> >
> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > +1(binding)
> > >
> > > * Verified signature and checksum of all source tarballs.
> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> > > -DskipTests -Pnative -Pdist -Dtar`.
> > > * Setup pseudo cluster with HDFS and YARN.
> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> > > * Run example mr applications and check the result - Pi & wordcount.
> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
> etc.
> > > * Checked git and JIRA using dev-support tools
> > > `git_jira_fix_version_check.py` .
> > >
> > > Thanks WeiChiu for your work.
> > >
> > > NOTE: I believe the build fatal error report from me above is only
> related
> > > to my own environment.
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> > >
> > > > Thanks Wei-Chiu for leading this effort !
> > > >
> > > > +1(Binding)
> > > >
> > > >
> > > > + Verified the signature and checksum of all tarballs.
> > > > + Started a web server and viewed documentation site.
> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > > > + Launched a pseudo distributed cluster using released binary
> packages,
> > > > done some HDFS dir/file basic opeations.
> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> > > >
> > > > Bests,
> > > > Sammi Chen
> > > > ________________________________
> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > > > 发送时间: 2023年6月19日 8:52
> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > > > mapreduce-dev <ma...@hadoop.apache.org>
> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> > > >
> > > > I am inviting anyone to try and vote on this release candidate.
> > > >
> > > > Note:
> > > > This is exactly the same as RC0, except the CHANGELOG.
> > > >
> > > > The RC is available at:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > > >
> > > > Git tag: release-3.3.6-RC1
> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > > >
> > > > Maven artifacts is built by x86 machine and are staged at
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > > >
> > > > My public key:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > Changelog:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > > >
> > > > Release notes:
> > > >
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > > >
> > > > This is a relatively small release (by Hadoop standard) containing
> about
> > > > 120 commits.
> > > > Please give it a try, this RC vote will run for 7 days.
> > > >
> > > >
> > > > Feature highlights:
> > > >
> > > > SBOM artifacts
> > > > ----------------------------------------
> > > > Starting from this release, Hadoop publishes Software Bill of
> Materials
> > > > (SBOM) using
> > > > CycloneDX Maven plugin. For more information about SBOM, please go to
> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > > >
> > > > HDFS RBF: RDBMS based token storage support
> > > > ----------------------------------------
> > > > HDFS Router-Router Based Federation now supports storing delegation
> > > tokens
> > > > on MySQL,
> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > > > which improves token operation through over the original
> Zookeeper-based
> > > > implementation.
> > > >
> > > >
> > > > New File System APIs
> > > > ----------------------------------------
> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > > moved a
> > > > number of
> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > > > applications that
> > > > depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > > >
> > > > In particular, recoverLease() and isFileClosed() are exposed through
> > > > LeaseRecoverable
> > > > interface. While setSafeMode() is exposed through SafeMode interface.
> > > >
> > >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Ayush Saxena <ay...@gmail.com>.
+1 (Binding)
* Built from source (x86 & Arm)
* Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
* Verified Checksums (x86 & Arm)
* Verified Signatures (x86 & Arm)
* Successful RAT check (x86 & Arm)
* Verified the diff b/w the tag & the source tar
* Built Ozone with 3.3.6, green build after a retrigger due to some OOM
issues [1]
* Built Tez with 3.3.6 green build [2]
* Ran basic HDFS shell commands (Fs
Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
* Ran some basic Yarn shell commands.
* Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
* Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
WordMean, Pi) (x86 & Arm)
* Verified the output of `hadoop version` (x86 & Arm)
* Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
* Skimmed over the contents of site jar
* Skimmed over the staging repo.
* Checked the NOTICE & Licence files.
Thanx Wei-Chiu for driving the release, Good Luck!!!
-Ayush
[1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
[2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
wrote:
> +1 (Non-binding).
> Thanks a lot Wei-Chiu for driving it.
>
> Thanks,
> Nilotpal Nandi
>
> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
> > +1 (binding)
> >
> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
> not 7
> > days. So technically the time is almost up.
> > https://hadoop.apache.org/bylaws#Decision+Making
> >
> > If you plan to cast a vote, please do so soon. In the meantime, I'll
> start
> > to prepare to wrap up the release work.
> >
> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > +1(binding)
> > >
> > > * Verified signature and checksum of all source tarballs.
> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> > > -DskipTests -Pnative -Pdist -Dtar`.
> > > * Setup pseudo cluster with HDFS and YARN.
> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> > > * Run example mr applications and check the result - Pi & wordcount.
> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
> etc.
> > > * Checked git and JIRA using dev-support tools
> > > `git_jira_fix_version_check.py` .
> > >
> > > Thanks WeiChiu for your work.
> > >
> > > NOTE: I believe the build fatal error report from me above is only
> related
> > > to my own environment.
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> > >
> > > > Thanks Wei-Chiu for leading this effort !
> > > >
> > > > +1(Binding)
> > > >
> > > >
> > > > + Verified the signature and checksum of all tarballs.
> > > > + Started a web server and viewed documentation site.
> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > > > + Launched a pseudo distributed cluster using released binary
> packages,
> > > > done some HDFS dir/file basic opeations.
> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> > > >
> > > > Bests,
> > > > Sammi Chen
> > > > ________________________________
> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > > > 发送时间: 2023年6月19日 8:52
> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > > > mapreduce-dev <ma...@hadoop.apache.org>
> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> > > >
> > > > I am inviting anyone to try and vote on this release candidate.
> > > >
> > > > Note:
> > > > This is exactly the same as RC0, except the CHANGELOG.
> > > >
> > > > The RC is available at:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > > >
> > > > Git tag: release-3.3.6-RC1
> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > > >
> > > > Maven artifacts is built by x86 machine and are staged at
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > > >
> > > > My public key:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > Changelog:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > > >
> > > > Release notes:
> > > >
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > > >
> > > > This is a relatively small release (by Hadoop standard) containing
> about
> > > > 120 commits.
> > > > Please give it a try, this RC vote will run for 7 days.
> > > >
> > > >
> > > > Feature highlights:
> > > >
> > > > SBOM artifacts
> > > > ----------------------------------------
> > > > Starting from this release, Hadoop publishes Software Bill of
> Materials
> > > > (SBOM) using
> > > > CycloneDX Maven plugin. For more information about SBOM, please go to
> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > > >
> > > > HDFS RBF: RDBMS based token storage support
> > > > ----------------------------------------
> > > > HDFS Router-Router Based Federation now supports storing delegation
> > > tokens
> > > > on MySQL,
> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > > > which improves token operation through over the original
> Zookeeper-based
> > > > implementation.
> > > >
> > > >
> > > > New File System APIs
> > > > ----------------------------------------
> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > > moved a
> > > > number of
> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > > > applications that
> > > > depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > > >
> > > > In particular, recoverLease() and isFileClosed() are exposed through
> > > > LeaseRecoverable
> > > > interface. While setSafeMode() is exposed through SafeMode interface.
> > > >
> > >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Ayush Saxena <ay...@gmail.com>.
+1 (Binding)
* Built from source (x86 & Arm)
* Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
* Verified Checksums (x86 & Arm)
* Verified Signatures (x86 & Arm)
* Successful RAT check (x86 & Arm)
* Verified the diff b/w the tag & the source tar
* Built Ozone with 3.3.6, green build after a retrigger due to some OOM
issues [1]
* Built Tez with 3.3.6 green build [2]
* Ran basic HDFS shell commands (Fs
Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
* Ran some basic Yarn shell commands.
* Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
* Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
WordMean, Pi) (x86 & Arm)
* Verified the output of `hadoop version` (x86 & Arm)
* Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
* Skimmed over the contents of site jar
* Skimmed over the staging repo.
* Checked the NOTICE & Licence files.
Thanx Wei-Chiu for driving the release, Good Luck!!!
-Ayush
[1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
[2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
wrote:
> +1 (Non-binding).
> Thanks a lot Wei-Chiu for driving it.
>
> Thanks,
> Nilotpal Nandi
>
> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
> > +1 (binding)
> >
> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
> not 7
> > days. So technically the time is almost up.
> > https://hadoop.apache.org/bylaws#Decision+Making
> >
> > If you plan to cast a vote, please do so soon. In the meantime, I'll
> start
> > to prepare to wrap up the release work.
> >
> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > +1(binding)
> > >
> > > * Verified signature and checksum of all source tarballs.
> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> > > -DskipTests -Pnative -Pdist -Dtar`.
> > > * Setup pseudo cluster with HDFS and YARN.
> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> > > * Run example mr applications and check the result - Pi & wordcount.
> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
> etc.
> > > * Checked git and JIRA using dev-support tools
> > > `git_jira_fix_version_check.py` .
> > >
> > > Thanks WeiChiu for your work.
> > >
> > > NOTE: I believe the build fatal error report from me above is only
> related
> > > to my own environment.
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> > >
> > > > Thanks Wei-Chiu for leading this effort !
> > > >
> > > > +1(Binding)
> > > >
> > > >
> > > > + Verified the signature and checksum of all tarballs.
> > > > + Started a web server and viewed documentation site.
> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > > > + Launched a pseudo distributed cluster using released binary
> packages,
> > > > done some HDFS dir/file basic opeations.
> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> > > >
> > > > Bests,
> > > > Sammi Chen
> > > > ________________________________
> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > > > 发送时间: 2023年6月19日 8:52
> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > > > mapreduce-dev <ma...@hadoop.apache.org>
> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> > > >
> > > > I am inviting anyone to try and vote on this release candidate.
> > > >
> > > > Note:
> > > > This is exactly the same as RC0, except the CHANGELOG.
> > > >
> > > > The RC is available at:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > > >
> > > > Git tag: release-3.3.6-RC1
> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > > >
> > > > Maven artifacts is built by x86 machine and are staged at
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > > >
> > > > My public key:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > Changelog:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > > >
> > > > Release notes:
> > > >
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > > >
> > > > This is a relatively small release (by Hadoop standard) containing
> about
> > > > 120 commits.
> > > > Please give it a try, this RC vote will run for 7 days.
> > > >
> > > >
> > > > Feature highlights:
> > > >
> > > > SBOM artifacts
> > > > ----------------------------------------
> > > > Starting from this release, Hadoop publishes Software Bill of
> Materials
> > > > (SBOM) using
> > > > CycloneDX Maven plugin. For more information about SBOM, please go to
> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > > >
> > > > HDFS RBF: RDBMS based token storage support
> > > > ----------------------------------------
> > > > HDFS Router-Router Based Federation now supports storing delegation
> > > tokens
> > > > on MySQL,
> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > > > which improves token operation through over the original
> Zookeeper-based
> > > > implementation.
> > > >
> > > >
> > > > New File System APIs
> > > > ----------------------------------------
> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > > moved a
> > > > number of
> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > > > applications that
> > > > depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > > >
> > > > In particular, recoverLease() and isFileClosed() are exposed through
> > > > LeaseRecoverable
> > > > interface. While setSafeMode() is exposed through SafeMode interface.
> > > >
> > >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Ayush Saxena <ay...@gmail.com>.
+1 (Binding)
* Built from source (x86 & Arm)
* Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm)
* Verified Checksums (x86 & Arm)
* Verified Signatures (x86 & Arm)
* Successful RAT check (x86 & Arm)
* Verified the diff b/w the tag & the source tar
* Built Ozone with 3.3.6, green build after a retrigger due to some OOM
issues [1]
* Built Tez with 3.3.6 green build [2]
* Ran basic HDFS shell commands (Fs
Operations/EC/RBF/StoragePolicy/Snapshots) (x86 & Arm)
* Ran some basic Yarn shell commands.
* Browsed through the UI (NN, DN, RM, NM, JHS) (x86 & Arm)
* Ran some example Jobs (TeraGen, TeraSort, TeraValidate, WordCount,
WordMean, Pi) (x86 & Arm)
* Verified the output of `hadoop version` (x86 & Arm)
* Ran some HDFS unit tests around FsOperations/EC/Observer Read/RBF/SPS
* Skimmed over the contents of site jar
* Skimmed over the staging repo.
* Checked the NOTICE & Licence files.
Thanx Wei-Chiu for driving the release, Good Luck!!!
-Ayush
[1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769
[2] https://github.com/apache/tez/pull/285#issuecomment-1590962978
On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi <ni...@apache.org>
wrote:
> +1 (Non-binding).
> Thanks a lot Wei-Chiu for driving it.
>
> Thanks,
> Nilotpal Nandi
>
> On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
> > +1 (binding)
> >
> > Note: according to the Hadoop bylaw, release vote is open for 5 days,
> not 7
> > days. So technically the time is almost up.
> > https://hadoop.apache.org/bylaws#Decision+Making
> >
> > If you plan to cast a vote, please do so soon. In the meantime, I'll
> start
> > to prepare to wrap up the release work.
> >
> > On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > > +1(binding)
> > >
> > > * Verified signature and checksum of all source tarballs.
> > > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> > > -DskipTests -Pnative -Pdist -Dtar`.
> > > * Setup pseudo cluster with HDFS and YARN.
> > > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> > > * Run example mr applications and check the result - Pi & wordcount.
> > > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager
> etc.
> > > * Checked git and JIRA using dev-support tools
> > > `git_jira_fix_version_check.py` .
> > >
> > > Thanks WeiChiu for your work.
> > >
> > > NOTE: I believe the build fatal error report from me above is only
> related
> > > to my own environment.
> > >
> > > Best Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> > >
> > > > Thanks Wei-Chiu for leading this effort !
> > > >
> > > > +1(Binding)
> > > >
> > > >
> > > > + Verified the signature and checksum of all tarballs.
> > > > + Started a web server and viewed documentation site.
> > > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > > > + Launched a pseudo distributed cluster using released binary
> packages,
> > > > done some HDFS dir/file basic opeations.
> > > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> > > >
> > > > Bests,
> > > > Sammi Chen
> > > > ________________________________
> > > > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > > > 发送时间: 2023年6月19日 8:52
> > > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > > > mapreduce-dev <ma...@hadoop.apache.org>
> > > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> > > >
> > > > I am inviting anyone to try and vote on this release candidate.
> > > >
> > > > Note:
> > > > This is exactly the same as RC0, except the CHANGELOG.
> > > >
> > > > The RC is available at:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > > >
> > > > Git tag: release-3.3.6-RC1
> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > > >
> > > > Maven artifacts is built by x86 machine and are staged at
> > > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > > >
> > > > My public key:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > Changelog:
> > > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > > >
> > > > Release notes:
> > > >
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > > >
> > > > This is a relatively small release (by Hadoop standard) containing
> about
> > > > 120 commits.
> > > > Please give it a try, this RC vote will run for 7 days.
> > > >
> > > >
> > > > Feature highlights:
> > > >
> > > > SBOM artifacts
> > > > ----------------------------------------
> > > > Starting from this release, Hadoop publishes Software Bill of
> Materials
> > > > (SBOM) using
> > > > CycloneDX Maven plugin. For more information about SBOM, please go to
> > > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > > >
> > > > HDFS RBF: RDBMS based token storage support
> > > > ----------------------------------------
> > > > HDFS Router-Router Based Federation now supports storing delegation
> > > tokens
> > > > on MySQL,
> > > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > > > which improves token operation through over the original
> Zookeeper-based
> > > > implementation.
> > > >
> > > >
> > > > New File System APIs
> > > > ----------------------------------------
> > > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > > moved a
> > > > number of
> > > > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > > > applications that
> > > > depend on HDFS semantics to run on other Hadoop compatible file
> systems.
> > > >
> > > > In particular, recoverLease() and isFileClosed() are exposed through
> > > > LeaseRecoverable
> > > > interface. While setSafeMode() is exposed through SafeMode interface.
> > > >
> > >
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Nilotpal Nandi <ni...@apache.org>.
+1 (Non-binding).
Thanks a lot Wei-Chiu for driving it.
Thanks,
Nilotpal Nandi
On 2023/06/23 21:51:56 Wei-Chiu Chuang wrote:
> +1 (binding)
>
> Note: according to the Hadoop bylaw, release vote is open for 5 days, not 7
> days. So technically the time is almost up.
> https://hadoop.apache.org/bylaws#Decision+Making
>
> If you plan to cast a vote, please do so soon. In the meantime, I'll start
> to prepare to wrap up the release work.
>
> On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org> wrote:
>
> > +1(binding)
> >
> > * Verified signature and checksum of all source tarballs.
> > * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> > -DskipTests -Pnative -Pdist -Dtar`.
> > * Setup pseudo cluster with HDFS and YARN.
> > * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> > * Run example mr applications and check the result - Pi & wordcount.
> > * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
> > * Checked git and JIRA using dev-support tools
> > `git_jira_fix_version_check.py` .
> >
> > Thanks WeiChiu for your work.
> >
> > NOTE: I believe the build fatal error report from me above is only related
> > to my own environment.
> >
> > Best Regards,
> > - He Xiaoqiao
> >
> > On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> >
> > > Thanks Wei-Chiu for leading this effort !
> > >
> > > +1(Binding)
> > >
> > >
> > > + Verified the signature and checksum of all tarballs.
> > > + Started a web server and viewed documentation site.
> > > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > > + Launched a pseudo distributed cluster using released binary packages,
> > > done some HDFS dir/file basic opeations.
> > > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> > >
> > > Bests,
> > > Sammi Chen
> > > ________________________________
> > > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > > 发送时间: 2023年6月19日 8:52
> > > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > > mapreduce-dev <ma...@hadoop.apache.org>
> > > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> > >
> > > I am inviting anyone to try and vote on this release candidate.
> > >
> > > Note:
> > > This is exactly the same as RC0, except the CHANGELOG.
> > >
> > > The RC is available at:
> > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> > >
> > > Git tag: release-3.3.6-RC1
> > > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> > >
> > > Maven artifacts is built by x86 machine and are staged at
> > > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> > >
> > > My public key:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > Changelog:
> > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> > >
> > > Release notes:
> > > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> > >
> > > This is a relatively small release (by Hadoop standard) containing about
> > > 120 commits.
> > > Please give it a try, this RC vote will run for 7 days.
> > >
> > >
> > > Feature highlights:
> > >
> > > SBOM artifacts
> > > ----------------------------------------
> > > Starting from this release, Hadoop publishes Software Bill of Materials
> > > (SBOM) using
> > > CycloneDX Maven plugin. For more information about SBOM, please go to
> > > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> > >
> > > HDFS RBF: RDBMS based token storage support
> > > ----------------------------------------
> > > HDFS Router-Router Based Federation now supports storing delegation
> > tokens
> > > on MySQL,
> > > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > > which improves token operation through over the original Zookeeper-based
> > > implementation.
> > >
> > >
> > > New File System APIs
> > > ----------------------------------------
> > > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> > moved a
> > > number of
> > > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > > applications that
> > > depend on HDFS semantics to run on other Hadoop compatible file systems.
> > >
> > > In particular, recoverLease() and isFileClosed() are exposed through
> > > LeaseRecoverable
> > > interface. While setSafeMode() is exposed through SafeMode interface.
> > >
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
+1 (binding)
Note: according to the Hadoop bylaw, release vote is open for 5 days, not 7
days. So technically the time is almost up.
https://hadoop.apache.org/bylaws#Decision+Making
If you plan to cast a vote, please do so soon. In the meantime, I'll start
to prepare to wrap up the release work.
On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org> wrote:
> +1(binding)
>
> * Verified signature and checksum of all source tarballs.
> * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> -DskipTests -Pnative -Pdist -Dtar`.
> * Setup pseudo cluster with HDFS and YARN.
> * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> * Run example mr applications and check the result - Pi & wordcount.
> * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
> * Checked git and JIRA using dev-support tools
> `git_jira_fix_version_check.py` .
>
> Thanks WeiChiu for your work.
>
> NOTE: I believe the build fatal error report from me above is only related
> to my own environment.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
>
> > Thanks Wei-Chiu for leading this effort !
> >
> > +1(Binding)
> >
> >
> > + Verified the signature and checksum of all tarballs.
> > + Started a web server and viewed documentation site.
> > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > + Launched a pseudo distributed cluster using released binary packages,
> > done some HDFS dir/file basic opeations.
> > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> >
> > Bests,
> > Sammi Chen
> > ________________________________
> > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > 发送时间: 2023年6月19日 8:52
> > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > mapreduce-dev <ma...@hadoop.apache.org>
> > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> >
> > I am inviting anyone to try and vote on this release candidate.
> >
> > Note:
> > This is exactly the same as RC0, except the CHANGELOG.
> >
> > The RC is available at:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >
> > Git tag: release-3.3.6-RC1
> > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >
> > Maven artifacts is built by x86 machine and are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >
> > My public key:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Changelog:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >
> > Release notes:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >
> > This is a relatively small release (by Hadoop standard) containing about
> > 120 commits.
> > Please give it a try, this RC vote will run for 7 days.
> >
> >
> > Feature highlights:
> >
> > SBOM artifacts
> > ----------------------------------------
> > Starting from this release, Hadoop publishes Software Bill of Materials
> > (SBOM) using
> > CycloneDX Maven plugin. For more information about SBOM, please go to
> > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >
> > HDFS RBF: RDBMS based token storage support
> > ----------------------------------------
> > HDFS Router-Router Based Federation now supports storing delegation
> tokens
> > on MySQL,
> > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > which improves token operation through over the original Zookeeper-based
> > implementation.
> >
> >
> > New File System APIs
> > ----------------------------------------
> > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved a
> > number of
> > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > applications that
> > depend on HDFS semantics to run on other Hadoop compatible file systems.
> >
> > In particular, recoverLease() and isFileClosed() are exposed through
> > LeaseRecoverable
> > interface. While setSafeMode() is exposed through SafeMode interface.
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
+1 (binding)
Note: according to the Hadoop bylaw, release vote is open for 5 days, not 7
days. So technically the time is almost up.
https://hadoop.apache.org/bylaws#Decision+Making
If you plan to cast a vote, please do so soon. In the meantime, I'll start
to prepare to wrap up the release work.
On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org> wrote:
> +1(binding)
>
> * Verified signature and checksum of all source tarballs.
> * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> -DskipTests -Pnative -Pdist -Dtar`.
> * Setup pseudo cluster with HDFS and YARN.
> * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> * Run example mr applications and check the result - Pi & wordcount.
> * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
> * Checked git and JIRA using dev-support tools
> `git_jira_fix_version_check.py` .
>
> Thanks WeiChiu for your work.
>
> NOTE: I believe the build fatal error report from me above is only related
> to my own environment.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
>
> > Thanks Wei-Chiu for leading this effort !
> >
> > +1(Binding)
> >
> >
> > + Verified the signature and checksum of all tarballs.
> > + Started a web server and viewed documentation site.
> > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > + Launched a pseudo distributed cluster using released binary packages,
> > done some HDFS dir/file basic opeations.
> > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> >
> > Bests,
> > Sammi Chen
> > ________________________________
> > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > 发送时间: 2023年6月19日 8:52
> > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > mapreduce-dev <ma...@hadoop.apache.org>
> > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> >
> > I am inviting anyone to try and vote on this release candidate.
> >
> > Note:
> > This is exactly the same as RC0, except the CHANGELOG.
> >
> > The RC is available at:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >
> > Git tag: release-3.3.6-RC1
> > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >
> > Maven artifacts is built by x86 machine and are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >
> > My public key:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Changelog:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >
> > Release notes:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >
> > This is a relatively small release (by Hadoop standard) containing about
> > 120 commits.
> > Please give it a try, this RC vote will run for 7 days.
> >
> >
> > Feature highlights:
> >
> > SBOM artifacts
> > ----------------------------------------
> > Starting from this release, Hadoop publishes Software Bill of Materials
> > (SBOM) using
> > CycloneDX Maven plugin. For more information about SBOM, please go to
> > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >
> > HDFS RBF: RDBMS based token storage support
> > ----------------------------------------
> > HDFS Router-Router Based Federation now supports storing delegation
> tokens
> > on MySQL,
> > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > which improves token operation through over the original Zookeeper-based
> > implementation.
> >
> >
> > New File System APIs
> > ----------------------------------------
> > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved a
> > number of
> > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > applications that
> > depend on HDFS semantics to run on other Hadoop compatible file systems.
> >
> > In particular, recoverLease() and isFileClosed() are exposed through
> > LeaseRecoverable
> > interface. While setSafeMode() is exposed through SafeMode interface.
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
+1 (binding)
Note: according to the Hadoop bylaw, release vote is open for 5 days, not 7
days. So technically the time is almost up.
https://hadoop.apache.org/bylaws#Decision+Making
If you plan to cast a vote, please do so soon. In the meantime, I'll start
to prepare to wrap up the release work.
On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org> wrote:
> +1(binding)
>
> * Verified signature and checksum of all source tarballs.
> * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> -DskipTests -Pnative -Pdist -Dtar`.
> * Setup pseudo cluster with HDFS and YARN.
> * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> * Run example mr applications and check the result - Pi & wordcount.
> * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
> * Checked git and JIRA using dev-support tools
> `git_jira_fix_version_check.py` .
>
> Thanks WeiChiu for your work.
>
> NOTE: I believe the build fatal error report from me above is only related
> to my own environment.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
>
> > Thanks Wei-Chiu for leading this effort !
> >
> > +1(Binding)
> >
> >
> > + Verified the signature and checksum of all tarballs.
> > + Started a web server and viewed documentation site.
> > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > + Launched a pseudo distributed cluster using released binary packages,
> > done some HDFS dir/file basic opeations.
> > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> >
> > Bests,
> > Sammi Chen
> > ________________________________
> > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > 发送时间: 2023年6月19日 8:52
> > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > mapreduce-dev <ma...@hadoop.apache.org>
> > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> >
> > I am inviting anyone to try and vote on this release candidate.
> >
> > Note:
> > This is exactly the same as RC0, except the CHANGELOG.
> >
> > The RC is available at:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >
> > Git tag: release-3.3.6-RC1
> > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >
> > Maven artifacts is built by x86 machine and are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >
> > My public key:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Changelog:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >
> > Release notes:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >
> > This is a relatively small release (by Hadoop standard) containing about
> > 120 commits.
> > Please give it a try, this RC vote will run for 7 days.
> >
> >
> > Feature highlights:
> >
> > SBOM artifacts
> > ----------------------------------------
> > Starting from this release, Hadoop publishes Software Bill of Materials
> > (SBOM) using
> > CycloneDX Maven plugin. For more information about SBOM, please go to
> > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >
> > HDFS RBF: RDBMS based token storage support
> > ----------------------------------------
> > HDFS Router-Router Based Federation now supports storing delegation
> tokens
> > on MySQL,
> > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > which improves token operation through over the original Zookeeper-based
> > implementation.
> >
> >
> > New File System APIs
> > ----------------------------------------
> > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved a
> > number of
> > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > applications that
> > depend on HDFS semantics to run on other Hadoop compatible file systems.
> >
> > In particular, recoverLease() and isFileClosed() are exposed through
> > LeaseRecoverable
> > interface. While setSafeMode() is exposed through SafeMode interface.
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
+1 (binding)
Note: according to the Hadoop bylaw, release vote is open for 5 days, not 7
days. So technically the time is almost up.
https://hadoop.apache.org/bylaws#Decision+Making
If you plan to cast a vote, please do so soon. In the meantime, I'll start
to prepare to wrap up the release work.
On Fri, Jun 23, 2023 at 6:09 AM Xiaoqiao He <he...@apache.org> wrote:
> +1(binding)
>
> * Verified signature and checksum of all source tarballs.
> * Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
> -DskipTests -Pnative -Pdist -Dtar`.
> * Setup pseudo cluster with HDFS and YARN.
> * Run simple FsShell - mkdir/put/get/mv/rm and check the result.
> * Run example mr applications and check the result - Pi & wordcount.
> * Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
> * Checked git and JIRA using dev-support tools
> `git_jira_fix_version_check.py` .
>
> Thanks WeiChiu for your work.
>
> NOTE: I believe the build fatal error report from me above is only related
> to my own environment.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
>
> > Thanks Wei-Chiu for leading this effort !
> >
> > +1(Binding)
> >
> >
> > + Verified the signature and checksum of all tarballs.
> > + Started a web server and viewed documentation site.
> > + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> > + Launched a pseudo distributed cluster using released binary packages,
> > done some HDFS dir/file basic opeations.
> > + Run grep, pi and wordcount MR tasks on the pseudo cluster.
> >
> > Bests,
> > Sammi Chen
> > ________________________________
> > 发件人: Wei-Chiu Chuang <we...@apache.org>
> > 发送时间: 2023年6月19日 8:52
> > 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> > hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> > mapreduce-dev <ma...@hadoop.apache.org>
> > 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
> >
> > I am inviting anyone to try and vote on this release candidate.
> >
> > Note:
> > This is exactly the same as RC0, except the CHANGELOG.
> >
> > The RC is available at:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
> >
> > Git tag: release-3.3.6-RC1
> > https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
> >
> > Maven artifacts is built by x86 machine and are staged at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1380/
> >
> > My public key:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Changelog:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
> >
> > Release notes:
> > https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
> >
> > This is a relatively small release (by Hadoop standard) containing about
> > 120 commits.
> > Please give it a try, this RC vote will run for 7 days.
> >
> >
> > Feature highlights:
> >
> > SBOM artifacts
> > ----------------------------------------
> > Starting from this release, Hadoop publishes Software Bill of Materials
> > (SBOM) using
> > CycloneDX Maven plugin. For more information about SBOM, please go to
> > [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
> >
> > HDFS RBF: RDBMS based token storage support
> > ----------------------------------------
> > HDFS Router-Router Based Federation now supports storing delegation
> tokens
> > on MySQL,
> > [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> > which improves token operation through over the original Zookeeper-based
> > implementation.
> >
> >
> > New File System APIs
> > ----------------------------------------
> > [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671)
> moved a
> > number of
> > HDFS-specific APIs to Hadoop Common to make it possible for certain
> > applications that
> > depend on HDFS semantics to run on other Hadoop compatible file systems.
> >
> > In particular, recoverLease() and isFileClosed() are exposed through
> > LeaseRecoverable
> > interface. While setSafeMode() is exposed through SafeMode interface.
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
+1(binding)
* Verified signature and checksum of all source tarballs.
* Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
-DskipTests -Pnative -Pdist -Dtar`.
* Setup pseudo cluster with HDFS and YARN.
* Run simple FsShell - mkdir/put/get/mv/rm and check the result.
* Run example mr applications and check the result - Pi & wordcount.
* Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
* Checked git and JIRA using dev-support tools
`git_jira_fix_version_check.py` .
Thanks WeiChiu for your work.
NOTE: I believe the build fatal error report from me above is only related
to my own environment.
Best Regards,
- He Xiaoqiao
On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> Thanks Wei-Chiu for leading this effort !
>
> +1(Binding)
>
>
> + Verified the signature and checksum of all tarballs.
> + Started a web server and viewed documentation site.
> + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> + Launched a pseudo distributed cluster using released binary packages,
> done some HDFS dir/file basic opeations.
> + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>
> Bests,
> Sammi Chen
> ________________________________
> 发件人: Wei-Chiu Chuang <we...@apache.org>
> 发送时间: 2023年6月19日 8:52
> 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> mapreduce-dev <ma...@hadoop.apache.org>
> 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
+1(binding)
* Verified signature and checksum of all source tarballs.
* Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
-DskipTests -Pnative -Pdist -Dtar`.
* Setup pseudo cluster with HDFS and YARN.
* Run simple FsShell - mkdir/put/get/mv/rm and check the result.
* Run example mr applications and check the result - Pi & wordcount.
* Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
* Checked git and JIRA using dev-support tools
`git_jira_fix_version_check.py` .
Thanks WeiChiu for your work.
NOTE: I believe the build fatal error report from me above is only related
to my own environment.
Best Regards,
- He Xiaoqiao
On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> Thanks Wei-Chiu for leading this effort !
>
> +1(Binding)
>
>
> + Verified the signature and checksum of all tarballs.
> + Started a web server and viewed documentation site.
> + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> + Launched a pseudo distributed cluster using released binary packages,
> done some HDFS dir/file basic opeations.
> + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>
> Bests,
> Sammi Chen
> ________________________________
> 发件人: Wei-Chiu Chuang <we...@apache.org>
> 发送时间: 2023年6月19日 8:52
> 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> mapreduce-dev <ma...@hadoop.apache.org>
> 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
+1(binding)
* Verified signature and checksum of all source tarballs.
* Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
-DskipTests -Pnative -Pdist -Dtar`.
* Setup pseudo cluster with HDFS and YARN.
* Run simple FsShell - mkdir/put/get/mv/rm and check the result.
* Run example mr applications and check the result - Pi & wordcount.
* Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
* Checked git and JIRA using dev-support tools
`git_jira_fix_version_check.py` .
Thanks WeiChiu for your work.
NOTE: I believe the build fatal error report from me above is only related
to my own environment.
Best Regards,
- He Xiaoqiao
On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> Thanks Wei-Chiu for leading this effort !
>
> +1(Binding)
>
>
> + Verified the signature and checksum of all tarballs.
> + Started a web server and viewed documentation site.
> + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> + Launched a pseudo distributed cluster using released binary packages,
> done some HDFS dir/file basic opeations.
> + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>
> Bests,
> Sammi Chen
> ________________________________
> 发件人: Wei-Chiu Chuang <we...@apache.org>
> 发送时间: 2023年6月19日 8:52
> 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> mapreduce-dev <ma...@hadoop.apache.org>
> 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Xiaoqiao He <he...@apache.org>.
+1(binding)
* Verified signature and checksum of all source tarballs.
* Built source code on Ubuntu and OpenJDK 11 by `mvn clean package
-DskipTests -Pnative -Pdist -Dtar`.
* Setup pseudo cluster with HDFS and YARN.
* Run simple FsShell - mkdir/put/get/mv/rm and check the result.
* Run example mr applications and check the result - Pi & wordcount.
* Checked the Web UI of NameNode/DataNode/Resourcemanager/NodeManager etc.
* Checked git and JIRA using dev-support tools
`git_jira_fix_version_check.py` .
Thanks WeiChiu for your work.
NOTE: I believe the build fatal error report from me above is only related
to my own environment.
Best Regards,
- He Xiaoqiao
On Thu, Jun 22, 2023 at 4:17 PM Chen Yi <ch...@hotmail.com> wrote:
> Thanks Wei-Chiu for leading this effort !
>
> +1(Binding)
>
>
> + Verified the signature and checksum of all tarballs.
> + Started a web server and viewed documentation site.
> + Built from the source tarball on macOS 12.3 and OpenJDK 8.
> + Launched a pseudo distributed cluster using released binary packages,
> done some HDFS dir/file basic opeations.
> + Run grep, pi and wordcount MR tasks on the pseudo cluster.
>
> Bests,
> Sammi Chen
> ________________________________
> 发件人: Wei-Chiu Chuang <we...@apache.org>
> 发送时间: 2023年6月19日 8:52
> 收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <
> hdfs-dev@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>;
> mapreduce-dev <ma...@hadoop.apache.org>
> 主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
>
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
回复: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Chen Yi <ch...@hotmail.com>.
Thanks Wei-Chiu for leading this effort !
+1(Binding)
+ Verified the signature and checksum of all tarballs.
+ Started a web server and viewed documentation site.
+ Built from the source tarball on macOS 12.3 and OpenJDK 8.
+ Launched a pseudo distributed cluster using released binary packages, done some HDFS dir/file basic opeations.
+ Run grep, pi and wordcount MR tasks on the pseudo cluster.
Bests,
Sammi Chen
________________________________
发件人: Wei-Chiu Chuang <we...@apache.org>
发送时间: 2023年6月19日 8:52
收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>
主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
I am inviting anyone to try and vote on this release candidate.
Note:
This is exactly the same as RC0, except the CHANGELOG.
The RC is available at:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
Git tag: release-3.3.6-RC1
https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
Maven artifacts is built by x86 machine and are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1380/
My public key:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Changelog:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
Release notes:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
This is a relatively small release (by Hadoop standard) containing about
120 commits.
Please give it a try, this RC vote will run for 7 days.
Feature highlights:
SBOM artifacts
----------------------------------------
Starting from this release, Hadoop publishes Software Bill of Materials
(SBOM) using
CycloneDX Maven plugin. For more information about SBOM, please go to
[SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
HDFS RBF: RDBMS based token storage support
----------------------------------------
HDFS Router-Router Based Federation now supports storing delegation tokens
on MySQL,
[HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
which improves token operation through over the original Zookeeper-based
implementation.
New File System APIs
----------------------------------------
[HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
number of
HDFS-specific APIs to Hadoop Common to make it possible for certain
applications that
depend on HDFS semantics to run on other Hadoop compatible file systems.
In particular, recoverLease() and isFileClosed() are exposed through
LeaseRecoverable
interface. While setSafeMode() is exposed through SafeMode interface.
回复: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Chen Yi <ch...@hotmail.com>.
Thanks Wei-Chiu for leading this effort !
+1(Binding)
+ Verified the signature and checksum of all tarballs.
+ Started a web server and viewed documentation site.
+ Built from the source tarball on macOS 12.3 and OpenJDK 8.
+ Launched a pseudo distributed cluster using released binary packages, done some HDFS dir/file basic opeations.
+ Run grep, pi and wordcount MR tasks on the pseudo cluster.
Bests,
Sammi Chen
________________________________
发件人: Wei-Chiu Chuang <we...@apache.org>
发送时间: 2023年6月19日 8:52
收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>
主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
I am inviting anyone to try and vote on this release candidate.
Note:
This is exactly the same as RC0, except the CHANGELOG.
The RC is available at:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
Git tag: release-3.3.6-RC1
https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
Maven artifacts is built by x86 machine and are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1380/
My public key:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Changelog:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
Release notes:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
This is a relatively small release (by Hadoop standard) containing about
120 commits.
Please give it a try, this RC vote will run for 7 days.
Feature highlights:
SBOM artifacts
----------------------------------------
Starting from this release, Hadoop publishes Software Bill of Materials
(SBOM) using
CycloneDX Maven plugin. For more information about SBOM, please go to
[SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
HDFS RBF: RDBMS based token storage support
----------------------------------------
HDFS Router-Router Based Federation now supports storing delegation tokens
on MySQL,
[HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
which improves token operation through over the original Zookeeper-based
implementation.
New File System APIs
----------------------------------------
[HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
number of
HDFS-specific APIs to Hadoop Common to make it possible for certain
applications that
depend on HDFS semantics to run on other Hadoop compatible file systems.
In particular, recoverLease() and isFileClosed() are exposed through
LeaseRecoverable
interface. While setSafeMode() is exposed through SafeMode interface.
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Rat check (1.8.0_362): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_362): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
* Brought up pseudo-distributed mode cluster with hdfs, zk 3.7 and hbase 2.5
* Basic RBF tests look good
* S3A tests with input stream prefetch enabled: looks good
On Sun, Jun 18, 2023 at 5:53 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
回复: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Chen Yi <ch...@hotmail.com>.
Thanks Wei-Chiu for leading this effort !
+1(Binding)
+ Verified the signature and checksum of all tarballs.
+ Started a web server and viewed documentation site.
+ Built from the source tarball on macOS 12.3 and OpenJDK 8.
+ Launched a pseudo distributed cluster using released binary packages, done some HDFS dir/file basic opeations.
+ Run grep, pi and wordcount MR tasks on the pseudo cluster.
Bests,
Sammi Chen
________________________________
发件人: Wei-Chiu Chuang <we...@apache.org>
发送时间: 2023年6月19日 8:52
收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>
主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
I am inviting anyone to try and vote on this release candidate.
Note:
This is exactly the same as RC0, except the CHANGELOG.
The RC is available at:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
Git tag: release-3.3.6-RC1
https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
Maven artifacts is built by x86 machine and are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1380/
My public key:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Changelog:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
Release notes:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
This is a relatively small release (by Hadoop standard) containing about
120 commits.
Please give it a try, this RC vote will run for 7 days.
Feature highlights:
SBOM artifacts
----------------------------------------
Starting from this release, Hadoop publishes Software Bill of Materials
(SBOM) using
CycloneDX Maven plugin. For more information about SBOM, please go to
[SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
HDFS RBF: RDBMS based token storage support
----------------------------------------
HDFS Router-Router Based Federation now supports storing delegation tokens
on MySQL,
[HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
which improves token operation through over the original Zookeeper-based
implementation.
New File System APIs
----------------------------------------
[HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
number of
HDFS-specific APIs to Hadoop Common to make it possible for certain
applications that
depend on HDFS semantics to run on other Hadoop compatible file systems.
In particular, recoverLease() and isFileClosed() are exposed through
LeaseRecoverable
interface. While setSafeMode() is exposed through SafeMode interface.
回复: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Chen Yi <ch...@hotmail.com>.
Thanks Wei-Chiu for leading this effort !
+1(Binding)
+ Verified the signature and checksum of all tarballs.
+ Started a web server and viewed documentation site.
+ Built from the source tarball on macOS 12.3 and OpenJDK 8.
+ Launched a pseudo distributed cluster using released binary packages, done some HDFS dir/file basic opeations.
+ Run grep, pi and wordcount MR tasks on the pseudo cluster.
Bests,
Sammi Chen
________________________________
发件人: Wei-Chiu Chuang <we...@apache.org>
发送时间: 2023年6月19日 8:52
收件人: Hadoop Common <co...@hadoop.apache.org>; Hdfs-dev <hd...@hadoop.apache.org>; yarn-dev <ya...@hadoop.apache.org>; mapreduce-dev <ma...@hadoop.apache.org>
主题: [VOTE] Release Apache Hadoop 3.3.6 RC1
I am inviting anyone to try and vote on this release candidate.
Note:
This is exactly the same as RC0, except the CHANGELOG.
The RC is available at:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
Git tag: release-3.3.6-RC1
https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
Maven artifacts is built by x86 machine and are staged at
https://repository.apache.org/content/repositories/orgapachehadoop-1380/
My public key:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
Changelog:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
Release notes:
https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
This is a relatively small release (by Hadoop standard) containing about
120 commits.
Please give it a try, this RC vote will run for 7 days.
Feature highlights:
SBOM artifacts
----------------------------------------
Starting from this release, Hadoop publishes Software Bill of Materials
(SBOM) using
CycloneDX Maven plugin. For more information about SBOM, please go to
[SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
HDFS RBF: RDBMS based token storage support
----------------------------------------
HDFS Router-Router Based Federation now supports storing delegation tokens
on MySQL,
[HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
which improves token operation through over the original Zookeeper-based
implementation.
New File System APIs
----------------------------------------
[HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
number of
HDFS-specific APIs to Hadoop Common to make it possible for certain
applications that
depend on HDFS semantics to run on other Hadoop compatible file systems.
In particular, recoverLease() and isFileClosed() are exposed through
LeaseRecoverable
interface. While setSafeMode() is exposed through SafeMode interface.
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Rat check (1.8.0_362): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_362): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_362): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
* Brought up pseudo-distributed mode cluster with hdfs, zk 3.7 and hbase 2.5
* Basic RBF tests look good
* S3A tests with input stream prefetch enabled: looks good
On Sun, Jun 18, 2023 at 5:53 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved a
> number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
Re: [VOTE] Release Apache Hadoop 3.3.6 RC1
Posted by Wei-Chiu Chuang <we...@apache.org>.
Bumping this thread to the top.
If you are verifying the release, please vote on this thread. RC0 and RC1
are exactly the same. The only material difference is the Changelog.
Thanks!!
On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang <we...@apache.org> wrote:
> I am inviting anyone to try and vote on this release candidate.
>
> Note:
> This is exactly the same as RC0, except the CHANGELOG.
>
> The RC is available at:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64)
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64)
>
> Git tag: release-3.3.6-RC1
> https://github.com/apache/hadoop/releases/tag/release-3.3.6-RC1
>
> Maven artifacts is built by x86 machine and are staged at
> https://repository.apache.org/content/repositories/orgapachehadoop-1380/
>
> My public key:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Changelog:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/CHANGELOG.md
>
> Release notes:
> https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/RELEASENOTES.md
>
> This is a relatively small release (by Hadoop standard) containing about
> 120 commits.
> Please give it a try, this RC vote will run for 7 days.
>
>
> Feature highlights:
>
> SBOM artifacts
> ----------------------------------------
> Starting from this release, Hadoop publishes Software Bill of Materials
> (SBOM) using
> CycloneDX Maven plugin. For more information about SBOM, please go to
> [SBOM](https://cwiki.apache.org/confluence/display/COMDEV/SBOM).
>
> HDFS RBF: RDBMS based token storage support
> ----------------------------------------
> HDFS Router-Router Based Federation now supports storing delegation tokens
> on MySQL,
> [HADOOP-18535](https://issues.apache.org/jira/browse/HADOOP-18535)
> which improves token operation through over the original Zookeeper-based
> implementation.
>
>
> New File System APIs
> ----------------------------------------
> [HADOOP-18671](https://issues.apache.org/jira/browse/HADOOP-18671) moved
> a number of
> HDFS-specific APIs to Hadoop Common to make it possible for certain
> applications that
> depend on HDFS semantics to run on other Hadoop compatible file systems.
>
> In particular, recoverLease() and isFileClosed() are exposed through
> LeaseRecoverable
> interface. While setSafeMode() is exposed through SafeMode interface.
>
>
>