You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Chao Sun <su...@apache.org> on 2022/01/26 19:16:13 UTC
[VOTE] Release Apache Hadoop 3.3.2 - RC3
Hi all,
I've put together Hadoop 3.3.2 RC3 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1333
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
The only delta between this and RC2 is the addition of the following fix:
- HADOOP-18094. Disable S3A auditing by default.
I've done the same tests as in RC2 and they look good:
- Ran all the unit tests
- Started a single node HDFS cluster and tested a few simple commands
- Ran all the tests in Spark using the RC2 artifacts
Please evaluate the RC and vote, thanks!
Best,
Chao
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
maybe even before moving the catalog away, we could make it optional
On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka <aa...@apache.org> wrote:
> Thank you Masatake and Chao!
>
> On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
>
> > Thanks Masatake and Akira for discovering the issue. I used
> > `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> > -Pnative -Pdist ...` in a separate container and somehow it didn't hit
> this
> > issue.
> >
> > Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> > branch-3.3.2 and start another RC then.
> >
> > Thanks,
> > Chao
> >
> > On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> Thanks, Akira.
> >>
> >> I confirmed that the issue is fixed in current branch-3.3 containing
> >> YARN-10561.
> >>
> >> On 2022/01/28 14:25, Akira Ajisaka wrote:
> >> > Hi Masatake,
> >> >
> >> > I faced the same error in a clean environment and
> >> https://issues.apache.org/jira/browse/YARN-10561 <
> >> https://issues.apache.org/jira/browse/YARN-10561> should fix this
> issue.
> >> I'll rebase the patch shortly.
> >> >
> >> > By the way, I'm afraid there is no active maintainer in
> >> hadoop-yarn-applications-catalog module. The module is for a sample
> >> application catalog, so I think we can move the module to a separate
> >> repository. Of course, it should be discussed separately.
> >> >
> >> > Thanks and regards,
> >> > Akira
> >> >
> >> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> wrote:
> >> >
> >> > Thanks for putting this up, Chao Sun.
> >> >
> >> > I got following error on building the RC3 source tarball.
> >> > It is reproducible even in the container launched by
> >> `./start-build-env.sh`.
> >> > There seems to be no relevant diff between release-3.3.2-RC0 and
> >> release-3.3.2-RC3 (and trunk)
> >> > under hadoop-yarn-applications-catalog-webapp.
> >> >
> >> > I guess developers having caches of related artifacts under ~/.m2
> >> did not see this?
> >> >
> >> > ```
> >> > $ mvn clean install -DskipTests -Pnative -Pdist
> >> > ...
> >> > [INFO] Installing node version v8.11.3
> >> > [INFO] Downloading
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> >> > [INFO] Copying node binary from
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> >> to
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> >> > [INFO] Installed node locally.
> >> > [INFO] Installing Yarn version v1.7.0
> >> > [INFO] Downloading
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >> <
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >
> >> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> >> > [INFO] Installed Yarn locally.
> >> > [INFO]
> >> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> >> hadoop-yarn-applications-catalog-webapp ---
> >> > [INFO] testFailureIgnore property is ignored in non test phases
> >> > [INFO] Running 'yarn ' in
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> >> > [INFO] yarn install v1.7.0
> >> > [INFO] info No lockfile found.
> >> > [INFO] [1/4] Resolving packages...
> >> > [INFO] [2/4] Fetching packages...
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".info Visit
> >> https://yarnpkg.com/en/docs/cli/install <
> >> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> >> command.
> >> > [INFO] error Found incompatible module
> >> > [INFO]
> >> ------------------------------------------------------------------------
> >> > ```
> >> >
> >> > Masatake Iwasaki
> >> >
> >> >
> >> > On 2022/01/27 4:16, Chao Sun wrote:
> >> > > Hi all,
> >> > >
> >> > > I've put together Hadoop 3.3.2 RC3 below:
> >> > >
> >> > > The RC is available at:
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> >> > > The RC tag is at:
> >> > >
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> >> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> >> > > The Maven artifacts are staged at:
> >> > >
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> <
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> >> > >
> >> > > You can find my public key at:
> >> > > https://downloads.apache.org/hadoop/common/KEYS <
> >> https://downloads.apache.org/hadoop/common/KEYS>
> >> > >
> >> > > The only delta between this and RC2 is the addition of the
> >> following fix:
> >> > > - HADOOP-18094. Disable S3A auditing by default.
> >> > >
> >> > > I've done the same tests as in RC2 and they look good:
> >> > > - Ran all the unit tests
> >> > > - Started a single node HDFS cluster and tested a few simple
> >> commands
> >> > > - Ran all the tests in Spark using the RC2 artifacts
> >> > >
> >> > > Please evaluate the RC and vote, thanks!
> >> > >
> >> > > Best,
> >> > > Chao
> >> > >
> >> >
> >> >
> >> ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
maybe even before moving the catalog away, we could make it optional
On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka <aa...@apache.org> wrote:
> Thank you Masatake and Chao!
>
> On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
>
> > Thanks Masatake and Akira for discovering the issue. I used
> > `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> > -Pnative -Pdist ...` in a separate container and somehow it didn't hit
> this
> > issue.
> >
> > Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> > branch-3.3.2 and start another RC then.
> >
> > Thanks,
> > Chao
> >
> > On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> Thanks, Akira.
> >>
> >> I confirmed that the issue is fixed in current branch-3.3 containing
> >> YARN-10561.
> >>
> >> On 2022/01/28 14:25, Akira Ajisaka wrote:
> >> > Hi Masatake,
> >> >
> >> > I faced the same error in a clean environment and
> >> https://issues.apache.org/jira/browse/YARN-10561 <
> >> https://issues.apache.org/jira/browse/YARN-10561> should fix this
> issue.
> >> I'll rebase the patch shortly.
> >> >
> >> > By the way, I'm afraid there is no active maintainer in
> >> hadoop-yarn-applications-catalog module. The module is for a sample
> >> application catalog, so I think we can move the module to a separate
> >> repository. Of course, it should be discussed separately.
> >> >
> >> > Thanks and regards,
> >> > Akira
> >> >
> >> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> wrote:
> >> >
> >> > Thanks for putting this up, Chao Sun.
> >> >
> >> > I got following error on building the RC3 source tarball.
> >> > It is reproducible even in the container launched by
> >> `./start-build-env.sh`.
> >> > There seems to be no relevant diff between release-3.3.2-RC0 and
> >> release-3.3.2-RC3 (and trunk)
> >> > under hadoop-yarn-applications-catalog-webapp.
> >> >
> >> > I guess developers having caches of related artifacts under ~/.m2
> >> did not see this?
> >> >
> >> > ```
> >> > $ mvn clean install -DskipTests -Pnative -Pdist
> >> > ...
> >> > [INFO] Installing node version v8.11.3
> >> > [INFO] Downloading
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> >> > [INFO] Copying node binary from
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> >> to
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> >> > [INFO] Installed node locally.
> >> > [INFO] Installing Yarn version v1.7.0
> >> > [INFO] Downloading
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >> <
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >
> >> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> >> > [INFO] Installed Yarn locally.
> >> > [INFO]
> >> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> >> hadoop-yarn-applications-catalog-webapp ---
> >> > [INFO] testFailureIgnore property is ignored in non test phases
> >> > [INFO] Running 'yarn ' in
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> >> > [INFO] yarn install v1.7.0
> >> > [INFO] info No lockfile found.
> >> > [INFO] [1/4] Resolving packages...
> >> > [INFO] [2/4] Fetching packages...
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".info Visit
> >> https://yarnpkg.com/en/docs/cli/install <
> >> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> >> command.
> >> > [INFO] error Found incompatible module
> >> > [INFO]
> >> ------------------------------------------------------------------------
> >> > ```
> >> >
> >> > Masatake Iwasaki
> >> >
> >> >
> >> > On 2022/01/27 4:16, Chao Sun wrote:
> >> > > Hi all,
> >> > >
> >> > > I've put together Hadoop 3.3.2 RC3 below:
> >> > >
> >> > > The RC is available at:
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> >> > > The RC tag is at:
> >> > >
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> >> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> >> > > The Maven artifacts are staged at:
> >> > >
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> <
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> >> > >
> >> > > You can find my public key at:
> >> > > https://downloads.apache.org/hadoop/common/KEYS <
> >> https://downloads.apache.org/hadoop/common/KEYS>
> >> > >
> >> > > The only delta between this and RC2 is the addition of the
> >> following fix:
> >> > > - HADOOP-18094. Disable S3A auditing by default.
> >> > >
> >> > > I've done the same tests as in RC2 and they look good:
> >> > > - Ran all the unit tests
> >> > > - Started a single node HDFS cluster and tested a few simple
> >> commands
> >> > > - Ran all the tests in Spark using the RC2 artifacts
> >> > >
> >> > > Please evaluate the RC and vote, thanks!
> >> > >
> >> > > Best,
> >> > > Chao
> >> > >
> >> >
> >> >
> >> ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
maybe even before moving the catalog away, we could make it optional
On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka <aa...@apache.org> wrote:
> Thank you Masatake and Chao!
>
> On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
>
> > Thanks Masatake and Akira for discovering the issue. I used
> > `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> > -Pnative -Pdist ...` in a separate container and somehow it didn't hit
> this
> > issue.
> >
> > Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> > branch-3.3.2 and start another RC then.
> >
> > Thanks,
> > Chao
> >
> > On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> Thanks, Akira.
> >>
> >> I confirmed that the issue is fixed in current branch-3.3 containing
> >> YARN-10561.
> >>
> >> On 2022/01/28 14:25, Akira Ajisaka wrote:
> >> > Hi Masatake,
> >> >
> >> > I faced the same error in a clean environment and
> >> https://issues.apache.org/jira/browse/YARN-10561 <
> >> https://issues.apache.org/jira/browse/YARN-10561> should fix this
> issue.
> >> I'll rebase the patch shortly.
> >> >
> >> > By the way, I'm afraid there is no active maintainer in
> >> hadoop-yarn-applications-catalog module. The module is for a sample
> >> application catalog, so I think we can move the module to a separate
> >> repository. Of course, it should be discussed separately.
> >> >
> >> > Thanks and regards,
> >> > Akira
> >> >
> >> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> wrote:
> >> >
> >> > Thanks for putting this up, Chao Sun.
> >> >
> >> > I got following error on building the RC3 source tarball.
> >> > It is reproducible even in the container launched by
> >> `./start-build-env.sh`.
> >> > There seems to be no relevant diff between release-3.3.2-RC0 and
> >> release-3.3.2-RC3 (and trunk)
> >> > under hadoop-yarn-applications-catalog-webapp.
> >> >
> >> > I guess developers having caches of related artifacts under ~/.m2
> >> did not see this?
> >> >
> >> > ```
> >> > $ mvn clean install -DskipTests -Pnative -Pdist
> >> > ...
> >> > [INFO] Installing node version v8.11.3
> >> > [INFO] Downloading
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> >> > [INFO] Copying node binary from
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> >> to
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> >> > [INFO] Installed node locally.
> >> > [INFO] Installing Yarn version v1.7.0
> >> > [INFO] Downloading
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >> <
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >
> >> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> >> > [INFO] Installed Yarn locally.
> >> > [INFO]
> >> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> >> hadoop-yarn-applications-catalog-webapp ---
> >> > [INFO] testFailureIgnore property is ignored in non test phases
> >> > [INFO] Running 'yarn ' in
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> >> > [INFO] yarn install v1.7.0
> >> > [INFO] info No lockfile found.
> >> > [INFO] [1/4] Resolving packages...
> >> > [INFO] [2/4] Fetching packages...
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".info Visit
> >> https://yarnpkg.com/en/docs/cli/install <
> >> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> >> command.
> >> > [INFO] error Found incompatible module
> >> > [INFO]
> >> ------------------------------------------------------------------------
> >> > ```
> >> >
> >> > Masatake Iwasaki
> >> >
> >> >
> >> > On 2022/01/27 4:16, Chao Sun wrote:
> >> > > Hi all,
> >> > >
> >> > > I've put together Hadoop 3.3.2 RC3 below:
> >> > >
> >> > > The RC is available at:
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> >> > > The RC tag is at:
> >> > >
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> >> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> >> > > The Maven artifacts are staged at:
> >> > >
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> <
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> >> > >
> >> > > You can find my public key at:
> >> > > https://downloads.apache.org/hadoop/common/KEYS <
> >> https://downloads.apache.org/hadoop/common/KEYS>
> >> > >
> >> > > The only delta between this and RC2 is the addition of the
> >> following fix:
> >> > > - HADOOP-18094. Disable S3A auditing by default.
> >> > >
> >> > > I've done the same tests as in RC2 and they look good:
> >> > > - Ran all the unit tests
> >> > > - Started a single node HDFS cluster and tested a few simple
> >> commands
> >> > > - Ran all the tests in Spark using the RC2 artifacts
> >> > >
> >> > > Please evaluate the RC and vote, thanks!
> >> > >
> >> > > Best,
> >> > > Chao
> >> > >
> >> >
> >> >
> >> ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Steve Loughran <st...@cloudera.com.INVALID>.
maybe even before moving the catalog away, we could make it optional
On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka <aa...@apache.org> wrote:
> Thank you Masatake and Chao!
>
> On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
>
> > Thanks Masatake and Akira for discovering the issue. I used
> > `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> > -Pnative -Pdist ...` in a separate container and somehow it didn't hit
> this
> > issue.
> >
> > Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> > branch-3.3.2 and start another RC then.
> >
> > Thanks,
> > Chao
> >
> > On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> Thanks, Akira.
> >>
> >> I confirmed that the issue is fixed in current branch-3.3 containing
> >> YARN-10561.
> >>
> >> On 2022/01/28 14:25, Akira Ajisaka wrote:
> >> > Hi Masatake,
> >> >
> >> > I faced the same error in a clean environment and
> >> https://issues.apache.org/jira/browse/YARN-10561 <
> >> https://issues.apache.org/jira/browse/YARN-10561> should fix this
> issue.
> >> I'll rebase the patch shortly.
> >> >
> >> > By the way, I'm afraid there is no active maintainer in
> >> hadoop-yarn-applications-catalog module. The module is for a sample
> >> application catalog, so I think we can move the module to a separate
> >> repository. Of course, it should be discussed separately.
> >> >
> >> > Thanks and regards,
> >> > Akira
> >> >
> >> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> >> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> wrote:
> >> >
> >> > Thanks for putting this up, Chao Sun.
> >> >
> >> > I got following error on building the RC3 source tarball.
> >> > It is reproducible even in the container launched by
> >> `./start-build-env.sh`.
> >> > There seems to be no relevant diff between release-3.3.2-RC0 and
> >> release-3.3.2-RC3 (and trunk)
> >> > under hadoop-yarn-applications-catalog-webapp.
> >> >
> >> > I guess developers having caches of related artifacts under ~/.m2
> >> did not see this?
> >> >
> >> > ```
> >> > $ mvn clean install -DskipTests -Pnative -Pdist
> >> > ...
> >> > [INFO] Installing node version v8.11.3
> >> > [INFO] Downloading
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> >> > [INFO] Copying node binary from
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> >> to
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> >> > [INFO] Installed node locally.
> >> > [INFO] Installing Yarn version v1.7.0
> >> > [INFO] Downloading
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >> <
> >>
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> >
> >> to
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> > [INFO] No proxies configured
> >> > [INFO] No proxy was configured, downloading directly
> >> > [INFO] Unpacking
> >>
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> >> into
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> >> > [INFO] Installed Yarn locally.
> >> > [INFO]
> >> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> >> hadoop-yarn-applications-catalog-webapp ---
> >> > [INFO] testFailureIgnore property is ignored in non test phases
> >> > [INFO] Running 'yarn ' in
> >>
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> >> > [INFO] yarn install v1.7.0
> >> > [INFO] info No lockfile found.
> >> > [INFO] [1/4] Resolving packages...
> >> > [INFO] [2/4] Fetching packages...
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".
> >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> >> incompatible with this module. Expected version ">=10".info Visit
> >> https://yarnpkg.com/en/docs/cli/install <
> >> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> >> command.
> >> > [INFO] error Found incompatible module
> >> > [INFO]
> >> ------------------------------------------------------------------------
> >> > ```
> >> >
> >> > Masatake Iwasaki
> >> >
> >> >
> >> > On 2022/01/27 4:16, Chao Sun wrote:
> >> > > Hi all,
> >> > >
> >> > > I've put together Hadoop 3.3.2 RC3 below:
> >> > >
> >> > > The RC is available at:
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> >> > > The RC tag is at:
> >> > >
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> >> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> >> > > The Maven artifacts are staged at:
> >> > >
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> <
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> >> > >
> >> > > You can find my public key at:
> >> > > https://downloads.apache.org/hadoop/common/KEYS <
> >> https://downloads.apache.org/hadoop/common/KEYS>
> >> > >
> >> > > The only delta between this and RC2 is the addition of the
> >> following fix:
> >> > > - HADOOP-18094. Disable S3A auditing by default.
> >> > >
> >> > > I've done the same tests as in RC2 and they look good:
> >> > > - Ran all the unit tests
> >> > > - Started a single node HDFS cluster and tested a few simple
> >> commands
> >> > > - Ran all the tests in Spark using the RC2 artifacts
> >> > >
> >> > > Please evaluate the RC and vote, thanks!
> >> > >
> >> > > Best,
> >> > > Chao
> >> > >
> >> >
> >> >
> >> ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >> <ma...@hadoop.apache.org>
> >> >
> >>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Thank you Masatake and Chao!
On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
> Thanks Masatake and Akira for discovering the issue. I used
> `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> -Pnative -Pdist ...` in a separate container and somehow it didn't hit this
> issue.
>
> Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> branch-3.3.2 and start another RC then.
>
> Thanks,
> Chao
>
> On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> Thanks, Akira.
>>
>> I confirmed that the issue is fixed in current branch-3.3 containing
>> YARN-10561.
>>
>> On 2022/01/28 14:25, Akira Ajisaka wrote:
>> > Hi Masatake,
>> >
>> > I faced the same error in a clean environment and
>> https://issues.apache.org/jira/browse/YARN-10561 <
>> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
>> I'll rebase the patch shortly.
>> >
>> > By the way, I'm afraid there is no active maintainer in
>> hadoop-yarn-applications-catalog module. The module is for a sample
>> application catalog, so I think we can move the module to a separate
>> repository. Of course, it should be discussed separately.
>> >
>> > Thanks and regards,
>> > Akira
>> >
>> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>> >
>> > Thanks for putting this up, Chao Sun.
>> >
>> > I got following error on building the RC3 source tarball.
>> > It is reproducible even in the container launched by
>> `./start-build-env.sh`.
>> > There seems to be no relevant diff between release-3.3.2-RC0 and
>> release-3.3.2-RC3 (and trunk)
>> > under hadoop-yarn-applications-catalog-webapp.
>> >
>> > I guess developers having caches of related artifacts under ~/.m2
>> did not see this?
>> >
>> > ```
>> > $ mvn clean install -DskipTests -Pnative -Pdist
>> > ...
>> > [INFO] Installing node version v8.11.3
>> > [INFO] Downloading
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
>> > [INFO] Copying node binary from
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
>> to
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
>> > [INFO] Installed node locally.
>> > [INFO] Installing Yarn version v1.7.0
>> > [INFO] Downloading
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
>> <
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
>> to
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
>> > [INFO] Installed Yarn locally.
>> > [INFO]
>> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
>> hadoop-yarn-applications-catalog-webapp ---
>> > [INFO] testFailureIgnore property is ignored in non test phases
>> > [INFO] Running 'yarn ' in
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
>> > [INFO] yarn install v1.7.0
>> > [INFO] info No lockfile found.
>> > [INFO] [1/4] Resolving packages...
>> > [INFO] [2/4] Fetching packages...
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".info Visit
>> https://yarnpkg.com/en/docs/cli/install <
>> https://yarnpkg.com/en/docs/cli/install> for documentation about this
>> command.
>> > [INFO] error Found incompatible module
>> > [INFO]
>> ------------------------------------------------------------------------
>> > ```
>> >
>> > Masatake Iwasaki
>> >
>> >
>> > On 2022/01/27 4:16, Chao Sun wrote:
>> > > Hi all,
>> > >
>> > > I've put together Hadoop 3.3.2 RC3 below:
>> > >
>> > > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
>> > > The RC tag is at:
>> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
>> > > The Maven artifacts are staged at:
>> > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
>> > >
>> > > You can find my public key at:
>> > > https://downloads.apache.org/hadoop/common/KEYS <
>> https://downloads.apache.org/hadoop/common/KEYS>
>> > >
>> > > The only delta between this and RC2 is the addition of the
>> following fix:
>> > > - HADOOP-18094. Disable S3A auditing by default.
>> > >
>> > > I've done the same tests as in RC2 and they look good:
>> > > - Ran all the unit tests
>> > > - Started a single node HDFS cluster and tested a few simple
>> commands
>> > > - Ran all the tests in Spark using the RC2 artifacts
>> > >
>> > > Please evaluate the RC and vote, thanks!
>> > >
>> > > Best,
>> > > Chao
>> > >
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Thank you Masatake and Chao!
On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
> Thanks Masatake and Akira for discovering the issue. I used
> `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> -Pnative -Pdist ...` in a separate container and somehow it didn't hit this
> issue.
>
> Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> branch-3.3.2 and start another RC then.
>
> Thanks,
> Chao
>
> On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> Thanks, Akira.
>>
>> I confirmed that the issue is fixed in current branch-3.3 containing
>> YARN-10561.
>>
>> On 2022/01/28 14:25, Akira Ajisaka wrote:
>> > Hi Masatake,
>> >
>> > I faced the same error in a clean environment and
>> https://issues.apache.org/jira/browse/YARN-10561 <
>> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
>> I'll rebase the patch shortly.
>> >
>> > By the way, I'm afraid there is no active maintainer in
>> hadoop-yarn-applications-catalog module. The module is for a sample
>> application catalog, so I think we can move the module to a separate
>> repository. Of course, it should be discussed separately.
>> >
>> > Thanks and regards,
>> > Akira
>> >
>> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>> >
>> > Thanks for putting this up, Chao Sun.
>> >
>> > I got following error on building the RC3 source tarball.
>> > It is reproducible even in the container launched by
>> `./start-build-env.sh`.
>> > There seems to be no relevant diff between release-3.3.2-RC0 and
>> release-3.3.2-RC3 (and trunk)
>> > under hadoop-yarn-applications-catalog-webapp.
>> >
>> > I guess developers having caches of related artifacts under ~/.m2
>> did not see this?
>> >
>> > ```
>> > $ mvn clean install -DskipTests -Pnative -Pdist
>> > ...
>> > [INFO] Installing node version v8.11.3
>> > [INFO] Downloading
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
>> > [INFO] Copying node binary from
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
>> to
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
>> > [INFO] Installed node locally.
>> > [INFO] Installing Yarn version v1.7.0
>> > [INFO] Downloading
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
>> <
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
>> to
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
>> > [INFO] Installed Yarn locally.
>> > [INFO]
>> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
>> hadoop-yarn-applications-catalog-webapp ---
>> > [INFO] testFailureIgnore property is ignored in non test phases
>> > [INFO] Running 'yarn ' in
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
>> > [INFO] yarn install v1.7.0
>> > [INFO] info No lockfile found.
>> > [INFO] [1/4] Resolving packages...
>> > [INFO] [2/4] Fetching packages...
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".info Visit
>> https://yarnpkg.com/en/docs/cli/install <
>> https://yarnpkg.com/en/docs/cli/install> for documentation about this
>> command.
>> > [INFO] error Found incompatible module
>> > [INFO]
>> ------------------------------------------------------------------------
>> > ```
>> >
>> > Masatake Iwasaki
>> >
>> >
>> > On 2022/01/27 4:16, Chao Sun wrote:
>> > > Hi all,
>> > >
>> > > I've put together Hadoop 3.3.2 RC3 below:
>> > >
>> > > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
>> > > The RC tag is at:
>> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
>> > > The Maven artifacts are staged at:
>> > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
>> > >
>> > > You can find my public key at:
>> > > https://downloads.apache.org/hadoop/common/KEYS <
>> https://downloads.apache.org/hadoop/common/KEYS>
>> > >
>> > > The only delta between this and RC2 is the addition of the
>> following fix:
>> > > - HADOOP-18094. Disable S3A auditing by default.
>> > >
>> > > I've done the same tests as in RC2 and they look good:
>> > > - Ran all the unit tests
>> > > - Started a single node HDFS cluster and tested a few simple
>> commands
>> > > - Ran all the tests in Spark using the RC2 artifacts
>> > >
>> > > Please evaluate the RC and vote, thanks!
>> > >
>> > > Best,
>> > > Chao
>> > >
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Thank you Masatake and Chao!
On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
> Thanks Masatake and Akira for discovering the issue. I used
> `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> -Pnative -Pdist ...` in a separate container and somehow it didn't hit this
> issue.
>
> Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> branch-3.3.2 and start another RC then.
>
> Thanks,
> Chao
>
> On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> Thanks, Akira.
>>
>> I confirmed that the issue is fixed in current branch-3.3 containing
>> YARN-10561.
>>
>> On 2022/01/28 14:25, Akira Ajisaka wrote:
>> > Hi Masatake,
>> >
>> > I faced the same error in a clean environment and
>> https://issues.apache.org/jira/browse/YARN-10561 <
>> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
>> I'll rebase the patch shortly.
>> >
>> > By the way, I'm afraid there is no active maintainer in
>> hadoop-yarn-applications-catalog module. The module is for a sample
>> application catalog, so I think we can move the module to a separate
>> repository. Of course, it should be discussed separately.
>> >
>> > Thanks and regards,
>> > Akira
>> >
>> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>> >
>> > Thanks for putting this up, Chao Sun.
>> >
>> > I got following error on building the RC3 source tarball.
>> > It is reproducible even in the container launched by
>> `./start-build-env.sh`.
>> > There seems to be no relevant diff between release-3.3.2-RC0 and
>> release-3.3.2-RC3 (and trunk)
>> > under hadoop-yarn-applications-catalog-webapp.
>> >
>> > I guess developers having caches of related artifacts under ~/.m2
>> did not see this?
>> >
>> > ```
>> > $ mvn clean install -DskipTests -Pnative -Pdist
>> > ...
>> > [INFO] Installing node version v8.11.3
>> > [INFO] Downloading
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
>> > [INFO] Copying node binary from
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
>> to
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
>> > [INFO] Installed node locally.
>> > [INFO] Installing Yarn version v1.7.0
>> > [INFO] Downloading
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
>> <
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
>> to
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
>> > [INFO] Installed Yarn locally.
>> > [INFO]
>> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
>> hadoop-yarn-applications-catalog-webapp ---
>> > [INFO] testFailureIgnore property is ignored in non test phases
>> > [INFO] Running 'yarn ' in
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
>> > [INFO] yarn install v1.7.0
>> > [INFO] info No lockfile found.
>> > [INFO] [1/4] Resolving packages...
>> > [INFO] [2/4] Fetching packages...
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".info Visit
>> https://yarnpkg.com/en/docs/cli/install <
>> https://yarnpkg.com/en/docs/cli/install> for documentation about this
>> command.
>> > [INFO] error Found incompatible module
>> > [INFO]
>> ------------------------------------------------------------------------
>> > ```
>> >
>> > Masatake Iwasaki
>> >
>> >
>> > On 2022/01/27 4:16, Chao Sun wrote:
>> > > Hi all,
>> > >
>> > > I've put together Hadoop 3.3.2 RC3 below:
>> > >
>> > > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
>> > > The RC tag is at:
>> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
>> > > The Maven artifacts are staged at:
>> > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
>> > >
>> > > You can find my public key at:
>> > > https://downloads.apache.org/hadoop/common/KEYS <
>> https://downloads.apache.org/hadoop/common/KEYS>
>> > >
>> > > The only delta between this and RC2 is the addition of the
>> following fix:
>> > > - HADOOP-18094. Disable S3A auditing by default.
>> > >
>> > > I've done the same tests as in RC2 and they look good:
>> > > - Ran all the unit tests
>> > > - Started a single node HDFS cluster and tested a few simple
>> commands
>> > > - Ran all the tests in Spark using the RC2 artifacts
>> > >
>> > > Please evaluate the RC and vote, thanks!
>> > >
>> > > Best,
>> > > Chao
>> > >
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Thank you Masatake and Chao!
On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <su...@apache.org> wrote:
> Thanks Masatake and Akira for discovering the issue. I used
> `dev-support/bin/create-release` which runs `mvn deploy -DskipTests
> -Pnative -Pdist ...` in a separate container and somehow it didn't hit this
> issue.
>
> Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
> branch-3.3.2 and start another RC then.
>
> Thanks,
> Chao
>
> On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> Thanks, Akira.
>>
>> I confirmed that the issue is fixed in current branch-3.3 containing
>> YARN-10561.
>>
>> On 2022/01/28 14:25, Akira Ajisaka wrote:
>> > Hi Masatake,
>> >
>> > I faced the same error in a clean environment and
>> https://issues.apache.org/jira/browse/YARN-10561 <
>> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
>> I'll rebase the patch shortly.
>> >
>> > By the way, I'm afraid there is no active maintainer in
>> hadoop-yarn-applications-catalog module. The module is for a sample
>> application catalog, so I think we can move the module to a separate
>> repository. Of course, it should be discussed separately.
>> >
>> > Thanks and regards,
>> > Akira
>> >
>> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>> >
>> > Thanks for putting this up, Chao Sun.
>> >
>> > I got following error on building the RC3 source tarball.
>> > It is reproducible even in the container launched by
>> `./start-build-env.sh`.
>> > There seems to be no relevant diff between release-3.3.2-RC0 and
>> release-3.3.2-RC3 (and trunk)
>> > under hadoop-yarn-applications-catalog-webapp.
>> >
>> > I guess developers having caches of related artifacts under ~/.m2
>> did not see this?
>> >
>> > ```
>> > $ mvn clean install -DskipTests -Pnative -Pdist
>> > ...
>> > [INFO] Installing node version v8.11.3
>> > [INFO] Downloading
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
>> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
>> > [INFO] Copying node binary from
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
>> to
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
>> > [INFO] Installed node locally.
>> > [INFO] Installing Yarn version v1.7.0
>> > [INFO] Downloading
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
>> <
>> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
>> to
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> > [INFO] No proxies configured
>> > [INFO] No proxy was configured, downloading directly
>> > [INFO] Unpacking
>> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
>> into
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
>> > [INFO] Installed Yarn locally.
>> > [INFO]
>> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
>> hadoop-yarn-applications-catalog-webapp ---
>> > [INFO] testFailureIgnore property is ignored in non test phases
>> > [INFO] Running 'yarn ' in
>> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
>> > [INFO] yarn install v1.7.0
>> > [INFO] info No lockfile found.
>> > [INFO] [1/4] Resolving packages...
>> > [INFO] [2/4] Fetching packages...
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".
>> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
>> incompatible with this module. Expected version ">=10".info Visit
>> https://yarnpkg.com/en/docs/cli/install <
>> https://yarnpkg.com/en/docs/cli/install> for documentation about this
>> command.
>> > [INFO] error Found incompatible module
>> > [INFO]
>> ------------------------------------------------------------------------
>> > ```
>> >
>> > Masatake Iwasaki
>> >
>> >
>> > On 2022/01/27 4:16, Chao Sun wrote:
>> > > Hi all,
>> > >
>> > > I've put together Hadoop 3.3.2 RC3 below:
>> > >
>> > > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
>> > > The RC tag is at:
>> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
>> > > The Maven artifacts are staged at:
>> > >
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
>> > >
>> > > You can find my public key at:
>> > > https://downloads.apache.org/hadoop/common/KEYS <
>> https://downloads.apache.org/hadoop/common/KEYS>
>> > >
>> > > The only delta between this and RC2 is the addition of the
>> following fix:
>> > > - HADOOP-18094. Disable S3A auditing by default.
>> > >
>> > > I've done the same tests as in RC2 and they look good:
>> > > - Ran all the unit tests
>> > > - Started a single node HDFS cluster and tested a few simple
>> commands
>> > > - Ran all the tests in Spark using the RC2 artifacts
>> > >
>> > > Please evaluate the RC and vote, thanks!
>> > >
>> > > Best,
>> > > Chao
>> > >
>> >
>> >
>> ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>> <ma...@hadoop.apache.org>
>> >
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Chao Sun <su...@apache.org>.
Thanks Masatake and Akira for discovering the issue. I used
`dev-support/bin/create-release` which runs `mvn deploy -DskipTests
-Pnative -Pdist ...` in a separate container and somehow it didn't hit this
issue.
Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
branch-3.3.2 and start another RC then.
Thanks,
Chao
On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks, Akira.
>
> I confirmed that the issue is fixed in current branch-3.3 containing
> YARN-10561.
>
> On 2022/01/28 14:25, Akira Ajisaka wrote:
> > Hi Masatake,
> >
> > I faced the same error in a clean environment and
> https://issues.apache.org/jira/browse/YARN-10561 <
> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
> I'll rebase the patch shortly.
> >
> > By the way, I'm afraid there is no active maintainer in
> hadoop-yarn-applications-catalog module. The module is for a sample
> application catalog, so I think we can move the module to a separate
> repository. Of course, it should be discussed separately.
> >
> > Thanks and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building the RC3 source tarball.
> > It is reproducible even in the container launched by
> `./start-build-env.sh`.
> > There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> > under hadoop-yarn-applications-catalog-webapp.
> >
> > I guess developers having caches of related artifacts under ~/.m2
> did not see this?
> >
> > ```
> > $ mvn clean install -DskipTests -Pnative -Pdist
> > ...
> > [INFO] Installing node version v8.11.3
> > [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> > [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> > [INFO] Installed node locally.
> > [INFO] Installing Yarn version v1.7.0
> > [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> <
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> > [INFO] Installed Yarn locally.
> > [INFO]
> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> > [INFO] testFailureIgnore property is ignored in non test phases
> > [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> > [INFO] yarn install v1.7.0
> > [INFO] info No lockfile found.
> > [INFO] [1/4] Resolving packages...
> > [INFO] [2/4] Fetching packages...
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install <
> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> command.
> > [INFO] error Found incompatible module
> > [INFO]
> ------------------------------------------------------------------------
> > ```
> >
> > Masatake Iwasaki
> >
> >
> > On 2022/01/27 4:16, Chao Sun wrote:
> > > Hi all,
> > >
> > > I've put together Hadoop 3.3.2 RC3 below:
> > >
> > > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > > The RC tag is at:
> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > > The Maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> > >
> > > You can find my public key at:
> > > https://downloads.apache.org/hadoop/common/KEYS <
> https://downloads.apache.org/hadoop/common/KEYS>
> > >
> > > The only delta between this and RC2 is the addition of the
> following fix:
> > > - HADOOP-18094. Disable S3A auditing by default.
> > >
> > > I've done the same tests as in RC2 and they look good:
> > > - Ran all the unit tests
> > > - Started a single node HDFS cluster and tested a few simple
> commands
> > > - Ran all the tests in Spark using the RC2 artifacts
> > >
> > > Please evaluate the RC and vote, thanks!
> > >
> > > Best,
> > > Chao
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Chao Sun <su...@apache.org>.
Thanks Masatake and Akira for discovering the issue. I used
`dev-support/bin/create-release` which runs `mvn deploy -DskipTests
-Pnative -Pdist ...` in a separate container and somehow it didn't hit this
issue.
Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
branch-3.3.2 and start another RC then.
Thanks,
Chao
On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks, Akira.
>
> I confirmed that the issue is fixed in current branch-3.3 containing
> YARN-10561.
>
> On 2022/01/28 14:25, Akira Ajisaka wrote:
> > Hi Masatake,
> >
> > I faced the same error in a clean environment and
> https://issues.apache.org/jira/browse/YARN-10561 <
> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
> I'll rebase the patch shortly.
> >
> > By the way, I'm afraid there is no active maintainer in
> hadoop-yarn-applications-catalog module. The module is for a sample
> application catalog, so I think we can move the module to a separate
> repository. Of course, it should be discussed separately.
> >
> > Thanks and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building the RC3 source tarball.
> > It is reproducible even in the container launched by
> `./start-build-env.sh`.
> > There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> > under hadoop-yarn-applications-catalog-webapp.
> >
> > I guess developers having caches of related artifacts under ~/.m2
> did not see this?
> >
> > ```
> > $ mvn clean install -DskipTests -Pnative -Pdist
> > ...
> > [INFO] Installing node version v8.11.3
> > [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> > [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> > [INFO] Installed node locally.
> > [INFO] Installing Yarn version v1.7.0
> > [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> <
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> > [INFO] Installed Yarn locally.
> > [INFO]
> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> > [INFO] testFailureIgnore property is ignored in non test phases
> > [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> > [INFO] yarn install v1.7.0
> > [INFO] info No lockfile found.
> > [INFO] [1/4] Resolving packages...
> > [INFO] [2/4] Fetching packages...
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install <
> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> command.
> > [INFO] error Found incompatible module
> > [INFO]
> ------------------------------------------------------------------------
> > ```
> >
> > Masatake Iwasaki
> >
> >
> > On 2022/01/27 4:16, Chao Sun wrote:
> > > Hi all,
> > >
> > > I've put together Hadoop 3.3.2 RC3 below:
> > >
> > > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > > The RC tag is at:
> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > > The Maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> > >
> > > You can find my public key at:
> > > https://downloads.apache.org/hadoop/common/KEYS <
> https://downloads.apache.org/hadoop/common/KEYS>
> > >
> > > The only delta between this and RC2 is the addition of the
> following fix:
> > > - HADOOP-18094. Disable S3A auditing by default.
> > >
> > > I've done the same tests as in RC2 and they look good:
> > > - Ran all the unit tests
> > > - Started a single node HDFS cluster and tested a few simple
> commands
> > > - Ran all the tests in Spark using the RC2 artifacts
> > >
> > > Please evaluate the RC and vote, thanks!
> > >
> > > Best,
> > > Chao
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Chao Sun <su...@apache.org>.
Thanks Masatake and Akira for discovering the issue. I used
`dev-support/bin/create-release` which runs `mvn deploy -DskipTests
-Pnative -Pdist ...` in a separate container and somehow it didn't hit this
issue.
Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
branch-3.3.2 and start another RC then.
Thanks,
Chao
On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks, Akira.
>
> I confirmed that the issue is fixed in current branch-3.3 containing
> YARN-10561.
>
> On 2022/01/28 14:25, Akira Ajisaka wrote:
> > Hi Masatake,
> >
> > I faced the same error in a clean environment and
> https://issues.apache.org/jira/browse/YARN-10561 <
> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
> I'll rebase the patch shortly.
> >
> > By the way, I'm afraid there is no active maintainer in
> hadoop-yarn-applications-catalog module. The module is for a sample
> application catalog, so I think we can move the module to a separate
> repository. Of course, it should be discussed separately.
> >
> > Thanks and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building the RC3 source tarball.
> > It is reproducible even in the container launched by
> `./start-build-env.sh`.
> > There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> > under hadoop-yarn-applications-catalog-webapp.
> >
> > I guess developers having caches of related artifacts under ~/.m2
> did not see this?
> >
> > ```
> > $ mvn clean install -DskipTests -Pnative -Pdist
> > ...
> > [INFO] Installing node version v8.11.3
> > [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> > [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> > [INFO] Installed node locally.
> > [INFO] Installing Yarn version v1.7.0
> > [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> <
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> > [INFO] Installed Yarn locally.
> > [INFO]
> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> > [INFO] testFailureIgnore property is ignored in non test phases
> > [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> > [INFO] yarn install v1.7.0
> > [INFO] info No lockfile found.
> > [INFO] [1/4] Resolving packages...
> > [INFO] [2/4] Fetching packages...
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install <
> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> command.
> > [INFO] error Found incompatible module
> > [INFO]
> ------------------------------------------------------------------------
> > ```
> >
> > Masatake Iwasaki
> >
> >
> > On 2022/01/27 4:16, Chao Sun wrote:
> > > Hi all,
> > >
> > > I've put together Hadoop 3.3.2 RC3 below:
> > >
> > > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > > The RC tag is at:
> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > > The Maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> > >
> > > You can find my public key at:
> > > https://downloads.apache.org/hadoop/common/KEYS <
> https://downloads.apache.org/hadoop/common/KEYS>
> > >
> > > The only delta between this and RC2 is the addition of the
> following fix:
> > > - HADOOP-18094. Disable S3A auditing by default.
> > >
> > > I've done the same tests as in RC2 and they look good:
> > > - Ran all the unit tests
> > > - Started a single node HDFS cluster and tested a few simple
> commands
> > > - Ran all the tests in Spark using the RC2 artifacts
> > >
> > > Please evaluate the RC and vote, thanks!
> > >
> > > Best,
> > > Chao
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Chao Sun <su...@apache.org>.
Thanks Masatake and Akira for discovering the issue. I used
`dev-support/bin/create-release` which runs `mvn deploy -DskipTests
-Pnative -Pdist ...` in a separate container and somehow it didn't hit this
issue.
Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to
branch-3.3.2 and start another RC then.
Thanks,
Chao
On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks, Akira.
>
> I confirmed that the issue is fixed in current branch-3.3 containing
> YARN-10561.
>
> On 2022/01/28 14:25, Akira Ajisaka wrote:
> > Hi Masatake,
> >
> > I faced the same error in a clean environment and
> https://issues.apache.org/jira/browse/YARN-10561 <
> https://issues.apache.org/jira/browse/YARN-10561> should fix this issue.
> I'll rebase the patch shortly.
> >
> > By the way, I'm afraid there is no active maintainer in
> hadoop-yarn-applications-catalog module. The module is for a sample
> application catalog, so I think we can move the module to a separate
> repository. Of course, it should be discussed separately.
> >
> > Thanks and regards,
> > Akira
> >
> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Thanks for putting this up, Chao Sun.
> >
> > I got following error on building the RC3 source tarball.
> > It is reproducible even in the container launched by
> `./start-build-env.sh`.
> > There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> > under hadoop-yarn-applications-catalog-webapp.
> >
> > I guess developers having caches of related artifacts under ~/.m2
> did not see this?
> >
> > ```
> > $ mvn clean install -DskipTests -Pnative -Pdist
> > ...
> > [INFO] Installing node version v8.11.3
> > [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> > [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> > [INFO] Installed node locally.
> > [INFO] Installing Yarn version v1.7.0
> > [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> <
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz>
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> > [INFO] No proxies configured
> > [INFO] No proxy was configured, downloading directly
> > [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> > [INFO] Installed Yarn locally.
> > [INFO]
> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> > [INFO] testFailureIgnore property is ignored in non test phases
> > [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> > [INFO] yarn install v1.7.0
> > [INFO] info No lockfile found.
> > [INFO] [1/4] Resolving packages...
> > [INFO] [2/4] Fetching packages...
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install <
> https://yarnpkg.com/en/docs/cli/install> for documentation about this
> command.
> > [INFO] error Found incompatible module
> > [INFO]
> ------------------------------------------------------------------------
> > ```
> >
> > Masatake Iwasaki
> >
> >
> > On 2022/01/27 4:16, Chao Sun wrote:
> > > Hi all,
> > >
> > > I've put together Hadoop 3.3.2 RC3 below:
> > >
> > > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > > The RC tag is at:
> > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > > The Maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1333 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> > >
> > > You can find my public key at:
> > > https://downloads.apache.org/hadoop/common/KEYS <
> https://downloads.apache.org/hadoop/common/KEYS>
> > >
> > > The only delta between this and RC2 is the addition of the
> following fix:
> > > - HADOOP-18094. Disable S3A auditing by default.
> > >
> > > I've done the same tests as in RC2 and they look good:
> > > - Ran all the unit tests
> > > - Started a single node HDFS cluster and tested a few simple
> commands
> > > - Ran all the tests in Spark using the RC2 artifacts
> > >
> > > Please evaluate the RC and vote, thanks!
> > >
> > > Best,
> > > Chao
> > >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks, Akira.
I confirmed that the issue is fixed in current branch-3.3 containing YARN-10561.
On 2022/01/28 14:25, Akira Ajisaka wrote:
> Hi Masatake,
>
> I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 <https://issues.apache.org/jira/browse/YARN-10561> should fix this issue. I'll rebase the patch shortly.
>
> By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample application catalog, so I think we can move the module to a separate repository. Of course, it should be discussed separately.
>
> Thanks and regards,
> Akira
>
> On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz <https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install <https://yarnpkg.com/en/docs/cli/install> for documentation about this command.
> [INFO] error Found incompatible module
> [INFO] ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333 <https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks, Akira.
I confirmed that the issue is fixed in current branch-3.3 containing YARN-10561.
On 2022/01/28 14:25, Akira Ajisaka wrote:
> Hi Masatake,
>
> I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 <https://issues.apache.org/jira/browse/YARN-10561> should fix this issue. I'll rebase the patch shortly.
>
> By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample application catalog, so I think we can move the module to a separate repository. Of course, it should be discussed separately.
>
> Thanks and regards,
> Akira
>
> On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz <https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install <https://yarnpkg.com/en/docs/cli/install> for documentation about this command.
> [INFO] error Found incompatible module
> [INFO] ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333 <https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks, Akira.
I confirmed that the issue is fixed in current branch-3.3 containing YARN-10561.
On 2022/01/28 14:25, Akira Ajisaka wrote:
> Hi Masatake,
>
> I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 <https://issues.apache.org/jira/browse/YARN-10561> should fix this issue. I'll rebase the patch shortly.
>
> By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample application catalog, so I think we can move the module to a separate repository. Of course, it should be discussed separately.
>
> Thanks and regards,
> Akira
>
> On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz <https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install <https://yarnpkg.com/en/docs/cli/install> for documentation about this command.
> [INFO] error Found incompatible module
> [INFO] ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333 <https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks, Akira.
I confirmed that the issue is fixed in current branch-3.3 containing YARN-10561.
On 2022/01/28 14:25, Akira Ajisaka wrote:
> Hi Masatake,
>
> I faced the same error in a clean environment and https://issues.apache.org/jira/browse/YARN-10561 <https://issues.apache.org/jira/browse/YARN-10561> should fix this issue. I'll rebase the patch shortly.
>
> By the way, I'm afraid there is no active maintainer in hadoop-yarn-applications-catalog module. The module is for a sample application catalog, so I think we can move the module to a separate repository. Of course, it should be discussed separately.
>
> Thanks and regards,
> Akira
>
> On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz <https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz <https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz> to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install <https://yarnpkg.com/en/docs/cli/install> for documentation about this command.
> [INFO] error Found incompatible module
> [INFO] ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ <http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/>
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3>
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333 <https://repository.apache.org/content/repositories/orgapachehadoop-1333>
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Masatake,
I faced the same error in a clean environment and
https://issues.apache.org/jira/browse/YARN-10561 should fix this issue.
I'll rebase the patch shortly.
By the way, I'm afraid there is no active maintainer in
hadoop-yarn-applications-catalog module. The module is for a sample
application catalog, so I think we can move the module to a separate
repository. Of course, it should be discussed separately.
Thanks and regards,
Akira
On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by
> `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not
> see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install for documentation about this
> command.
> [INFO] error Found incompatible module
> [INFO]
> ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Masatake,
I faced the same error in a clean environment and
https://issues.apache.org/jira/browse/YARN-10561 should fix this issue.
I'll rebase the patch shortly.
By the way, I'm afraid there is no active maintainer in
hadoop-yarn-applications-catalog module. The module is for a sample
application catalog, so I think we can move the module to a separate
repository. Of course, it should be discussed separately.
Thanks and regards,
Akira
On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by
> `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not
> see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install for documentation about this
> command.
> [INFO] error Found incompatible module
> [INFO]
> ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Masatake,
I faced the same error in a clean environment and
https://issues.apache.org/jira/browse/YARN-10561 should fix this issue.
I'll rebase the patch shortly.
By the way, I'm afraid there is no active maintainer in
hadoop-yarn-applications-catalog module. The module is for a sample
application catalog, so I think we can move the module to a separate
repository. Of course, it should be discussed separately.
Thanks and regards,
Akira
On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by
> `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not
> see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install for documentation about this
> command.
> [INFO] error Found incompatible module
> [INFO]
> ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Masatake,
I faced the same error in a clean environment and
https://issues.apache.org/jira/browse/YARN-10561 should fix this issue.
I'll rebase the patch shortly.
By the way, I'm afraid there is no active maintainer in
hadoop-yarn-applications-catalog module. The module is for a sample
application catalog, so I think we can move the module to a separate
repository. Of course, it should be discussed separately.
Thanks and regards,
Akira
On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Thanks for putting this up, Chao Sun.
>
> I got following error on building the RC3 source tarball.
> It is reproducible even in the container launched by
> `./start-build-env.sh`.
> There seems to be no relevant diff between release-3.3.2-RC0 and
> release-3.3.2-RC3 (and trunk)
> under hadoop-yarn-applications-catalog-webapp.
>
> I guess developers having caches of related artifacts under ~/.m2 did not
> see this?
>
> ```
> $ mvn clean install -DskipTests -Pnative -Pdist
> ...
> [INFO] Installing node version v8.11.3
> [INFO] Downloading
> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
> [INFO] Copying node binary from
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node
> to
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
> [INFO] Installed node locally.
> [INFO] Installing Yarn version v1.7.0
> [INFO] Downloading
> https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz
> to
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> [INFO] No proxies configured
> [INFO] No proxy was configured, downloading directly
> [INFO] Unpacking
> /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
> into
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
> [INFO] Installed Yarn locally.
> [INFO]
> [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @
> hadoop-yarn-applications-catalog-webapp ---
> [INFO] testFailureIgnore property is ignored in non test phases
> [INFO] Running 'yarn ' in
> /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
> [INFO] yarn install v1.7.0
> [INFO] info No lockfile found.
> [INFO] [1/4] Resolving packages...
> [INFO] [2/4] Fetching packages...
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".
> [INFO] error safe-stable-stringify@2.3.1: The engine "node" is
> incompatible with this module. Expected version ">=10".info Visit
> https://yarnpkg.com/en/docs/cli/install for documentation about this
> command.
> [INFO] error Found incompatible module
> [INFO]
> ------------------------------------------------------------------------
> ```
>
> Masatake Iwasaki
>
>
> On 2022/01/27 4:16, Chao Sun wrote:
> > Hi all,
> >
> > I've put together Hadoop 3.3.2 RC3 below:
> >
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> > The Maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1333
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > The only delta between this and RC2 is the addition of the following fix:
> > - HADOOP-18094. Disable S3A auditing by default.
> >
> > I've done the same tests as in RC2 and they look good:
> > - Ran all the unit tests
> > - Started a single node HDFS cluster and tested a few simple commands
> > - Ran all the tests in Spark using the RC2 artifacts
> >
> > Please evaluate the RC and vote, thanks!
> >
> > Best,
> > Chao
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for putting this up, Chao Sun.
I got following error on building the RC3 source tarball.
It is reproducible even in the container launched by `./start-build-env.sh`.
There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
under hadoop-yarn-applications-catalog-webapp.
I guess developers having caches of related artifacts under ~/.m2 did not see this?
```
$ mvn clean install -DskipTests -Pnative -Pdist
...
[INFO] Installing node version v8.11.3
[INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.7.0
[INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
[INFO] testFailureIgnore property is ignored in non test phases
[INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[INFO] yarn install v1.7.0
[INFO] info No lockfile found.
[INFO] [1/4] Resolving packages...
[INFO] [2/4] Fetching packages...
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
[INFO] error Found incompatible module
[INFO] ------------------------------------------------------------------------
```
Masatake Iwasaki
On 2022/01/27 4:16, Chao Sun wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
> * ATSv2 functional tests: ok
Ran against hbase 1.7 cluster
On Thu, Jan 27, 2022 at 5:03 PM Viraj Jasani <vj...@apache.org> wrote:
> +1 (non-binding)
>
> * Signature: ok
> * Checksum: ok
> * Build from source: ok
> * Ran some large tests from hbase 2.5 branch against RC2: looks good
> (carry forward from previous RC)
> * HDFS functional tests: ok
> * Ran a couple of MapReduce Jobs: ok
> * ATSv2 functional tests: ok
>
>
> On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> I've put together Hadoop 3.3.2 RC3 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The only delta between this and RC2 is the addition of the following fix:
>> - HADOOP-18094. Disable S3A auditing by default.
>>
>> I've done the same tests as in RC2 and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC2 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
> * ATSv2 functional tests: ok
Ran against hbase 1.7 cluster
On Thu, Jan 27, 2022 at 5:03 PM Viraj Jasani <vj...@apache.org> wrote:
> +1 (non-binding)
>
> * Signature: ok
> * Checksum: ok
> * Build from source: ok
> * Ran some large tests from hbase 2.5 branch against RC2: looks good
> (carry forward from previous RC)
> * HDFS functional tests: ok
> * Ran a couple of MapReduce Jobs: ok
> * ATSv2 functional tests: ok
>
>
> On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> I've put together Hadoop 3.3.2 RC3 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The only delta between this and RC2 is the addition of the following fix:
>> - HADOOP-18094. Disable S3A auditing by default.
>>
>> I've done the same tests as in RC2 and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC2 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
> * ATSv2 functional tests: ok
Ran against hbase 1.7 cluster
On Thu, Jan 27, 2022 at 5:03 PM Viraj Jasani <vj...@apache.org> wrote:
> +1 (non-binding)
>
> * Signature: ok
> * Checksum: ok
> * Build from source: ok
> * Ran some large tests from hbase 2.5 branch against RC2: looks good
> (carry forward from previous RC)
> * HDFS functional tests: ok
> * Ran a couple of MapReduce Jobs: ok
> * ATSv2 functional tests: ok
>
>
> On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> I've put together Hadoop 3.3.2 RC3 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The only delta between this and RC2 is the addition of the following fix:
>> - HADOOP-18094. Disable S3A auditing by default.
>>
>> I've done the same tests as in RC2 and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC2 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
> * ATSv2 functional tests: ok
Ran against hbase 1.7 cluster
On Thu, Jan 27, 2022 at 5:03 PM Viraj Jasani <vj...@apache.org> wrote:
> +1 (non-binding)
>
> * Signature: ok
> * Checksum: ok
> * Build from source: ok
> * Ran some large tests from hbase 2.5 branch against RC2: looks good
> (carry forward from previous RC)
> * HDFS functional tests: ok
> * Ran a couple of MapReduce Jobs: ok
> * ATSv2 functional tests: ok
>
>
> On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> I've put together Hadoop 3.3.2 RC3 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The only delta between this and RC2 is the addition of the following fix:
>> - HADOOP-18094. Disable S3A auditing by default.
>>
>> I've done the same tests as in RC2 and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC2 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Build from source: ok
* Ran some large tests from hbase 2.5 branch against RC2: looks good (carry
forward from previous RC)
* HDFS functional tests: ok
* Ran a couple of MapReduce Jobs: ok
* ATSv2 functional tests: ok
On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for putting this up, Chao Sun.
I got following error on building the RC3 source tarball.
It is reproducible even in the container launched by `./start-build-env.sh`.
There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
under hadoop-yarn-applications-catalog-webapp.
I guess developers having caches of related artifacts under ~/.m2 did not see this?
```
$ mvn clean install -DskipTests -Pnative -Pdist
...
[INFO] Installing node version v8.11.3
[INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.7.0
[INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
[INFO] testFailureIgnore property is ignored in non test phases
[INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[INFO] yarn install v1.7.0
[INFO] info No lockfile found.
[INFO] [1/4] Resolving packages...
[INFO] [2/4] Fetching packages...
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
[INFO] error Found incompatible module
[INFO] ------------------------------------------------------------------------
```
Masatake Iwasaki
On 2022/01/27 4:16, Chao Sun wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
* +1 binding *
Checked out the RC tag and compiled successfully. ( mvn clean package
-Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true)
Ran abfs and azure integration tests. All good.
Compiled gcs with 3.3.2 hadoop from staging successful.
Tested list, get, put , delete operation on s3, gcs and abfs buckets.
On Thu, Jan 27, 2022 at 12:46 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for putting this up, Chao Sun.
I got following error on building the RC3 source tarball.
It is reproducible even in the container launched by `./start-build-env.sh`.
There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
under hadoop-yarn-applications-catalog-webapp.
I guess developers having caches of related artifacts under ~/.m2 did not see this?
```
$ mvn clean install -DskipTests -Pnative -Pdist
...
[INFO] Installing node version v8.11.3
[INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.7.0
[INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
[INFO] testFailureIgnore property is ignored in non test phases
[INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[INFO] yarn install v1.7.0
[INFO] info No lockfile found.
[INFO] [1/4] Resolving packages...
[INFO] [2/4] Fetching packages...
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
[INFO] error Found incompatible module
[INFO] ------------------------------------------------------------------------
```
Masatake Iwasaki
On 2022/01/27 4:16, Chao Sun wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for putting this up, Chao Sun.
I got following error on building the RC3 source tarball.
It is reproducible even in the container launched by `./start-build-env.sh`.
There seems to be no relevant diff between release-3.3.2-RC0 and release-3.3.2-RC3 (and trunk)
under hadoop-yarn-applications-catalog-webapp.
I guess developers having caches of related artifacts under ~/.m2 did not see this?
```
$ mvn clean install -DskipTests -Pnative -Pdist
...
[INFO] Installing node version v8.11.3
[INFO] Downloading https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz to /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp
[INFO] Copying node binary from /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node to /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.7.0
[INFO] Downloading https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz to /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz into /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ hadoop-yarn-applications-catalog-webapp ---
[INFO] testFailureIgnore property is ignored in non test phases
[INFO] Running 'yarn ' in /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target
[INFO] yarn install v1.7.0
[INFO] info No lockfile found.
[INFO] [1/4] Resolving packages...
[INFO] [2/4] Fetching packages...
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".
[INFO] error safe-stable-stringify@2.3.1: The engine "node" is incompatible with this module. Expected version ">=10".info Visit https://yarnpkg.com/en/docs/cli/install for documentation about this command.
[INFO] error Found incompatible module
[INFO] ------------------------------------------------------------------------
```
Masatake Iwasaki
On 2022/01/27 4:16, Chao Sun wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Build from source: ok
* Ran some large tests from hbase 2.5 branch against RC2: looks good (carry
forward from previous RC)
* HDFS functional tests: ok
* Ran a couple of MapReduce Jobs: ok
* ATSv2 functional tests: ok
On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Build from source: ok
* Ran some large tests from hbase 2.5 branch against RC2: looks good (carry
forward from previous RC)
* HDFS functional tests: ok
* Ran a couple of MapReduce Jobs: ok
* ATSv2 functional tests: ok
On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
* +1 binding *
Checked out the RC tag and compiled successfully. ( mvn clean package
-Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true)
Ran abfs and azure integration tests. All good.
Compiled gcs with 3.3.2 hadoop from staging successful.
Tested list, get, put , delete operation on s3, gcs and abfs buckets.
On Thu, Jan 27, 2022 at 12:46 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
* +1 binding *
Checked out the RC tag and compiled successfully. ( mvn clean package
-Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true)
Ran abfs and azure integration tests. All good.
Compiled gcs with 3.3.2 hadoop from staging successful.
Tested list, get, put , delete operation on s3, gcs and abfs buckets.
On Thu, Jan 27, 2022 at 12:46 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Mukund Madhav Thakur <mt...@cloudera.com.INVALID>.
* +1 binding *
Checked out the RC tag and compiled successfully. ( mvn clean package
-Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true)
Ran abfs and azure integration tests. All good.
Compiled gcs with 3.3.2 hadoop from staging successful.
Tested list, get, put , delete operation on s3, gcs and abfs buckets.
On Thu, Jan 27, 2022 at 12:46 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC3
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
* Signature: ok
* Checksum: ok
* Build from source: ok
* Ran some large tests from hbase 2.5 branch against RC2: looks good (carry
forward from previous RC)
* HDFS functional tests: ok
* Ran a couple of MapReduce Jobs: ok
* ATSv2 functional tests: ok
On Thu, Jan 27, 2022 at 12:47 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> I've put together Hadoop 3.3.2 RC3 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1333
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The only delta between this and RC2 is the addition of the following fix:
> - HADOOP-18094. Disable S3A auditing by default.
>
> I've done the same tests as in RC2 and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC2 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>