You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Kengo Seki <se...@apache.org> on 2022/05/17 05:42:58 UTC

[VOTE] Release Bigtop version 3.1.0

This is the vote for release 3.1.0 of Apache Bigtop.

It fixes the following issues:
    https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644

The vote will be going for at least 72 hours and will be closed on Friday,
May 19th, 2022 at 11 p.m. PDT. Please download, test and vote with

[ ] +1, accept RC0 as the official 3.1.0 release of Apache Bigtop
[ ] +0, I don't care either way,
[ ] -1, do not accept RC0 as the official 3.1.0 release of Apache
Bigtop, because...

Source and binary files:
    https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/

Maven staging repo:
    https://repository.apache.org/content/repositories/orgapachebigtop-1034

The git tag to be voted upon is release-3.1.0

Bigtop's KEYS file containing PGP keys we use to sign the release:
    https://dist.apache.org/repos/dist/release/bigtop/KEYS

You can see the results of packaging, deployment and smoke tests
on the CI environment in the following URLs.
Some builds had to be retried several times since some of our tests are flaky,
but all of them succeeded at last, except for Ambari on Rocky Linux/aarch64
(already known as BIGTOP-3553).

    https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/
    https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/

Kengo Seki <se...@apache.org>

Re: [VOTE] Release Bigtop version 3.1.0

Posted by Yuqi Gu <gu...@apache.org>.
+1.

Built all components and verified the related smoke tests on Arm64
Debian11/Fedora35.
Thanks, Kengo.

BRs,
Yuqi

<Le...@nttdata.com> 于2022年5月19日周四 20:38写道:

> +1
>
> I checked on CentOS 7/amd64 CPU, build all project and test mainstream
> projects.
>
> git clone https://github.com/apache/bigtop.git
> cd bigtop
> git checkout release-3.1.0
> ./gradlew alluxio-pkg ambari-pkg bigtop-ambari-mpack-pkg bigtop-groovy-pkg
> bigtop-jsvc-pkg bigtop-utils-pkg \
>   elasticsearch-pkg flink-pkg gpdb-pkg hadoop-pkg hbase-pkg hive-pkg
> kafka-pkg kibana-pkg livy-pkg logstash-pkg \
>   oozie-pkg phoenix-pkg solr-pkg spark-pkg sqoop-pkg tez-pkg ycsb-pkg
> zeppelin-pkg zookeeper-pkg
> ./gradlew repo
> cd provisioner/docker
> ./docker-hadoop.sh \
>   --create 3 \
>   --image bigtop/puppet:trunk-centos-7 \
>   --memory 8g \
>   --enable-local-repo \
>   --disable-gpg-check \
>   --stack hdfs,yarn,mapreduce,hbase,hive,spark,kafka \
>   --smoke-tests hdfs,yarn,mapreduce,hbase,hive,spark,kafka
>
> . . .
> :bigtop-tests:smoke-tests:kafka:test (Thread[Daemon worker,5,main])
> completed. Took 4.672 secs.
>
> BUILD SUCCESSFUL in 14m 1s
> 51 actionable tasks: 22 executed, 29 up-to-date
> . . .
>
> From: Kengo Seki <se...@apache.org>
> Date: Tuesday, May 17, 2022 14:43
> To: dev <de...@bigtop.apache.org>
> Subject: [VOTE] Release Bigtop version 3.1.0
> This is the vote for release 3.1.0 of Apache Bigtop.
>
> It fixes the following issues:
>
> https://urldefense.com/v3/__https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EWfzzop4$
> <
> https://urldefense.com/v3/__https:/issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EWfzzop4$
> >
>
> The vote will be going for at least 72 hours and will be closed on Friday,
> May 19th, 2022 at 11 p.m. PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.1.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.1.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
>
> https://urldefense.com/v3/__https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EvTiHPJE$
> <
> https://urldefense.com/v3/__https:/dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EvTiHPJE$
> >
>
> Maven staging repo:
>
> https://urldefense.com/v3/__https://repository.apache.org/content/repositories/orgapachebigtop-1034__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2ET6aXry0$
> <
> https://urldefense.com/v3/__https:/repository.apache.org/content/repositories/orgapachebigtop-1034__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2ET6aXry0$
> >
>
> The git tag to be voted upon is release-3.1.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
>
> https://urldefense.com/v3/__https://dist.apache.org/repos/dist/release/bigtop/KEYS__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2E9xjl1Go$
> <
> https://urldefense.com/v3/__https:/dist.apache.org/repos/dist/release/bigtop/KEYS__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2E9xjl1Go$
> >
>
> You can see the results of packaging, deployment and smoke tests
> on the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests are
> flaky,
> but all of them succeeded at last, except for Ambari on Rocky Linux/aarch64
> (already known as BIGTOP-3553).
>
>
> https://urldefense.com/v3/__https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EjXGA-Do$
> <
> https://urldefense.com/v3/__https:/ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EjXGA-Do$
> >
>
> https://urldefense.com/v3/__https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EGemSdVY$
> <
> https://urldefense.com/v3/__https:/ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EGemSdVY$
> >
>
> Kengo Seki <se...@apache.org>
>

Re: [VOTE] Release Bigtop version 3.1.0

Posted by Le...@nttdata.com.
+1

I checked on CentOS 7/amd64 CPU, build all project and test mainstream projects.

git clone https://github.com/apache/bigtop.git
cd bigtop
git checkout release-3.1.0
./gradlew alluxio-pkg ambari-pkg bigtop-ambari-mpack-pkg bigtop-groovy-pkg bigtop-jsvc-pkg bigtop-utils-pkg \
  elasticsearch-pkg flink-pkg gpdb-pkg hadoop-pkg hbase-pkg hive-pkg kafka-pkg kibana-pkg livy-pkg logstash-pkg \
  oozie-pkg phoenix-pkg solr-pkg spark-pkg sqoop-pkg tez-pkg ycsb-pkg zeppelin-pkg zookeeper-pkg
./gradlew repo
cd provisioner/docker
./docker-hadoop.sh \
  --create 3 \
  --image bigtop/puppet:trunk-centos-7 \
  --memory 8g \
  --enable-local-repo \
  --disable-gpg-check \
  --stack hdfs,yarn,mapreduce,hbase,hive,spark,kafka \
  --smoke-tests hdfs,yarn,mapreduce,hbase,hive,spark,kafka

. . .
:bigtop-tests:smoke-tests:kafka:test (Thread[Daemon worker,5,main]) completed. Took 4.672 secs.

BUILD SUCCESSFUL in 14m 1s
51 actionable tasks: 22 executed, 29 up-to-date
. . .

From: Kengo Seki <se...@apache.org>
Date: Tuesday, May 17, 2022 14:43
To: dev <de...@bigtop.apache.org>
Subject: [VOTE] Release Bigtop version 3.1.0
This is the vote for release 3.1.0 of Apache Bigtop.

It fixes the following issues:
    https://urldefense.com/v3/__https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EWfzzop4$<https://urldefense.com/v3/__https:/issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EWfzzop4$>

The vote will be going for at least 72 hours and will be closed on Friday,
May 19th, 2022 at 11 p.m. PDT. Please download, test and vote with

[ ] +1, accept RC0 as the official 3.1.0 release of Apache Bigtop
[ ] +0, I don't care either way,
[ ] -1, do not accept RC0 as the official 3.1.0 release of Apache
Bigtop, because...

Source and binary files:
    https://urldefense.com/v3/__https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EvTiHPJE$<https://urldefense.com/v3/__https:/dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EvTiHPJE$>

Maven staging repo:
    https://urldefense.com/v3/__https://repository.apache.org/content/repositories/orgapachebigtop-1034__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2ET6aXry0$<https://urldefense.com/v3/__https:/repository.apache.org/content/repositories/orgapachebigtop-1034__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2ET6aXry0$>

The git tag to be voted upon is release-3.1.0

Bigtop's KEYS file containing PGP keys we use to sign the release:
    https://urldefense.com/v3/__https://dist.apache.org/repos/dist/release/bigtop/KEYS__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2E9xjl1Go$<https://urldefense.com/v3/__https:/dist.apache.org/repos/dist/release/bigtop/KEYS__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2E9xjl1Go$>

You can see the results of packaging, deployment and smoke tests
on the CI environment in the following URLs.
Some builds had to be retried several times since some of our tests are flaky,
but all of them succeeded at last, except for Ambari on Rocky Linux/aarch64
(already known as BIGTOP-3553).

    https://urldefense.com/v3/__https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EjXGA-Do$<https://urldefense.com/v3/__https:/ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EjXGA-Do$>
    https://urldefense.com/v3/__https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EGemSdVY$<https://urldefense.com/v3/__https:/ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/__;!!GCTRfqYYOYGmgK_z!76ZYC9lVszFZkP1Qmtep8V7WtWU2EAyVAAyRhCrl8UH0Hiyoj6GjUw-mB7zUcqLIrmR_sgDdaC2EGemSdVY$>

Kengo Seki <se...@apache.org>

[RESULT][VOTE] Release Bigtop version 3.1.0

Posted by Kengo Seki <se...@apache.org>.
Here's my +1 (binding):

* Verified all signatures and checksums of the source tarball and the
*.(repo|list) files
* Ensured that a few components were successfully built using the source tarball
* Ensured that a few components were successfully deployed using
puppet manifests in the source tarball and packages published on S3

And with three binding +1s, one non-binding +1s, and no -1 or +-0 votes,
the vote for the 3.1.0 release PASSED.

Binding +1s:
  Yuqi Gu
  Masatake Iwasaki
  Kengo Seki

Non-binding +1s:
  Leona Yoda

Thank you all for voting and testing to make this release happen!

Kengo Seki <se...@apache.org>

On Tue, May 17, 2022 at 2:42 PM Kengo Seki <se...@apache.org> wrote:
>
> This is the vote for release 3.1.0 of Apache Bigtop.
>
> It fixes the following issues:
>     https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644
>
> The vote will be going for at least 72 hours and will be closed on Friday,
> May 19th, 2022 at 11 p.m. PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.1.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.1.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
>     https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/
>
> Maven staging repo:
>     https://repository.apache.org/content/repositories/orgapachebigtop-1034
>
> The git tag to be voted upon is release-3.1.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
>     https://dist.apache.org/repos/dist/release/bigtop/KEYS
>
> You can see the results of packaging, deployment and smoke tests
> on the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests are flaky,
> but all of them succeeded at last, except for Ambari on Rocky Linux/aarch64
> (already known as BIGTOP-3553).
>
>     https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/
>     https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/
>
> Kengo Seki <se...@apache.org>

Re: [VOTE] Release Bigtop version 3.1.0

Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1(binding).

- downloaded the source tarball and checked the signature and checksum.

- built all packages on Rocky Linux 8 x86_64 and ran smoke-tests of
   hdfs,yarn,mapreduce,hbase,hive,spark,kafka::

     $ ./gradlew alluxio-pkg ambari-pkg bigtop-ambari-mpack-pkg bigtop-groovy-pkg bigtop-jsvc-pkg bigtop-utils-pkg elasticsearch-pkg flink-pkg gpdb-pkg hadoop-pkg hbase-pkg hive-pkg kafka-pkg kibana-pkg livy-pkg logstash-pkg oozie-pkg phoenix-pkg solr-pkg spark-pkg sqoop-pkg tez-pkg ycsb-pkg zeppelin-pkg zookeeper-pkg
     $ ./gradlew repo
     $ cd provisioner/docker
     $ ./docker-hadoop.sh \
        --create 3 \
        --image bigtop/puppet:trunk-rockylinux-8 \
        --memory 8g \
        --enable-local-repo \
        --disable-gpg-check \
        --stack hdfs,yarn,mapreduce,hbase,hive,spark,kafka \
        --smoke-tests hdfs,yarn,mapreduce,hbase,hive,spark,kafka
     ...
     BUILD SUCCESSFUL in 16m 39s
     51 actionable tasks: 22 executed, 29 up-to-date
     Stopped 1 worker daemon(s).

Thanks,
Masatake Iwasaki


On 2022/05/17 14:42, Kengo Seki wrote:
> This is the vote for release 3.1.0 of Apache Bigtop.
> 
> It fixes the following issues:
>      https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12350644
> 
> The vote will be going for at least 72 hours and will be closed on Friday,
> May 19th, 2022 at 11 p.m. PDT. Please download, test and vote with
> 
> [ ] +1, accept RC0 as the official 3.1.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.1.0 release of Apache
> Bigtop, because...
> 
> Source and binary files:
>      https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.1.0-RC0/
> 
> Maven staging repo:
>      https://repository.apache.org/content/repositories/orgapachebigtop-1034
> 
> The git tag to be voted upon is release-3.1.0
> 
> Bigtop's KEYS file containing PGP keys we use to sign the release:
>      https://dist.apache.org/repos/dist/release/bigtop/KEYS
> 
> You can see the results of packaging, deployment and smoke tests
> on the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests are flaky,
> but all of them succeeded at last, except for Ambari on Rocky Linux/aarch64
> (already known as BIGTOP-3553).
> 
>      https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.1.0/
>      https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/
> 
> Kengo Seki <se...@apache.org>