You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Kengo Seki <se...@apache.org> on 2021/10/18 23:16:52 UTC
[VOTE] Release Bigtop version 3.0.0
This is the vote for release 3.0.0 of Apache Bigtop.
It fixes the following issues:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
The vote will be going for at least 72 hours and will be closed on Thursday,
October 21st, 2021 at 17:00 PDT. Please download, test and vote with
[ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
[ ] +0, I don't care either way,
[ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
Bigtop, because...
Source and binary files:
https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
Maven staging repo:
https://repository.apache.org/content/repositories/orgapachebigtop-1031
The git tag to be voted upon is release-3.0.0
Bigtop's KEYS file containing PGP keys we use to sign the release:
https://dist.apache.org/repos/dist/release/bigtop/KEYS
You can see the results of packaging, deployment and smoke tests on
the CI environment in the following URLs.
Some builds had to be retried several times since some of our tests
are flaky, but all of them succeeded at last.
(I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
I ran them only for CentOS and Debian on the former and for Fedora and
Ubuntu on the latter,
since our computation resource is respectively limited.)
https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
Kengo Seki <se...@apache.org>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Kengo Seki <se...@apache.org>.
Thank you for verifying and voting, Yuqi and Masatake.
Here's my +1 (binding), so this release has been approved.
I'm going to start to roll it out and write the announce email soon.
Regarding BIGTOP-3589 and BIGTOP-3590, I will add them as known issues
and their workaround to the release page on our cwiki.
I'd like to say thank you for everyone who participated in this development! ;)
Kengo Seki <se...@apache.org>
On Fri, Oct 22, 2021 at 10:57 AM Yuqi Gu <yu...@linaro.org> wrote:
>
> +1(binding).
>
> Verified the Arm64 packages of Hadoop, Spark, hbase,hive, zeppelin, flink,
> kafka on Fedora-33 and Ubuntu 20.04 except the issue reported in
> BIGTOP-3590.
> Agreed with Masatake and let's put it to the next minor release.
>
> BRs,
> Yuqi
>
>
> On Thu, 21 Oct 2021 at 21:34, Masatake Iwasaki <iw...@oss.nttdata.co.jp>
> wrote:
>
> > +1(binding).
> >
> > * verified signature and checksums of the source tarball.
> > * built all products from the source tarball on CentOS 8 (x86_64) and
> > Ubuntu 18.04 (x86_64)
> > * ran smoke tests of hdfs,yarn,mapreduce,hbase,hive,spark on CentOS 8
> > (x86_64) and Ubuntu 18.04 (x86_64)
> > * built bigtop-*, zookeeper, hadoop, hbase, hive on CentOS 7 (aarch64)
> > * ran smoke tests of hdfs,yarn,mapreduce,hbase,hive on CentOS 7 (aarch64)
> > * built bigtop-*, zookeeper, hadoop and ran smoke-tests of hbase on Ubuntu
> > 20.04 (x86_64)
> >
> > As I reported in BIGTOP-3589, building Alluxio fails.
> > The workaround is using source code cloned from apache/bigtop with
> > release-3.0.0 tag.
> >
> > The issue reported in BIGTOP-3590 turned out to be trivial bug of test
> > code.
> > I think it is not worth for sinking RC0.
> >
> > Masatake Iwasaki
> >
> > On 2021/10/19 8:16, Kengo Seki wrote:
> > > This is the vote for release 3.0.0 of Apache Bigtop.
> > >
> > > It fixes the following issues:
> > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> > >
> > > The vote will be going for at least 72 hours and will be closed on
> > Thursday,
> > > October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> > >
> > > [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > > [ ] +0, I don't care either way,
> > > [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > > Bigtop, because...
> > >
> > > Source and binary files:
> > > https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> > >
> > > Maven staging repo:
> > >
> > https://repository.apache.org/content/repositories/orgapachebigtop-1031
> > >
> > > The git tag to be voted upon is release-3.0.0
> > >
> > > Bigtop's KEYS file containing PGP keys we use to sign the release:
> > > https://dist.apache.org/repos/dist/release/bigtop/KEYS
> > >
> > > You can see the results of packaging, deployment and smoke tests on
> > > the CI environment in the following URLs.
> > > Some builds had to be retried several times since some of our tests
> > > are flaky, but all of them succeeded at last.
> > > (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and
> > ppc64le,
> > > I ran them only for CentOS and Debian on the former and for Fedora and
> > > Ubuntu on the latter,
> > > since our computation resource is respectively limited.)
> > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > >
> > https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> > >
> > > Kengo Seki <se...@apache.org>
> > >
> >
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Yuqi Gu <yu...@linaro.org>.
+1(binding).
Verified the Arm64 packages of Hadoop, Spark, hbase,hive, zeppelin, flink,
kafka on Fedora-33 and Ubuntu 20.04 except the issue reported in
BIGTOP-3590.
Agreed with Masatake and let's put it to the next minor release.
BRs,
Yuqi
On Thu, 21 Oct 2021 at 21:34, Masatake Iwasaki <iw...@oss.nttdata.co.jp>
wrote:
> +1(binding).
>
> * verified signature and checksums of the source tarball.
> * built all products from the source tarball on CentOS 8 (x86_64) and
> Ubuntu 18.04 (x86_64)
> * ran smoke tests of hdfs,yarn,mapreduce,hbase,hive,spark on CentOS 8
> (x86_64) and Ubuntu 18.04 (x86_64)
> * built bigtop-*, zookeeper, hadoop, hbase, hive on CentOS 7 (aarch64)
> * ran smoke tests of hdfs,yarn,mapreduce,hbase,hive on CentOS 7 (aarch64)
> * built bigtop-*, zookeeper, hadoop and ran smoke-tests of hbase on Ubuntu
> 20.04 (x86_64)
>
> As I reported in BIGTOP-3589, building Alluxio fails.
> The workaround is using source code cloned from apache/bigtop with
> release-3.0.0 tag.
>
> The issue reported in BIGTOP-3590 turned out to be trivial bug of test
> code.
> I think it is not worth for sinking RC0.
>
> Masatake Iwasaki
>
> On 2021/10/19 8:16, Kengo Seki wrote:
> > This is the vote for release 3.0.0 of Apache Bigtop.
> >
> > It fixes the following issues:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> >
> > The vote will be going for at least 72 hours and will be closed on
> Thursday,
> > October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> >
> > [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > [ ] +0, I don't care either way,
> > [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > Bigtop, because...
> >
> > Source and binary files:
> > https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> >
> > Maven staging repo:
> >
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
> >
> > The git tag to be voted upon is release-3.0.0
> >
> > Bigtop's KEYS file containing PGP keys we use to sign the release:
> > https://dist.apache.org/repos/dist/release/bigtop/KEYS
> >
> > You can see the results of packaging, deployment and smoke tests on
> > the CI environment in the following URLs.
> > Some builds had to be retried several times since some of our tests
> > are flaky, but all of them succeeded at last.
> > (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and
> ppc64le,
> > I ran them only for CentOS and Debian on the former and for Fedora and
> > Ubuntu on the latter,
> > since our computation resource is respectively limited.)
> > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> >
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> >
> > Kengo Seki <se...@apache.org>
> >
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1(binding).
* verified signature and checksums of the source tarball.
* built all products from the source tarball on CentOS 8 (x86_64) and Ubuntu 18.04 (x86_64)
* ran smoke tests of hdfs,yarn,mapreduce,hbase,hive,spark on CentOS 8 (x86_64) and Ubuntu 18.04 (x86_64)
* built bigtop-*, zookeeper, hadoop, hbase, hive on CentOS 7 (aarch64)
* ran smoke tests of hdfs,yarn,mapreduce,hbase,hive on CentOS 7 (aarch64)
* built bigtop-*, zookeeper, hadoop and ran smoke-tests of hbase on Ubuntu 20.04 (x86_64)
As I reported in BIGTOP-3589, building Alluxio fails.
The workaround is using source code cloned from apache/bigtop with release-3.0.0 tag.
The issue reported in BIGTOP-3590 turned out to be trivial bug of test code.
I think it is not worth for sinking RC0.
Masatake Iwasaki
On 2021/10/19 8:16, Kengo Seki wrote:
> This is the vote for release 3.0.0 of Apache Bigtop.
>
> It fixes the following issues:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>
> The vote will be going for at least 72 hours and will be closed on Thursday,
> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>
> Maven staging repo:
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>
> The git tag to be voted upon is release-3.0.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>
> You can see the results of packaging, deployment and smoke tests on
> the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests
> are flaky, but all of them succeeded at last.
> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
> I ran them only for CentOS and Debian on the former and for Fedora and
> Ubuntu on the latter,
> since our computation resource is respectively limited.)
> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>
> Kengo Seki <se...@apache.org>
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Kengo Seki <se...@apache.org>.
Thank you for trying many packages, Yuqi!
> But I found *hbase*(x86_64 and arm64) smoke tests failed on Ubuntu-20.04*。
Would you share the error on a new JIRA issue or this ml? That was
successful on our CI environment, though it was only tested on the
x86_64 platform. I will also try it later.
https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/COMPONENTS=hdfs.hbase@hbase,OS=ubuntu-20.04-amd64-deploy/34/
Kengo Seki <se...@apache.org>
On Wed, Oct 20, 2021 at 1:00 PM YQ <du...@gmail.com> wrote:
>
> Thanks Kengo for rolling out the 3.0 release.
>
> Verified the Arm64 packages of Hadoop, Spark, hive, zeppelin, flink, kafka
> on Fedora-33 and Ubuntu-20.04.
> But I found *hbase*(x86_64 and arm64) smoke tests failed on Ubuntu-20.04*。*
>
>
> BRs,
> Yuqi
>
> Kengo Seki <se...@apache.org> 于2021年10月20日周三 上午9:14写道：
>
> > Thank you for finding this and testing all packages, Masatake!
> >
> > > recreating only the source tarball should be enough if we cut RC1.
> >
> > Or, isn't it enough to add a notice and workaround to the release page
> > on cwiki, which is supposed to be published such as
> > https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.5.0+Release?
> >
> > Kengo Seki <se...@apache.org>
> >
> > On Wed, Oct 20, 2021 at 10:04 AM Masatake Iwasaki
> > <iw...@oss.nttdata.co.jp> wrote:
> > >
> > > > I filed BIGTOP-3589 related to source tarball of RC0.
> > >
> > > I got no issue on packaging other products from the source tarball (on
> > CentOS 8 x86_64 and Ubuntu 18.04 x86_64).
> > > Since the fix of BIGTOP-3589 does not affect binary packages built from
> > the RC0,
> > > recreating only the source tarball should be enough if we cut RC1.
> > >
> > > On 2021/10/19 19:51, Masatake Iwasaki wrote:
> > > > Thanks for putting this up, Kengo.
> > > >
> > > > I filed BIGTOP-3589 related to source tarball of RC0.
> > > >
> > > > Masatake Iwasaki
> > > >
> > > > On 2021/10/19 8:16, Kengo Seki wrote:
> > > >> This is the vote for release 3.0.0 of Apache Bigtop.
> > > >>
> > > >> It fixes the following issues:
> > > >>
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> > > >>
> > > >> The vote will be going for at least 72 hours and will be closed on
> > Thursday,
> > > >> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> > > >>
> > > >> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > > >> [ ] +0, I don't care either way,
> > > >> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > > >> Bigtop, because...
> > > >>
> > > >> Source and binary files:
> > > >> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> > > >>
> > > >> Maven staging repo:
> > > >>
> > https://repository.apache.org/content/repositories/orgapachebigtop-1031
> > > >>
> > > >> The git tag to be voted upon is release-3.0.0
> > > >>
> > > >> Bigtop's KEYS file containing PGP keys we use to sign the release:
> > > >> https://dist.apache.org/repos/dist/release/bigtop/KEYS
> > > >>
> > > >> You can see the results of packaging, deployment and smoke tests on
> > > >> the CI environment in the following URLs.
> > > >> Some builds had to be retried several times since some of our tests
> > > >> are flaky, but all of them succeeded at last.
> > > >> (I ran the smoke tests for all distros on x86_64. Regarding aarch64
> > and ppc64le,
> > > >> I ran them only for CentOS and Debian on the former and for Fedora and
> > > >> Ubuntu on the latter,
> > > >> since our computation resource is respectively limited.)
> > > >> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > > >>
> > https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> > > >>
> > > >> Kengo Seki <se...@apache.org>
> > > >>
> >
Re: [VOTE] Release Bigtop version 3.0.0
Posted by YQ <du...@gmail.com>.
Thanks Kengo for rolling out the 3.0 release.
Verified the Arm64 packages of Hadoop, Spark, hive, zeppelin, flink, kafka
on Fedora-33 and Ubuntu-20.04.
But I found *hbase*(x86_64 and arm64) smoke tests failed on Ubuntu-20.04*。*
BRs,
Yuqi
Kengo Seki <se...@apache.org> 于2021年10月20日周三 上午9:14写道：
> Thank you for finding this and testing all packages, Masatake!
>
> > recreating only the source tarball should be enough if we cut RC1.
>
> Or, isn't it enough to add a notice and workaround to the release page
> on cwiki, which is supposed to be published such as
> https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.5.0+Release?
>
> Kengo Seki <se...@apache.org>
>
> On Wed, Oct 20, 2021 at 10:04 AM Masatake Iwasaki
> <iw...@oss.nttdata.co.jp> wrote:
> >
> > > I filed BIGTOP-3589 related to source tarball of RC0.
> >
> > I got no issue on packaging other products from the source tarball (on
> CentOS 8 x86_64 and Ubuntu 18.04 x86_64).
> > Since the fix of BIGTOP-3589 does not affect binary packages built from
> the RC0,
> > recreating only the source tarball should be enough if we cut RC1.
> >
> > On 2021/10/19 19:51, Masatake Iwasaki wrote:
> > > Thanks for putting this up, Kengo.
> > >
> > > I filed BIGTOP-3589 related to source tarball of RC0.
> > >
> > > Masatake Iwasaki
> > >
> > > On 2021/10/19 8:16, Kengo Seki wrote:
> > >> This is the vote for release 3.0.0 of Apache Bigtop.
> > >>
> > >> It fixes the following issues:
> > >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> > >>
> > >> The vote will be going for at least 72 hours and will be closed on
> Thursday,
> > >> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> > >>
> > >> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > >> [ ] +0, I don't care either way,
> > >> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > >> Bigtop, because...
> > >>
> > >> Source and binary files:
> > >> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> > >>
> > >> Maven staging repo:
> > >>
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
> > >>
> > >> The git tag to be voted upon is release-3.0.0
> > >>
> > >> Bigtop's KEYS file containing PGP keys we use to sign the release:
> > >> https://dist.apache.org/repos/dist/release/bigtop/KEYS
> > >>
> > >> You can see the results of packaging, deployment and smoke tests on
> > >> the CI environment in the following URLs.
> > >> Some builds had to be retried several times since some of our tests
> > >> are flaky, but all of them succeeded at last.
> > >> (I ran the smoke tests for all distros on x86_64. Regarding aarch64
> and ppc64le,
> > >> I ran them only for CentOS and Debian on the former and for Fedora and
> > >> Ubuntu on the latter,
> > >> since our computation resource is respectively limited.)
> > >> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > >>
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> > >>
> > >> Kengo Seki <se...@apache.org>
> > >>
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
>> recreating only the source tarball should be enough if we cut RC1.
>
> Or, isn't it enough to add a notice and workaround to the release page
> on cwiki, which is supposed to be published such as
> https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.5.0+Release?
I'm OK to avoid cutting RC1 given that binary packages have no issue.
Thanks,
Masatake Iwasaki
On 2021/10/20 10:14, Kengo Seki wrote:
> Thank you for finding this and testing all packages, Masatake!
>
>> recreating only the source tarball should be enough if we cut RC1.
>
> Or, isn't it enough to add a notice and workaround to the release page
> on cwiki, which is supposed to be published such as
> https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.5.0+Release?
>
> Kengo Seki <se...@apache.org>
>
> On Wed, Oct 20, 2021 at 10:04 AM Masatake Iwasaki
> <iw...@oss.nttdata.co.jp> wrote:
>>
>>> I filed BIGTOP-3589 related to source tarball of RC0.
>>
>> I got no issue on packaging other products from the source tarball (on CentOS 8 x86_64 and Ubuntu 18.04 x86_64).
>> Since the fix of BIGTOP-3589 does not affect binary packages built from the RC0,
>> recreating only the source tarball should be enough if we cut RC1.
>>
>> On 2021/10/19 19:51, Masatake Iwasaki wrote:
>>> Thanks for putting this up, Kengo.
>>>
>>> I filed BIGTOP-3589 related to source tarball of RC0.
>>>
>>> Masatake Iwasaki
>>>
>>> On 2021/10/19 8:16, Kengo Seki wrote:
>>>> This is the vote for release 3.0.0 of Apache Bigtop.
>>>>
>>>> It fixes the following issues:
>>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>>>>
>>>> The vote will be going for at least 72 hours and will be closed on Thursday,
>>>> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>>>>
>>>> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
>>>> [ ] +0, I don't care either way,
>>>> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
>>>> Bigtop, because...
>>>>
>>>> Source and binary files:
>>>> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>>>>
>>>> Maven staging repo:
>>>> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>>>>
>>>> The git tag to be voted upon is release-3.0.0
>>>>
>>>> Bigtop's KEYS file containing PGP keys we use to sign the release:
>>>> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>>>>
>>>> You can see the results of packaging, deployment and smoke tests on
>>>> the CI environment in the following URLs.
>>>> Some builds had to be retried several times since some of our tests
>>>> are flaky, but all of them succeeded at last.
>>>> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
>>>> I ran them only for CentOS and Debian on the former and for Fedora and
>>>> Ubuntu on the latter,
>>>> since our computation resource is respectively limited.)
>>>> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
>>>> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>>>>
>>>> Kengo Seki <se...@apache.org>
>>>>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Kengo Seki <se...@apache.org>.
Thank you for finding this and testing all packages, Masatake!
> recreating only the source tarball should be enough if we cut RC1.
Or, isn't it enough to add a notice and workaround to the release page
on cwiki, which is supposed to be published such as
https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+1.5.0+Release?
Kengo Seki <se...@apache.org>
On Wed, Oct 20, 2021 at 10:04 AM Masatake Iwasaki
<iw...@oss.nttdata.co.jp> wrote:
>
> > I filed BIGTOP-3589 related to source tarball of RC0.
>
> I got no issue on packaging other products from the source tarball (on CentOS 8 x86_64 and Ubuntu 18.04 x86_64).
> Since the fix of BIGTOP-3589 does not affect binary packages built from the RC0,
> recreating only the source tarball should be enough if we cut RC1.
>
> On 2021/10/19 19:51, Masatake Iwasaki wrote:
> > Thanks for putting this up, Kengo.
> >
> > I filed BIGTOP-3589 related to source tarball of RC0.
> >
> > Masatake Iwasaki
> >
> > On 2021/10/19 8:16, Kengo Seki wrote:
> >> This is the vote for release 3.0.0 of Apache Bigtop.
> >>
> >> It fixes the following issues:
> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> >>
> >> The vote will be going for at least 72 hours and will be closed on Thursday,
> >> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> >>
> >> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> >> [ ] +0, I don't care either way,
> >> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> >> Bigtop, because...
> >>
> >> Source and binary files:
> >> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> >>
> >> Maven staging repo:
> >> https://repository.apache.org/content/repositories/orgapachebigtop-1031
> >>
> >> The git tag to be voted upon is release-3.0.0
> >>
> >> Bigtop's KEYS file containing PGP keys we use to sign the release:
> >> https://dist.apache.org/repos/dist/release/bigtop/KEYS
> >>
> >> You can see the results of packaging, deployment and smoke tests on
> >> the CI environment in the following URLs.
> >> Some builds had to be retried several times since some of our tests
> >> are flaky, but all of them succeeded at last.
> >> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
> >> I ran them only for CentOS and Debian on the former and for Fedora and
> >> Ubuntu on the latter,
> >> since our computation resource is respectively limited.)
> >> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> >> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> >>
> >> Kengo Seki <se...@apache.org>
> >>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> I filed BIGTOP-3589 related to source tarball of RC0.
I got no issue on packaging other products from the source tarball (on CentOS 8 x86_64 and Ubuntu 18.04 x86_64).
Since the fix of BIGTOP-3589 does not affect binary packages built from the RC0,
recreating only the source tarball should be enough if we cut RC1.
On 2021/10/19 19:51, Masatake Iwasaki wrote:
> Thanks for putting this up, Kengo.
>
> I filed BIGTOP-3589 related to source tarball of RC0.
>
> Masatake Iwasaki
>
> On 2021/10/19 8:16, Kengo Seki wrote:
>> This is the vote for release 3.0.0 of Apache Bigtop.
>>
>> It fixes the following issues:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>>
>> The vote will be going for at least 72 hours and will be closed on Thursday,
>> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>>
>> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
>> [ ] +0, I don't care either way,
>> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
>> Bigtop, because...
>>
>> Source and binary files:
>> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>>
>> Maven staging repo:
>> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>>
>> The git tag to be voted upon is release-3.0.0
>>
>> Bigtop's KEYS file containing PGP keys we use to sign the release:
>> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>>
>> You can see the results of packaging, deployment and smoke tests on
>> the CI environment in the following URLs.
>> Some builds had to be retried several times since some of our tests
>> are flaky, but all of them succeeded at last.
>> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
>> I ran them only for CentOS and Debian on the former and for Fedora and
>> Ubuntu on the latter,
>> since our computation resource is respectively limited.)
>> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
>> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>>
>> Kengo Seki <se...@apache.org>
>>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for putting this up, Kengo.
I filed BIGTOP-3589 related to source tarball of RC0.
Masatake Iwasaki
On 2021/10/19 8:16, Kengo Seki wrote:
> This is the vote for release 3.0.0 of Apache Bigtop.
>
> It fixes the following issues:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>
> The vote will be going for at least 72 hours and will be closed on Thursday,
> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>
> Maven staging repo:
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>
> The git tag to be voted upon is release-3.0.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>
> You can see the results of packaging, deployment and smoke tests on
> the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests
> are flaky, but all of them succeeded at last.
> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
> I ran them only for CentOS and Debian on the former and for Fedora and
> Ubuntu on the latter,
> since our computation resource is respectively limited.)
> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>
> Kengo Seki <se...@apache.org>
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Evans Ye <ev...@apache.org>.
Thanks Kengo. I'm really excited to see the RC for 3.0 is out!
Let me spend time playing around with it and get back to you.
Kengo Seki <se...@apache.org> 於 2021年10月19日 週二 上午7:17寫道：
> This is the vote for release 3.0.0 of Apache Bigtop.
>
> It fixes the following issues:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>
> The vote will be going for at least 72 hours and will be closed on
> Thursday,
> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>
> Maven staging repo:
>
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>
> The git tag to be voted upon is release-3.0.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>
> You can see the results of packaging, deployment and smoke tests on
> the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests
> are flaky, but all of them succeeded at last.
> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and
> ppc64le,
> I ran them only for CentOS and Debian on the former and for Fedora and
> Ubuntu on the latter,
> since our computation resource is respectively limited.)
> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>
> Kengo Seki <se...@apache.org>
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Kengo Seki <se...@apache.org>.
Thank you for the verification and an additional +1, Evans! ;)
Kengo Seki <se...@apache.org>
On Mon, Oct 25, 2021 at 1:28 AM Evans Ye <ev...@apache.org> wrote:
>
> Here's my late +1 (binding)
>
> 1. SHA 256, 512 evaluated.
> 2. signature verified.
> 3. Hadoop build on CentOS 7 tested.
> 4. smoke test via provisioner tested on CentOS 7 (./docker-hadoop.sh -d
> -c 3 -m 8g -k 'hdfs,mapreduce,yarn,spark,hive,hbase,flink' -s
> 'hdfs,mapreduce,yarn,spark,hbase,flink,hive')
>
> I do find things out-of-date such as the Vagrant Provisioner
> (provisioner/vagrant). However, that shouldn't cancel RC since that's not
> the only thing out-dated in our code base(Docker Sandbox is also out-dated,
> etc). The main Bigtop Hadoop 3 distro is a valuable product and its quality
> is good enough for a release. Overall, thanks to the great team and great
> collaboration!
>
> - Evans
>
> Kengo Seki <se...@apache.org> 於 2021年10月23日 週六 上午8:37寫道：
>
> > > Since this is a hadoop 2 -> hadoop 3 upgrade for Bigtop,
> > > is there any documentation/guideline/etc.. that is available
> > > to help people to migrate their configs to the new major version?
> >
> > I'm afraid there is no document like that right now,
> > so we have to check the migration guide of each products.
> >
> > > we'll surely report back any issue that
> > > we find when we decide to upgrade.
> >
> > Thanks! Your feedback is always very helpful.
> > Masatake and I will also report back our findings when our customers
> > who are using Bigtop 1.5 migrates their platform to 3.0 in the future.
> >
> > Kengo Seki <se...@apache.org>
> >
> > On Thu, Oct 21, 2021 at 12:43 AM Luca Toscano <to...@gmail.com>
> > wrote:
> > >
> > > This is really great, so happy to see 3.0 in RC state!
> > >
> > > We will probably not be able to test a full upgrade of our testing
> > > environment for this vote, but we'll surely report back any issue that
> > > we find when we decide to upgrade. Since this is a hadoop 2 -> hadoop
> > > 3 upgrade for Bigtop, is there any documentation/guideline/etc.. that
> > > is available to help people to migrate their configs to the new major
> > > version?
> > >
> > > Luca
> > >
> > > On Tue, Oct 19, 2021 at 1:17 AM Kengo Seki <se...@apache.org> wrote:
> > > >
> > > > This is the vote for release 3.0.0 of Apache Bigtop.
> > > >
> > > > It fixes the following issues:
> > > >
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> > > >
> > > > The vote will be going for at least 72 hours and will be closed on
> > Thursday,
> > > > October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> > > >
> > > > [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > > > [ ] +0, I don't care either way,
> > > > [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > > > Bigtop, because...
> > > >
> > > > Source and binary files:
> > > > https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> > > >
> > > > Maven staging repo:
> > > >
> > https://repository.apache.org/content/repositories/orgapachebigtop-1031
> > > >
> > > > The git tag to be voted upon is release-3.0.0
> > > >
> > > > Bigtop's KEYS file containing PGP keys we use to sign the release:
> > > > https://dist.apache.org/repos/dist/release/bigtop/KEYS
> > > >
> > > > You can see the results of packaging, deployment and smoke tests on
> > > > the CI environment in the following URLs.
> > > > Some builds had to be retried several times since some of our tests
> > > > are flaky, but all of them succeeded at last.
> > > > (I ran the smoke tests for all distros on x86_64. Regarding aarch64
> > and ppc64le,
> > > > I ran them only for CentOS and Debian on the former and for Fedora and
> > > > Ubuntu on the latter,
> > > > since our computation resource is respectively limited.)
> > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > > >
> > https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> > > >
> > > > Kengo Seki <se...@apache.org>
> >
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Evans Ye <ev...@apache.org>.
Here's my late +1 (binding)
1. SHA 256, 512 evaluated.
2. signature verified.
3. Hadoop build on CentOS 7 tested.
4. smoke test via provisioner tested on CentOS 7 (./docker-hadoop.sh -d
-c 3 -m 8g -k 'hdfs,mapreduce,yarn,spark,hive,hbase,flink' -s
'hdfs,mapreduce,yarn,spark,hbase,flink,hive')
I do find things out-of-date such as the Vagrant Provisioner
(provisioner/vagrant). However, that shouldn't cancel RC since that's not
the only thing out-dated in our code base(Docker Sandbox is also out-dated,
etc). The main Bigtop Hadoop 3 distro is a valuable product and its quality
is good enough for a release. Overall, thanks to the great team and great
collaboration!
- Evans
Kengo Seki <se...@apache.org> 於 2021年10月23日 週六 上午8:37寫道：
> > Since this is a hadoop 2 -> hadoop 3 upgrade for Bigtop,
> > is there any documentation/guideline/etc.. that is available
> > to help people to migrate their configs to the new major version?
>
> I'm afraid there is no document like that right now,
> so we have to check the migration guide of each products.
>
> > we'll surely report back any issue that
> > we find when we decide to upgrade.
>
> Thanks! Your feedback is always very helpful.
> Masatake and I will also report back our findings when our customers
> who are using Bigtop 1.5 migrates their platform to 3.0 in the future.
>
> Kengo Seki <se...@apache.org>
>
> On Thu, Oct 21, 2021 at 12:43 AM Luca Toscano <to...@gmail.com>
> wrote:
> >
> > This is really great, so happy to see 3.0 in RC state!
> >
> > We will probably not be able to test a full upgrade of our testing
> > environment for this vote, but we'll surely report back any issue that
> > we find when we decide to upgrade. Since this is a hadoop 2 -> hadoop
> > 3 upgrade for Bigtop, is there any documentation/guideline/etc.. that
> > is available to help people to migrate their configs to the new major
> > version?
> >
> > Luca
> >
> > On Tue, Oct 19, 2021 at 1:17 AM Kengo Seki <se...@apache.org> wrote:
> > >
> > > This is the vote for release 3.0.0 of Apache Bigtop.
> > >
> > > It fixes the following issues:
> > >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> > >
> > > The vote will be going for at least 72 hours and will be closed on
> Thursday,
> > > October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> > >
> > > [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > > [ ] +0, I don't care either way,
> > > [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > > Bigtop, because...
> > >
> > > Source and binary files:
> > > https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> > >
> > > Maven staging repo:
> > >
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
> > >
> > > The git tag to be voted upon is release-3.0.0
> > >
> > > Bigtop's KEYS file containing PGP keys we use to sign the release:
> > > https://dist.apache.org/repos/dist/release/bigtop/KEYS
> > >
> > > You can see the results of packaging, deployment and smoke tests on
> > > the CI environment in the following URLs.
> > > Some builds had to be retried several times since some of our tests
> > > are flaky, but all of them succeeded at last.
> > > (I ran the smoke tests for all distros on x86_64. Regarding aarch64
> and ppc64le,
> > > I ran them only for CentOS and Debian on the former and for Fedora and
> > > Ubuntu on the latter,
> > > since our computation resource is respectively limited.)
> > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > >
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> > >
> > > Kengo Seki <se...@apache.org>
>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Kengo Seki <se...@apache.org>.
> Since this is a hadoop 2 -> hadoop 3 upgrade for Bigtop,
> is there any documentation/guideline/etc.. that is available
> to help people to migrate their configs to the new major version?
I'm afraid there is no document like that right now,
so we have to check the migration guide of each products.
> we'll surely report back any issue that
> we find when we decide to upgrade.
Thanks! Your feedback is always very helpful.
Masatake and I will also report back our findings when our customers
who are using Bigtop 1.5 migrates their platform to 3.0 in the future.
Kengo Seki <se...@apache.org>
On Thu, Oct 21, 2021 at 12:43 AM Luca Toscano <to...@gmail.com> wrote:
>
> This is really great, so happy to see 3.0 in RC state!
>
> We will probably not be able to test a full upgrade of our testing
> environment for this vote, but we'll surely report back any issue that
> we find when we decide to upgrade. Since this is a hadoop 2 -> hadoop
> 3 upgrade for Bigtop, is there any documentation/guideline/etc.. that
> is available to help people to migrate their configs to the new major
> version?
>
> Luca
>
> On Tue, Oct 19, 2021 at 1:17 AM Kengo Seki <se...@apache.org> wrote:
> >
> > This is the vote for release 3.0.0 of Apache Bigtop.
> >
> > It fixes the following issues:
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
> >
> > The vote will be going for at least 72 hours and will be closed on Thursday,
> > October 21st, 2021 at 17:00 PDT. Please download, test and vote with
> >
> > [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> > [ ] +0, I don't care either way,
> > [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> > Bigtop, because...
> >
> > Source and binary files:
> > https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
> >
> > Maven staging repo:
> > https://repository.apache.org/content/repositories/orgapachebigtop-1031
> >
> > The git tag to be voted upon is release-3.0.0
> >
> > Bigtop's KEYS file containing PGP keys we use to sign the release:
> > https://dist.apache.org/repos/dist/release/bigtop/KEYS
> >
> > You can see the results of packaging, deployment and smoke tests on
> > the CI environment in the following URLs.
> > Some builds had to be retried several times since some of our tests
> > are flaky, but all of them succeeded at last.
> > (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
> > I ran them only for CentOS and Debian on the former and for Fedora and
> > Ubuntu on the latter,
> > since our computation resource is respectively limited.)
> > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> > https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
> >
> > Kengo Seki <se...@apache.org>
Re: [VOTE] Release Bigtop version 3.0.0
Posted by Luca Toscano <to...@gmail.com>.
This is really great, so happy to see 3.0 in RC state!
We will probably not be able to test a full upgrade of our testing
environment for this vote, but we'll surely report back any issue that
we find when we decide to upgrade. Since this is a hadoop 2 -> hadoop
3 upgrade for Bigtop, is there any documentation/guideline/etc.. that
is available to help people to migrate their configs to the new major
version?
Luca
On Tue, Oct 19, 2021 at 1:17 AM Kengo Seki <se...@apache.org> wrote:
>
> This is the vote for release 3.0.0 of Apache Bigtop.
>
> It fixes the following issues:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311420&version=12349352
>
> The vote will be going for at least 72 hours and will be closed on Thursday,
> October 21st, 2021 at 17:00 PDT. Please download, test and vote with
>
> [ ] +1, accept RC0 as the official 3.0.0 release of Apache Bigtop
> [ ] +0, I don't care either way,
> [ ] -1, do not accept RC0 as the official 3.0.0 release of Apache
> Bigtop, because...
>
> Source and binary files:
> https://dist.apache.org/repos/dist/dev/bigtop/bigtop-3.0.0-RC0/
>
> Maven staging repo:
> https://repository.apache.org/content/repositories/orgapachebigtop-1031
>
> The git tag to be voted upon is release-3.0.0
>
> Bigtop's KEYS file containing PGP keys we use to sign the release:
> https://dist.apache.org/repos/dist/release/bigtop/KEYS
>
> You can see the results of packaging, deployment and smoke tests on
> the CI environment in the following URLs.
> Some builds had to be retried several times since some of our tests
> are flaky, but all of them succeeded at last.
> (I ran the smoke tests for all distros on x86_64. Regarding aarch64 and ppc64le,
> I ran them only for CentOS and Debian on the former and for Fedora and
> Ubuntu on the latter,
> since our computation resource is respectively limited.)
> https://ci.bigtop.apache.org/view/Releases/job/Bigtop-3.0.0/
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.0.0-smoke-tests/
>
> Kengo Seki <se...@apache.org>