You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by Shiyan Xu <xu...@gmail.com> on 2022/04/06 19:36:47 UTC
[VOTE] Release 0.11.0, release candidate #1
Hi everyone,
Please review and vote on the release candidate #1 for the version 0.11.0,
as follows:
[ ] +1, Approve the release
[ ] -1, Do not approve the release (please provide specific comments)
The complete staging area is available for your review, which includes:
* JIRA release notes [1],
* the official Apache source release and binary convenience releases to be
deployed to dist.apache.org [2], which are signed with the key with
fingerprint E1FACC15B67B2C5149224052D3B314F3B6E9C746 [3],
* all artifacts to be deployed to the Maven Central Repository [4],
* source code tag "0.11.0-rc1" [5],
The vote will be open for at least 72 hours. It is adopted by majority
approval, with at least 3 PMC affirmative votes.
Thanks,
Release Manager
[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12350673
[2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.11.0-rc1/
[3] https://dist.apache.org/repos/dist/release/hudi/KEYS
[4] https://repository.apache.org/content/repositories/orgapachehudi-1056/
[5] https://github.com/apache/hudi/releases/tag/release-0.11.0-rc1
Re: [VOTE] Release 0.11.0, release candidate #1
Posted by Shiyan Xu <xu...@gmail.com>.
Based on the feedback, we will cancel RC1 and I'll start preparing RC2
within 1 day. Thank you all.
On Mon, Apr 11, 2022 at 6:07 AM Y Ethan Guo <et...@gmail.com>
wrote:
> -1
>
> During my testing of 0.11.0 RC1 with Deltastreamer, errors have come up due
> to the issues Siva mentioned.
>
> On Sun, Apr 10, 2022 at 11:03 AM Shiyan Xu <xu...@gmail.com>
> wrote:
>
> > -1
> >
> > Rat plugin in CI was not working for some time and resulted in some files
> > missing Apache license header. This was fixed in master
> >
> >
> https://github.com/apache/hudi/commit/5e65aefc61e973a959c11f08c2aa9f19fefc09fc
> >
> >
> >
> > On Sat, Apr 9, 2022 at 9:01 PM Sivabalan <n....@gmail.com> wrote:
> >
> > > -1
> > >
> > > a. release validation script failed due to presence of non-text files.
> > > b. We identified a few bugs that are blocker and needs to be added to
> RC.
> > > One of the fixes have already been landed, but two are under review.
> > >
> > > https://issues.apache.org/jira/browse/HUDI-3636 : With deltastreamer
> and
> > > async table services, timeline server is not managed well on
> > re-initiating
> > > write clients. This will fail the pipeline from time to time and thwart
> > > progress.
> > > https://issues.apache.org/jira/browse/HUDI-3807: We are adding new
> > > partitions to MDT in 0.11, and added a new bloom filter index based out
> > of
> > > it. But its not guarded by a flag and by default gets enabled.
> > > https://issues.apache.org/jira/browse/HUDI-3454: Partition name
> parsing
> > > had
> > > bugs with LogRecordScanner in some of the code paths.
> > >
> > > Appendix
> > > a. release validation failures
> > >
> > > ./release/validate_staged_release.sh --release=0.11.0 --rc_num=1
> > > Validation release 0.11.0 for RC 1 and release type dev
> > > /tmp/validation_scratch_dir_001
> > > ~/Documents/personal/projects/apache_hudi_dec/hudi/scripts
> > > Downloading from svn co https://dist.apache.org/repos/dist//dev/hudi
> > > Validating hudi-0.11.0-rc1 with release type "dev"
> > > Checking Checksum of Source Release
> > > Checksum Check of Source Release - [OK]
> > >
> > > % Total % Received % Xferd Average Speed Time Time Time
> > > Current
> > > Dload Upload Total Spent Left
> > > Speed
> > > 100 55975 100 55975 0 0 162k 0 --:--:-- --:--:--
> --:--:--
> > > 162k
> > > Checking Signature
> > > Signature Check - [OK]
> > >
> > > Checking for binary files in source release
> > > There were non-text files in source release. Please check below
> > >
> > > ./docker/push_to_docker_hub.png: image/png; charset=binary
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, 6 Apr 2022 at 15:37, Shiyan Xu <xu...@gmail.com>
> > > wrote:
> > >
> > > > Hi everyone,
> > > >
> > > > Please review and vote on the release candidate #1 for the version
> > > 0.11.0,
> > > > as follows:
> > > >
> > > > [ ] +1, Approve the release
> > > >
> > > > [ ] -1, Do not approve the release (please provide specific comments)
> > > >
> > > >
> > > >
> > > > The complete staging area is available for your review, which
> includes:
> > > >
> > > > * JIRA release notes [1],
> > > >
> > > > * the official Apache source release and binary convenience releases
> to
> > > be
> > > > deployed to dist.apache.org [2], which are signed with the key with
> > > > fingerprint E1FACC15B67B2C5149224052D3B314F3B6E9C746 [3],
> > > >
> > > > * all artifacts to be deployed to the Maven Central Repository [4],
> > > >
> > > > * source code tag "0.11.0-rc1" [5],
> > > >
> > > >
> > > >
> > > > The vote will be open for at least 72 hours. It is adopted by
> majority
> > > > approval, with at least 3 PMC affirmative votes.
> > > >
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > Release Manager
> > > >
> > > >
> > > >
> > > > [1]
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12350673
> > > >
> > > > [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.11.0-rc1/
> > > >
> > > > [3] https://dist.apache.org/repos/dist/release/hudi/KEYS
> > > >
> > > > [4]
> > > https://repository.apache.org/content/repositories/orgapachehudi-1056/
> > > >
> > > > [5] https://github.com/apache/hudi/releases/tag/release-0.11.0-rc1
> > > >
> > >
> > >
> > > --
> > > Regards,
> > > -Sivabalan
> > >
> >
> >
> > --
> > Best,
> > Shiyan
> >
>
--
Best,
Shiyan
Re: [VOTE] Release 0.11.0, release candidate #1
Posted by Y Ethan Guo <et...@gmail.com>.
-1
During my testing of 0.11.0 RC1 with Deltastreamer, errors have come up due
to the issues Siva mentioned.
On Sun, Apr 10, 2022 at 11:03 AM Shiyan Xu <xu...@gmail.com>
wrote:
> -1
>
> Rat plugin in CI was not working for some time and resulted in some files
> missing Apache license header. This was fixed in master
>
> https://github.com/apache/hudi/commit/5e65aefc61e973a959c11f08c2aa9f19fefc09fc
>
>
>
> On Sat, Apr 9, 2022 at 9:01 PM Sivabalan <n....@gmail.com> wrote:
>
> > -1
> >
> > a. release validation script failed due to presence of non-text files.
> > b. We identified a few bugs that are blocker and needs to be added to RC.
> > One of the fixes have already been landed, but two are under review.
> >
> > https://issues.apache.org/jira/browse/HUDI-3636 : With deltastreamer and
> > async table services, timeline server is not managed well on
> re-initiating
> > write clients. This will fail the pipeline from time to time and thwart
> > progress.
> > https://issues.apache.org/jira/browse/HUDI-3807: We are adding new
> > partitions to MDT in 0.11, and added a new bloom filter index based out
> of
> > it. But its not guarded by a flag and by default gets enabled.
> > https://issues.apache.org/jira/browse/HUDI-3454: Partition name parsing
> > had
> > bugs with LogRecordScanner in some of the code paths.
> >
> > Appendix
> > a. release validation failures
> >
> > ./release/validate_staged_release.sh --release=0.11.0 --rc_num=1
> > Validation release 0.11.0 for RC 1 and release type dev
> > /tmp/validation_scratch_dir_001
> > ~/Documents/personal/projects/apache_hudi_dec/hudi/scripts
> > Downloading from svn co https://dist.apache.org/repos/dist//dev/hudi
> > Validating hudi-0.11.0-rc1 with release type "dev"
> > Checking Checksum of Source Release
> > Checksum Check of Source Release - [OK]
> >
> > % Total % Received % Xferd Average Speed Time Time Time
> > Current
> > Dload Upload Total Spent Left
> > Speed
> > 100 55975 100 55975 0 0 162k 0 --:--:-- --:--:-- --:--:--
> > 162k
> > Checking Signature
> > Signature Check - [OK]
> >
> > Checking for binary files in source release
> > There were non-text files in source release. Please check below
> >
> > ./docker/push_to_docker_hub.png: image/png; charset=binary
> >
> >
> >
> >
> >
> >
> >
> >
> > On Wed, 6 Apr 2022 at 15:37, Shiyan Xu <xu...@gmail.com>
> > wrote:
> >
> > > Hi everyone,
> > >
> > > Please review and vote on the release candidate #1 for the version
> > 0.11.0,
> > > as follows:
> > >
> > > [ ] +1, Approve the release
> > >
> > > [ ] -1, Do not approve the release (please provide specific comments)
> > >
> > >
> > >
> > > The complete staging area is available for your review, which includes:
> > >
> > > * JIRA release notes [1],
> > >
> > > * the official Apache source release and binary convenience releases to
> > be
> > > deployed to dist.apache.org [2], which are signed with the key with
> > > fingerprint E1FACC15B67B2C5149224052D3B314F3B6E9C746 [3],
> > >
> > > * all artifacts to be deployed to the Maven Central Repository [4],
> > >
> > > * source code tag "0.11.0-rc1" [5],
> > >
> > >
> > >
> > > The vote will be open for at least 72 hours. It is adopted by majority
> > > approval, with at least 3 PMC affirmative votes.
> > >
> > >
> > >
> > > Thanks,
> > >
> > > Release Manager
> > >
> > >
> > >
> > > [1]
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12350673
> > >
> > > [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.11.0-rc1/
> > >
> > > [3] https://dist.apache.org/repos/dist/release/hudi/KEYS
> > >
> > > [4]
> > https://repository.apache.org/content/repositories/orgapachehudi-1056/
> > >
> > > [5] https://github.com/apache/hudi/releases/tag/release-0.11.0-rc1
> > >
> >
> >
> > --
> > Regards,
> > -Sivabalan
> >
>
>
> --
> Best,
> Shiyan
>
Re: [VOTE] Release 0.11.0, release candidate #1
Posted by Shiyan Xu <xu...@gmail.com>.
-1
Rat plugin in CI was not working for some time and resulted in some files
missing Apache license header. This was fixed in master
https://github.com/apache/hudi/commit/5e65aefc61e973a959c11f08c2aa9f19fefc09fc
On Sat, Apr 9, 2022 at 9:01 PM Sivabalan <n....@gmail.com> wrote:
> -1
>
> a. release validation script failed due to presence of non-text files.
> b. We identified a few bugs that are blocker and needs to be added to RC.
> One of the fixes have already been landed, but two are under review.
>
> https://issues.apache.org/jira/browse/HUDI-3636 : With deltastreamer and
> async table services, timeline server is not managed well on re-initiating
> write clients. This will fail the pipeline from time to time and thwart
> progress.
> https://issues.apache.org/jira/browse/HUDI-3807: We are adding new
> partitions to MDT in 0.11, and added a new bloom filter index based out of
> it. But its not guarded by a flag and by default gets enabled.
> https://issues.apache.org/jira/browse/HUDI-3454: Partition name parsing
> had
> bugs with LogRecordScanner in some of the code paths.
>
> Appendix
> a. release validation failures
>
> ./release/validate_staged_release.sh --release=0.11.0 --rc_num=1
> Validation release 0.11.0 for RC 1 and release type dev
> /tmp/validation_scratch_dir_001
> ~/Documents/personal/projects/apache_hudi_dec/hudi/scripts
> Downloading from svn co https://dist.apache.org/repos/dist//dev/hudi
> Validating hudi-0.11.0-rc1 with release type "dev"
> Checking Checksum of Source Release
> Checksum Check of Source Release - [OK]
>
> % Total % Received % Xferd Average Speed Time Time Time
> Current
> Dload Upload Total Spent Left
> Speed
> 100 55975 100 55975 0 0 162k 0 --:--:-- --:--:-- --:--:--
> 162k
> Checking Signature
> Signature Check - [OK]
>
> Checking for binary files in source release
> There were non-text files in source release. Please check below
>
> ./docker/push_to_docker_hub.png: image/png; charset=binary
>
>
>
>
>
>
>
>
> On Wed, 6 Apr 2022 at 15:37, Shiyan Xu <xu...@gmail.com>
> wrote:
>
> > Hi everyone,
> >
> > Please review and vote on the release candidate #1 for the version
> 0.11.0,
> > as follows:
> >
> > [ ] +1, Approve the release
> >
> > [ ] -1, Do not approve the release (please provide specific comments)
> >
> >
> >
> > The complete staging area is available for your review, which includes:
> >
> > * JIRA release notes [1],
> >
> > * the official Apache source release and binary convenience releases to
> be
> > deployed to dist.apache.org [2], which are signed with the key with
> > fingerprint E1FACC15B67B2C5149224052D3B314F3B6E9C746 [3],
> >
> > * all artifacts to be deployed to the Maven Central Repository [4],
> >
> > * source code tag "0.11.0-rc1" [5],
> >
> >
> >
> > The vote will be open for at least 72 hours. It is adopted by majority
> > approval, with at least 3 PMC affirmative votes.
> >
> >
> >
> > Thanks,
> >
> > Release Manager
> >
> >
> >
> > [1]
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12350673
> >
> > [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.11.0-rc1/
> >
> > [3] https://dist.apache.org/repos/dist/release/hudi/KEYS
> >
> > [4]
> https://repository.apache.org/content/repositories/orgapachehudi-1056/
> >
> > [5] https://github.com/apache/hudi/releases/tag/release-0.11.0-rc1
> >
>
>
> --
> Regards,
> -Sivabalan
>
--
Best,
Shiyan
Re: [VOTE] Release 0.11.0, release candidate #1
Posted by Sivabalan <n....@gmail.com>.
-1
a. release validation script failed due to presence of non-text files.
b. We identified a few bugs that are blocker and needs to be added to RC.
One of the fixes have already been landed, but two are under review.
https://issues.apache.org/jira/browse/HUDI-3636 : With deltastreamer and
async table services, timeline server is not managed well on re-initiating
write clients. This will fail the pipeline from time to time and thwart
progress.
https://issues.apache.org/jira/browse/HUDI-3807: We are adding new
partitions to MDT in 0.11, and added a new bloom filter index based out of
it. But its not guarded by a flag and by default gets enabled.
https://issues.apache.org/jira/browse/HUDI-3454: Partition name parsing had
bugs with LogRecordScanner in some of the code paths.
Appendix
a. release validation failures
./release/validate_staged_release.sh --release=0.11.0 --rc_num=1
Validation release 0.11.0 for RC 1 and release type dev
/tmp/validation_scratch_dir_001
~/Documents/personal/projects/apache_hudi_dec/hudi/scripts
Downloading from svn co https://dist.apache.org/repos/dist//dev/hudi
Validating hudi-0.11.0-rc1 with release type "dev"
Checking Checksum of Source Release
Checksum Check of Source Release - [OK]
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 55975 100 55975 0 0 162k 0 --:--:-- --:--:-- --:--:-- 162k
Checking Signature
Signature Check - [OK]
Checking for binary files in source release
There were non-text files in source release. Please check below
./docker/push_to_docker_hub.png: image/png; charset=binary
On Wed, 6 Apr 2022 at 15:37, Shiyan Xu <xu...@gmail.com> wrote:
> Hi everyone,
>
> Please review and vote on the release candidate #1 for the version 0.11.0,
> as follows:
>
> [ ] +1, Approve the release
>
> [ ] -1, Do not approve the release (please provide specific comments)
>
>
>
> The complete staging area is available for your review, which includes:
>
> * JIRA release notes [1],
>
> * the official Apache source release and binary convenience releases to be
> deployed to dist.apache.org [2], which are signed with the key with
> fingerprint E1FACC15B67B2C5149224052D3B314F3B6E9C746 [3],
>
> * all artifacts to be deployed to the Maven Central Repository [4],
>
> * source code tag "0.11.0-rc1" [5],
>
>
>
> The vote will be open for at least 72 hours. It is adopted by majority
> approval, with at least 3 PMC affirmative votes.
>
>
>
> Thanks,
>
> Release Manager
>
>
>
> [1]
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822&version=12350673
>
> [2] https://dist.apache.org/repos/dist/dev/hudi/hudi-0.11.0-rc1/
>
> [3] https://dist.apache.org/repos/dist/release/hudi/KEYS
>
> [4] https://repository.apache.org/content/repositories/orgapachehudi-1056/
>
> [5] https://github.com/apache/hudi/releases/tag/release-0.11.0-rc1
>
--
Regards,
-Sivabalan