You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Chao Sun <su...@apache.org> on 2022/02/11 21:40:59 UTC
[VOTE] Release Apache Hadoop 3.3.2 - RC4
Hi all,
Sorry for the delay! was waiting for a few fixes that people have requested
to backport. I've just put together Hadoop 3.3.2 RC4 below:
The RC is available at: http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1334/
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
The deltas between this and RC3 are the addition of the following fixes:
- HADOOP-17198. Support S3 Access Points
- HADOOP-18096. Distcp: Sync moves filtered file to home directory rather
than deleting.
- YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
application catalog webapp
Same as before, I've done the following verification and they look good:
- Ran all the unit tests
- Started a single node HDFS cluster and tested a few simple commands
- Ran all the tests in Spark using the RC4 artifacts
Please evaluate the RC and vote, thanks!
Best,
Chao
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun <su...@apache.org> wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG. Thanks
> everyone! In the meantime you can still evaluate the binary bits of this RC
> since they won't change.
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
>
>> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
>> finishes successfully [1] and is not part of the released Maven artifacts,
>> I'm thinking of just replacing the existing one in
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
>> another RC. What do you think?
>>
>> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>>
>> Best,
>> Chao
>>
>> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>>
>>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>>> After checking to build from source and setting up a pseudo cluster
>>> based on the
>>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>>> changelog, right?
>>> Please feel free to share information if you meet any blocker issues to
>>> push this release
>>> progress forward.
>>> Thanks Chao again.
>>>
>>> Best,
>>> - He Xiaoqiao
>>>
>>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>>> I am curious if this requires new RC or you would like to update
>>>> Changelog
>>>> in the existing RC. Either way, once Changelog is updated, and since
>>>> other
>>>> functional testing looks good anyways, my vote would be +1
>>>> (non-binding).
>>>>
>>>>
>>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>>
>>>> > Thanks again Viraj!
>>>> >
>>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>>> >
>>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I
>>>> removed the
>>>> > fix version tag.
>>>> >
>>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> > present.
>>>> >
>>>> > Removed the fix version tag for this too.
>>>> >
>>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found
>>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>>> >
>>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>>> >
>>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>>> tag.
>>>> >
>>>> > Please check again when you have a chance. Thanks.
>>>> >
>>>> > Best,
>>>> > Chao
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >
>>>> >> Thanks Chao. I just re-executed the script and found very minor
>>>> >> differences:
>>>> >>
>>>> >> 1. Incorrect fix versions:
>>>> >> HADOOP-17988
>>>> >> HADOOP-17728
>>>> >>
>>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> >> present.
>>>> >>
>>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found on
>>>> >> 3.3.2:
>>>> >> HADOOP-17936
>>>> >> HADOOP-18066
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>>> many
>>>> >>> JIRAs. The script is super useful!
>>>> >>>
>>>> >>> I just fixed the "fix version" of these. Could you double check?
>>>> Really
>>>> >>> appreciate you putting effort to do a thorough check on this.
>>>> >>>
>>>> >>> Chao
>>>> >>>
>>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>>> resolved
>>>> >>>> and
>>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>>> >>>>
>>>> >>>> Basic RC verification using hadoop-vote.sh
>>>> >>>> <
>>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >>>> >:
>>>> >>>>
>>>> >>>> * Signature: ok
>>>> >>>> * Checksum : ok
>>>> >>>> * Rat check (1.8.0_301): ok
>>>> >>>> - mvn clean apache-rat:check
>>>> >>>> * Built from source (1.8.0_301): ok
>>>> >>>> - mvn clean install -DskipTests
>>>> >>>> * Built tar from source (1.8.0_301): ok
>>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> >>>> -Dmaven.javadoc.skip=true
>>>> >>>>
>>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>>> from
>>>> >>>> previous RC.
>>>> >>>>
>>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>>> >>>>
>>>> >>>> Jiras with missing fixVersion: 3.3.2
>>>> >>>>
>>>> >>>> HADOOP-17198
>>>> >>>> HDFS-16344
>>>> >>>> HDFS-16339
>>>> >>>> YARN-11007
>>>> >>>> HDFS-16171
>>>> >>>> HDFS-16350
>>>> >>>> HDFS-16336
>>>> >>>> HADOOP-17975
>>>> >>>> YARN-10991
>>>> >>>> HDFS-16332
>>>> >>>> HADOOP-17857
>>>> >>>> HDFS-16271
>>>> >>>> HADOOP-17195
>>>> >>>> HADOOP-17290
>>>> >>>> HADOOP-17819
>>>> >>>> YARN-9551
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>>> testing.
>>>> >>>> >
>>>> >>>> >
>>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>> >
>>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> >>>> again?
>>>> >>>> >> Thanks!
>>>> >>>> >>
>>>> >>>> >> Chao
>>>> >>>> >>
>>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <
>>>> vjasani@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >>> > The RC is available at:
>>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>
>>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>> >>>
>>>> >>>> >>>
>>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>>
>>>> >>>> >>>> Hi all,
>>>> >>>> >>>>
>>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>>> have
>>>> >>>> >>>> requested
>>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>> >>>>
>>>> >>>> >>>> The RC is available at:
>>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>> The RC tag is at:
>>>> >>>> >>>>
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> >>>> The Maven artifacts are staged at:
>>>> >>>> >>>>
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>> >>>>
>>>> >>>> >>>> You can find my public key at:
>>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>> >>>>
>>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>>> following
>>>> >>>> fixes:
>>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> >>>> directory
>>>> >>>> >>>> rather
>>>> >>>> >>>> than deleting.
>>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>>> in
>>>> >>>> YARN
>>>> >>>> >>>> application catalog webapp
>>>> >>>> >>>>
>>>> >>>> >>>> Same as before, I've done the following verification and they
>>>> look
>>>> >>>> good:
>>>> >>>> >>>> - Ran all the unit tests
>>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> >>>> commands
>>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>> >>>>
>>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>> >>>>
>>>> >>>> >>>> Best,
>>>> >>>> >>>> Chao
>>>> >>>> >>>>
>>>> >>>> >>>
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun <su...@apache.org> wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG. Thanks
> everyone! In the meantime you can still evaluate the binary bits of this RC
> since they won't change.
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
>
>> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
>> finishes successfully [1] and is not part of the released Maven artifacts,
>> I'm thinking of just replacing the existing one in
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
>> another RC. What do you think?
>>
>> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>>
>> Best,
>> Chao
>>
>> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>>
>>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>>> After checking to build from source and setting up a pseudo cluster
>>> based on the
>>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>>> changelog, right?
>>> Please feel free to share information if you meet any blocker issues to
>>> push this release
>>> progress forward.
>>> Thanks Chao again.
>>>
>>> Best,
>>> - He Xiaoqiao
>>>
>>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>>> I am curious if this requires new RC or you would like to update
>>>> Changelog
>>>> in the existing RC. Either way, once Changelog is updated, and since
>>>> other
>>>> functional testing looks good anyways, my vote would be +1
>>>> (non-binding).
>>>>
>>>>
>>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>>
>>>> > Thanks again Viraj!
>>>> >
>>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>>> >
>>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I
>>>> removed the
>>>> > fix version tag.
>>>> >
>>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> > present.
>>>> >
>>>> > Removed the fix version tag for this too.
>>>> >
>>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found
>>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>>> >
>>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>>> >
>>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>>> tag.
>>>> >
>>>> > Please check again when you have a chance. Thanks.
>>>> >
>>>> > Best,
>>>> > Chao
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >
>>>> >> Thanks Chao. I just re-executed the script and found very minor
>>>> >> differences:
>>>> >>
>>>> >> 1. Incorrect fix versions:
>>>> >> HADOOP-17988
>>>> >> HADOOP-17728
>>>> >>
>>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> >> present.
>>>> >>
>>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found on
>>>> >> 3.3.2:
>>>> >> HADOOP-17936
>>>> >> HADOOP-18066
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>>> many
>>>> >>> JIRAs. The script is super useful!
>>>> >>>
>>>> >>> I just fixed the "fix version" of these. Could you double check?
>>>> Really
>>>> >>> appreciate you putting effort to do a thorough check on this.
>>>> >>>
>>>> >>> Chao
>>>> >>>
>>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>>> resolved
>>>> >>>> and
>>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>>> >>>>
>>>> >>>> Basic RC verification using hadoop-vote.sh
>>>> >>>> <
>>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >>>> >:
>>>> >>>>
>>>> >>>> * Signature: ok
>>>> >>>> * Checksum : ok
>>>> >>>> * Rat check (1.8.0_301): ok
>>>> >>>> - mvn clean apache-rat:check
>>>> >>>> * Built from source (1.8.0_301): ok
>>>> >>>> - mvn clean install -DskipTests
>>>> >>>> * Built tar from source (1.8.0_301): ok
>>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> >>>> -Dmaven.javadoc.skip=true
>>>> >>>>
>>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>>> from
>>>> >>>> previous RC.
>>>> >>>>
>>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>>> >>>>
>>>> >>>> Jiras with missing fixVersion: 3.3.2
>>>> >>>>
>>>> >>>> HADOOP-17198
>>>> >>>> HDFS-16344
>>>> >>>> HDFS-16339
>>>> >>>> YARN-11007
>>>> >>>> HDFS-16171
>>>> >>>> HDFS-16350
>>>> >>>> HDFS-16336
>>>> >>>> HADOOP-17975
>>>> >>>> YARN-10991
>>>> >>>> HDFS-16332
>>>> >>>> HADOOP-17857
>>>> >>>> HDFS-16271
>>>> >>>> HADOOP-17195
>>>> >>>> HADOOP-17290
>>>> >>>> HADOOP-17819
>>>> >>>> YARN-9551
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>>> testing.
>>>> >>>> >
>>>> >>>> >
>>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>> >
>>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> >>>> again?
>>>> >>>> >> Thanks!
>>>> >>>> >>
>>>> >>>> >> Chao
>>>> >>>> >>
>>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <
>>>> vjasani@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >>> > The RC is available at:
>>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>
>>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>> >>>
>>>> >>>> >>>
>>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>>
>>>> >>>> >>>> Hi all,
>>>> >>>> >>>>
>>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>>> have
>>>> >>>> >>>> requested
>>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>> >>>>
>>>> >>>> >>>> The RC is available at:
>>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>> The RC tag is at:
>>>> >>>> >>>>
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> >>>> The Maven artifacts are staged at:
>>>> >>>> >>>>
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>> >>>>
>>>> >>>> >>>> You can find my public key at:
>>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>> >>>>
>>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>>> following
>>>> >>>> fixes:
>>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> >>>> directory
>>>> >>>> >>>> rather
>>>> >>>> >>>> than deleting.
>>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>>> in
>>>> >>>> YARN
>>>> >>>> >>>> application catalog webapp
>>>> >>>> >>>>
>>>> >>>> >>>> Same as before, I've done the following verification and they
>>>> look
>>>> >>>> good:
>>>> >>>> >>>> - Ran all the unit tests
>>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> >>>> commands
>>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>> >>>>
>>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>> >>>>
>>>> >>>> >>>> Best,
>>>> >>>> >>>> Chao
>>>> >>>> >>>>
>>>> >>>> >>>
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun <su...@apache.org> wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG. Thanks
> everyone! In the meantime you can still evaluate the binary bits of this RC
> since they won't change.
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
>
>> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
>> finishes successfully [1] and is not part of the released Maven artifacts,
>> I'm thinking of just replacing the existing one in
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
>> another RC. What do you think?
>>
>> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>>
>> Best,
>> Chao
>>
>> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>>
>>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>>> After checking to build from source and setting up a pseudo cluster
>>> based on the
>>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>>> changelog, right?
>>> Please feel free to share information if you meet any blocker issues to
>>> push this release
>>> progress forward.
>>> Thanks Chao again.
>>>
>>> Best,
>>> - He Xiaoqiao
>>>
>>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>>> I am curious if this requires new RC or you would like to update
>>>> Changelog
>>>> in the existing RC. Either way, once Changelog is updated, and since
>>>> other
>>>> functional testing looks good anyways, my vote would be +1
>>>> (non-binding).
>>>>
>>>>
>>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>>
>>>> > Thanks again Viraj!
>>>> >
>>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>>> >
>>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I
>>>> removed the
>>>> > fix version tag.
>>>> >
>>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> > present.
>>>> >
>>>> > Removed the fix version tag for this too.
>>>> >
>>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found
>>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>>> >
>>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>>> >
>>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>>> tag.
>>>> >
>>>> > Please check again when you have a chance. Thanks.
>>>> >
>>>> > Best,
>>>> > Chao
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >
>>>> >> Thanks Chao. I just re-executed the script and found very minor
>>>> >> differences:
>>>> >>
>>>> >> 1. Incorrect fix versions:
>>>> >> HADOOP-17988
>>>> >> HADOOP-17728
>>>> >>
>>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> >> present.
>>>> >>
>>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found on
>>>> >> 3.3.2:
>>>> >> HADOOP-17936
>>>> >> HADOOP-18066
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>>> many
>>>> >>> JIRAs. The script is super useful!
>>>> >>>
>>>> >>> I just fixed the "fix version" of these. Could you double check?
>>>> Really
>>>> >>> appreciate you putting effort to do a thorough check on this.
>>>> >>>
>>>> >>> Chao
>>>> >>>
>>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>>> resolved
>>>> >>>> and
>>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>>> >>>>
>>>> >>>> Basic RC verification using hadoop-vote.sh
>>>> >>>> <
>>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >>>> >:
>>>> >>>>
>>>> >>>> * Signature: ok
>>>> >>>> * Checksum : ok
>>>> >>>> * Rat check (1.8.0_301): ok
>>>> >>>> - mvn clean apache-rat:check
>>>> >>>> * Built from source (1.8.0_301): ok
>>>> >>>> - mvn clean install -DskipTests
>>>> >>>> * Built tar from source (1.8.0_301): ok
>>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> >>>> -Dmaven.javadoc.skip=true
>>>> >>>>
>>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>>> from
>>>> >>>> previous RC.
>>>> >>>>
>>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>>> >>>>
>>>> >>>> Jiras with missing fixVersion: 3.3.2
>>>> >>>>
>>>> >>>> HADOOP-17198
>>>> >>>> HDFS-16344
>>>> >>>> HDFS-16339
>>>> >>>> YARN-11007
>>>> >>>> HDFS-16171
>>>> >>>> HDFS-16350
>>>> >>>> HDFS-16336
>>>> >>>> HADOOP-17975
>>>> >>>> YARN-10991
>>>> >>>> HDFS-16332
>>>> >>>> HADOOP-17857
>>>> >>>> HDFS-16271
>>>> >>>> HADOOP-17195
>>>> >>>> HADOOP-17290
>>>> >>>> HADOOP-17819
>>>> >>>> YARN-9551
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>>> testing.
>>>> >>>> >
>>>> >>>> >
>>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>> >
>>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> >>>> again?
>>>> >>>> >> Thanks!
>>>> >>>> >>
>>>> >>>> >> Chao
>>>> >>>> >>
>>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <
>>>> vjasani@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >>> > The RC is available at:
>>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>
>>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>> >>>
>>>> >>>> >>>
>>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>>
>>>> >>>> >>>> Hi all,
>>>> >>>> >>>>
>>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>>> have
>>>> >>>> >>>> requested
>>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>> >>>>
>>>> >>>> >>>> The RC is available at:
>>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>> The RC tag is at:
>>>> >>>> >>>>
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> >>>> The Maven artifacts are staged at:
>>>> >>>> >>>>
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>> >>>>
>>>> >>>> >>>> You can find my public key at:
>>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>> >>>>
>>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>>> following
>>>> >>>> fixes:
>>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> >>>> directory
>>>> >>>> >>>> rather
>>>> >>>> >>>> than deleting.
>>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>>> in
>>>> >>>> YARN
>>>> >>>> >>>> application catalog webapp
>>>> >>>> >>>>
>>>> >>>> >>>> Same as before, I've done the following verification and they
>>>> look
>>>> >>>> good:
>>>> >>>> >>>> - Ran all the unit tests
>>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> >>>> commands
>>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>> >>>>
>>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>> >>>>
>>>> >>>> >>>> Best,
>>>> >>>> >>>> Chao
>>>> >>>> >>>>
>>>> >>>> >>>
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Hi all, I just started another voting thread for RC5. Please evaluate and
vote there. Thanks!
On Mon, Feb 21, 2022 at 10:46 AM Chao Sun <su...@apache.org> wrote:
> Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
> too. I'll start a new RC with the only change being the CHANGELOG. Thanks
> everyone! In the meantime you can still evaluate the binary bits of this RC
> since they won't change.
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
>
>> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
>> finishes successfully [1] and is not part of the released Maven artifacts,
>> I'm thinking of just replacing the existing one in
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
>> another RC. What do you think?
>>
>> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>>
>> Best,
>> Chao
>>
>> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org>
>> wrote:
>>
>>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>>> After checking to build from source and setting up a pseudo cluster
>>> based on the
>>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>>> changelog, right?
>>> Please feel free to share information if you meet any blocker issues to
>>> push this release
>>> progress forward.
>>> Thanks Chao again.
>>>
>>> Best,
>>> - He Xiaoqiao
>>>
>>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>>> I am curious if this requires new RC or you would like to update
>>>> Changelog
>>>> in the existing RC. Either way, once Changelog is updated, and since
>>>> other
>>>> functional testing looks good anyways, my vote would be +1
>>>> (non-binding).
>>>>
>>>>
>>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>>
>>>> > Thanks again Viraj!
>>>> >
>>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>>> >
>>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I
>>>> removed the
>>>> > fix version tag.
>>>> >
>>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> > present.
>>>> >
>>>> > Removed the fix version tag for this too.
>>>> >
>>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found
>>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>>> >
>>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>>> >
>>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>>> tag.
>>>> >
>>>> > Please check again when you have a chance. Thanks.
>>>> >
>>>> > Best,
>>>> > Chao
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >
>>>> >> Thanks Chao. I just re-executed the script and found very minor
>>>> >> differences:
>>>> >>
>>>> >> 1. Incorrect fix versions:
>>>> >> HADOOP-17988
>>>> >> HADOOP-17728
>>>> >>
>>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>>> >> present.
>>>> >>
>>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>>> found on
>>>> >> 3.3.2:
>>>> >> HADOOP-17936
>>>> >> HADOOP-18066
>>>> >>
>>>> >>
>>>> >>
>>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>>> many
>>>> >>> JIRAs. The script is super useful!
>>>> >>>
>>>> >>> I just fixed the "fix version" of these. Could you double check?
>>>> Really
>>>> >>> appreciate you putting effort to do a thorough check on this.
>>>> >>>
>>>> >>> Chao
>>>> >>>
>>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>>> resolved
>>>> >>>> and
>>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>>> >>>>
>>>> >>>> Basic RC verification using hadoop-vote.sh
>>>> >>>> <
>>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >>>> >:
>>>> >>>>
>>>> >>>> * Signature: ok
>>>> >>>> * Checksum : ok
>>>> >>>> * Rat check (1.8.0_301): ok
>>>> >>>> - mvn clean apache-rat:check
>>>> >>>> * Built from source (1.8.0_301): ok
>>>> >>>> - mvn clean install -DskipTests
>>>> >>>> * Built tar from source (1.8.0_301): ok
>>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> >>>> -Dmaven.javadoc.skip=true
>>>> >>>>
>>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>>> from
>>>> >>>> previous RC.
>>>> >>>>
>>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>>> >>>>
>>>> >>>> Jiras with missing fixVersion: 3.3.2
>>>> >>>>
>>>> >>>> HADOOP-17198
>>>> >>>> HDFS-16344
>>>> >>>> HDFS-16339
>>>> >>>> YARN-11007
>>>> >>>> HDFS-16171
>>>> >>>> HDFS-16350
>>>> >>>> HDFS-16336
>>>> >>>> HADOOP-17975
>>>> >>>> YARN-10991
>>>> >>>> HDFS-16332
>>>> >>>> HADOOP-17857
>>>> >>>> HDFS-16271
>>>> >>>> HADOOP-17195
>>>> >>>> HADOOP-17290
>>>> >>>> HADOOP-17819
>>>> >>>> YARN-9551
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> >>>> wrote:
>>>> >>>>
>>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>>> testing.
>>>> >>>> >
>>>> >>>> >
>>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>> >
>>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> >>>> again?
>>>> >>>> >> Thanks!
>>>> >>>> >>
>>>> >>>> >> Chao
>>>> >>>> >>
>>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <
>>>> vjasani@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>
>>>> >>>> >>> > The RC is available at:
>>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>
>>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>> >>>
>>>> >>>> >>>
>>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> >>>> wrote:
>>>> >>>> >>>
>>>> >>>> >>>> Hi all,
>>>> >>>> >>>>
>>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>>> have
>>>> >>>> >>>> requested
>>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>> >>>>
>>>> >>>> >>>> The RC is available at:
>>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> >>>> The RC tag is at:
>>>> >>>> >>>>
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> >>>> The Maven artifacts are staged at:
>>>> >>>> >>>>
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>> >>>>
>>>> >>>> >>>> You can find my public key at:
>>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>> >>>>
>>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>>> following
>>>> >>>> fixes:
>>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> >>>> directory
>>>> >>>> >>>> rather
>>>> >>>> >>>> than deleting.
>>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>>> in
>>>> >>>> YARN
>>>> >>>> >>>> application catalog webapp
>>>> >>>> >>>>
>>>> >>>> >>>> Same as before, I've done the following verification and they
>>>> look
>>>> >>>> good:
>>>> >>>> >>>> - Ran all the unit tests
>>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> >>>> commands
>>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>> >>>>
>>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>> >>>>
>>>> >>>> >>>> Best,
>>>> >>>> >>>> Chao
>>>> >>>> >>>>
>>>> >>>> >>>
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
too. I'll start a new RC with the only change being the CHANGELOG. Thanks
everyone! In the meantime you can still evaluate the binary bits of this RC
since they won't change.
Best,
Chao
On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
> finishes successfully [1] and is not part of the released Maven artifacts,
> I'm thinking of just replacing the existing one in
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
> another RC. What do you think?
>
> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
>
>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>> After checking to build from source and setting up a pseudo cluster based
>> on the
>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>> changelog, right?
>> Please feel free to share information if you meet any blocker issues to
>> push this release
>> progress forward.
>> Thanks Chao again.
>>
>> Best,
>> - He Xiaoqiao
>>
>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>> I am curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>
>>> > Thanks again Viraj!
>>> >
>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>> >
>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>>> the
>>> > fix version tag.
>>> >
>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> > present.
>>> >
>>> > Removed the fix version tag for this too.
>>> >
>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found
>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>> >
>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>> >
>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>> tag.
>>> >
>>> > Please check again when you have a chance. Thanks.
>>> >
>>> > Best,
>>> > Chao
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >
>>> >> Thanks Chao. I just re-executed the script and found very minor
>>> >> differences:
>>> >>
>>> >> 1. Incorrect fix versions:
>>> >> HADOOP-17988
>>> >> HADOOP-17728
>>> >>
>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> >> present.
>>> >>
>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found on
>>> >> 3.3.2:
>>> >> HADOOP-17936
>>> >> HADOOP-18066
>>> >>
>>> >>
>>> >>
>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>> >>
>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>> many
>>> >>> JIRAs. The script is super useful!
>>> >>>
>>> >>> I just fixed the "fix version" of these. Could you double check?
>>> Really
>>> >>> appreciate you putting effort to do a thorough check on this.
>>> >>>
>>> >>> Chao
>>> >>>
>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>>
>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>> resolved
>>> >>>> and
>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>> >>>>
>>> >>>> Basic RC verification using hadoop-vote.sh
>>> >>>> <
>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >>>> >:
>>> >>>>
>>> >>>> * Signature: ok
>>> >>>> * Checksum : ok
>>> >>>> * Rat check (1.8.0_301): ok
>>> >>>> - mvn clean apache-rat:check
>>> >>>> * Built from source (1.8.0_301): ok
>>> >>>> - mvn clean install -DskipTests
>>> >>>> * Built tar from source (1.8.0_301): ok
>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> >>>> -Dmaven.javadoc.skip=true
>>> >>>>
>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>> from
>>> >>>> previous RC.
>>> >>>>
>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>> >>>>
>>> >>>> Jiras with missing fixVersion: 3.3.2
>>> >>>>
>>> >>>> HADOOP-17198
>>> >>>> HDFS-16344
>>> >>>> HDFS-16339
>>> >>>> YARN-11007
>>> >>>> HDFS-16171
>>> >>>> HDFS-16350
>>> >>>> HDFS-16336
>>> >>>> HADOOP-17975
>>> >>>> YARN-10991
>>> >>>> HDFS-16332
>>> >>>> HADOOP-17857
>>> >>>> HDFS-16271
>>> >>>> HADOOP-17195
>>> >>>> HADOOP-17290
>>> >>>> HADOOP-17819
>>> >>>> YARN-9551
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>> testing.
>>> >>>> >
>>> >>>> >
>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>> wrote:
>>> >>>> >
>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>> >>>> again?
>>> >>>> >> Thanks!
>>> >>>> >>
>>> >>>> >> Chao
>>> >>>> >>
>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vjasani@apache.org
>>> >
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >>> > The RC is available at:
>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>
>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>> >>>
>>> >>>> >>>
>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>> >>>> wrote:
>>> >>>> >>>
>>> >>>> >>>> Hi all,
>>> >>>> >>>>
>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>> have
>>> >>>> >>>> requested
>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>> >>>>
>>> >>>> >>>> The RC is available at:
>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>> The RC tag is at:
>>> >>>> >>>>
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> >>>> The Maven artifacts are staged at:
>>> >>>> >>>>
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>> >>>>
>>> >>>> >>>> You can find my public key at:
>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>> >>>>
>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>> following
>>> >>>> fixes:
>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>> >>>> directory
>>> >>>> >>>> rather
>>> >>>> >>>> than deleting.
>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>> in
>>> >>>> YARN
>>> >>>> >>>> application catalog webapp
>>> >>>> >>>>
>>> >>>> >>>> Same as before, I've done the following verification and they
>>> look
>>> >>>> good:
>>> >>>> >>>> - Ran all the unit tests
>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> >>>> commands
>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>> >>>>
>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>> >>>>
>>> >>>> >>>> Best,
>>> >>>> >>>> Chao
>>> >>>> >>>>
>>> >>>> >>>
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
too. I'll start a new RC with the only change being the CHANGELOG. Thanks
everyone! In the meantime you can still evaluate the binary bits of this RC
since they won't change.
Best,
Chao
On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
> finishes successfully [1] and is not part of the released Maven artifacts,
> I'm thinking of just replacing the existing one in
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
> another RC. What do you think?
>
> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
>
>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>> After checking to build from source and setting up a pseudo cluster based
>> on the
>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>> changelog, right?
>> Please feel free to share information if you meet any blocker issues to
>> push this release
>> progress forward.
>> Thanks Chao again.
>>
>> Best,
>> - He Xiaoqiao
>>
>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>> I am curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>
>>> > Thanks again Viraj!
>>> >
>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>> >
>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>>> the
>>> > fix version tag.
>>> >
>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> > present.
>>> >
>>> > Removed the fix version tag for this too.
>>> >
>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found
>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>> >
>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>> >
>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>> tag.
>>> >
>>> > Please check again when you have a chance. Thanks.
>>> >
>>> > Best,
>>> > Chao
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >
>>> >> Thanks Chao. I just re-executed the script and found very minor
>>> >> differences:
>>> >>
>>> >> 1. Incorrect fix versions:
>>> >> HADOOP-17988
>>> >> HADOOP-17728
>>> >>
>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> >> present.
>>> >>
>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found on
>>> >> 3.3.2:
>>> >> HADOOP-17936
>>> >> HADOOP-18066
>>> >>
>>> >>
>>> >>
>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>> >>
>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>> many
>>> >>> JIRAs. The script is super useful!
>>> >>>
>>> >>> I just fixed the "fix version" of these. Could you double check?
>>> Really
>>> >>> appreciate you putting effort to do a thorough check on this.
>>> >>>
>>> >>> Chao
>>> >>>
>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>>
>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>> resolved
>>> >>>> and
>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>> >>>>
>>> >>>> Basic RC verification using hadoop-vote.sh
>>> >>>> <
>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >>>> >:
>>> >>>>
>>> >>>> * Signature: ok
>>> >>>> * Checksum : ok
>>> >>>> * Rat check (1.8.0_301): ok
>>> >>>> - mvn clean apache-rat:check
>>> >>>> * Built from source (1.8.0_301): ok
>>> >>>> - mvn clean install -DskipTests
>>> >>>> * Built tar from source (1.8.0_301): ok
>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> >>>> -Dmaven.javadoc.skip=true
>>> >>>>
>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>> from
>>> >>>> previous RC.
>>> >>>>
>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>> >>>>
>>> >>>> Jiras with missing fixVersion: 3.3.2
>>> >>>>
>>> >>>> HADOOP-17198
>>> >>>> HDFS-16344
>>> >>>> HDFS-16339
>>> >>>> YARN-11007
>>> >>>> HDFS-16171
>>> >>>> HDFS-16350
>>> >>>> HDFS-16336
>>> >>>> HADOOP-17975
>>> >>>> YARN-10991
>>> >>>> HDFS-16332
>>> >>>> HADOOP-17857
>>> >>>> HDFS-16271
>>> >>>> HADOOP-17195
>>> >>>> HADOOP-17290
>>> >>>> HADOOP-17819
>>> >>>> YARN-9551
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>> testing.
>>> >>>> >
>>> >>>> >
>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>> wrote:
>>> >>>> >
>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>> >>>> again?
>>> >>>> >> Thanks!
>>> >>>> >>
>>> >>>> >> Chao
>>> >>>> >>
>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vjasani@apache.org
>>> >
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >>> > The RC is available at:
>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>
>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>> >>>
>>> >>>> >>>
>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>> >>>> wrote:
>>> >>>> >>>
>>> >>>> >>>> Hi all,
>>> >>>> >>>>
>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>> have
>>> >>>> >>>> requested
>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>> >>>>
>>> >>>> >>>> The RC is available at:
>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>> The RC tag is at:
>>> >>>> >>>>
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> >>>> The Maven artifacts are staged at:
>>> >>>> >>>>
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>> >>>>
>>> >>>> >>>> You can find my public key at:
>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>> >>>>
>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>> following
>>> >>>> fixes:
>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>> >>>> directory
>>> >>>> >>>> rather
>>> >>>> >>>> than deleting.
>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>> in
>>> >>>> YARN
>>> >>>> >>>> application catalog webapp
>>> >>>> >>>>
>>> >>>> >>>> Same as before, I've done the following verification and they
>>> look
>>> >>>> good:
>>> >>>> >>>> - Ran all the unit tests
>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> >>>> commands
>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>> >>>>
>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>> >>>>
>>> >>>> >>>> Best,
>>> >>>> >>>> Chao
>>> >>>> >>>>
>>> >>>> >>>
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
too. I'll start a new RC with the only change being the CHANGELOG. Thanks
everyone! In the meantime you can still evaluate the binary bits of this RC
since they won't change.
Best,
Chao
On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
> finishes successfully [1] and is not part of the released Maven artifacts,
> I'm thinking of just replacing the existing one in
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
> another RC. What do you think?
>
> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
>
>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>> After checking to build from source and setting up a pseudo cluster based
>> on the
>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>> changelog, right?
>> Please feel free to share information if you meet any blocker issues to
>> push this release
>> progress forward.
>> Thanks Chao again.
>>
>> Best,
>> - He Xiaoqiao
>>
>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>> I am curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>
>>> > Thanks again Viraj!
>>> >
>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>> >
>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>>> the
>>> > fix version tag.
>>> >
>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> > present.
>>> >
>>> > Removed the fix version tag for this too.
>>> >
>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found
>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>> >
>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>> >
>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>> tag.
>>> >
>>> > Please check again when you have a chance. Thanks.
>>> >
>>> > Best,
>>> > Chao
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >
>>> >> Thanks Chao. I just re-executed the script and found very minor
>>> >> differences:
>>> >>
>>> >> 1. Incorrect fix versions:
>>> >> HADOOP-17988
>>> >> HADOOP-17728
>>> >>
>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> >> present.
>>> >>
>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found on
>>> >> 3.3.2:
>>> >> HADOOP-17936
>>> >> HADOOP-18066
>>> >>
>>> >>
>>> >>
>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>> >>
>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>> many
>>> >>> JIRAs. The script is super useful!
>>> >>>
>>> >>> I just fixed the "fix version" of these. Could you double check?
>>> Really
>>> >>> appreciate you putting effort to do a thorough check on this.
>>> >>>
>>> >>> Chao
>>> >>>
>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>>
>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>> resolved
>>> >>>> and
>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>> >>>>
>>> >>>> Basic RC verification using hadoop-vote.sh
>>> >>>> <
>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >>>> >:
>>> >>>>
>>> >>>> * Signature: ok
>>> >>>> * Checksum : ok
>>> >>>> * Rat check (1.8.0_301): ok
>>> >>>> - mvn clean apache-rat:check
>>> >>>> * Built from source (1.8.0_301): ok
>>> >>>> - mvn clean install -DskipTests
>>> >>>> * Built tar from source (1.8.0_301): ok
>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> >>>> -Dmaven.javadoc.skip=true
>>> >>>>
>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>> from
>>> >>>> previous RC.
>>> >>>>
>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>> >>>>
>>> >>>> Jiras with missing fixVersion: 3.3.2
>>> >>>>
>>> >>>> HADOOP-17198
>>> >>>> HDFS-16344
>>> >>>> HDFS-16339
>>> >>>> YARN-11007
>>> >>>> HDFS-16171
>>> >>>> HDFS-16350
>>> >>>> HDFS-16336
>>> >>>> HADOOP-17975
>>> >>>> YARN-10991
>>> >>>> HDFS-16332
>>> >>>> HADOOP-17857
>>> >>>> HDFS-16271
>>> >>>> HADOOP-17195
>>> >>>> HADOOP-17290
>>> >>>> HADOOP-17819
>>> >>>> YARN-9551
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>> testing.
>>> >>>> >
>>> >>>> >
>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>> wrote:
>>> >>>> >
>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>> >>>> again?
>>> >>>> >> Thanks!
>>> >>>> >>
>>> >>>> >> Chao
>>> >>>> >>
>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vjasani@apache.org
>>> >
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >>> > The RC is available at:
>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>
>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>> >>>
>>> >>>> >>>
>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>> >>>> wrote:
>>> >>>> >>>
>>> >>>> >>>> Hi all,
>>> >>>> >>>>
>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>> have
>>> >>>> >>>> requested
>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>> >>>>
>>> >>>> >>>> The RC is available at:
>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>> The RC tag is at:
>>> >>>> >>>>
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> >>>> The Maven artifacts are staged at:
>>> >>>> >>>>
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>> >>>>
>>> >>>> >>>> You can find my public key at:
>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>> >>>>
>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>> following
>>> >>>> fixes:
>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>> >>>> directory
>>> >>>> >>>> rather
>>> >>>> >>>> than deleting.
>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>> in
>>> >>>> YARN
>>> >>>> >>>> application catalog webapp
>>> >>>> >>>>
>>> >>>> >>>> Same as before, I've done the following verification and they
>>> look
>>> >>>> good:
>>> >>>> >>>> - Ran all the unit tests
>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> >>>> commands
>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>> >>>>
>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>> >>>>
>>> >>>> >>>> Best,
>>> >>>> >>>> Chao
>>> >>>> >>>>
>>> >>>> >>>
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Ah I take it back: the CHANGELOG is part of the hadoop-3.3.2-site.tar.gz
too. I'll start a new RC with the only change being the CHANGELOG. Thanks
everyone! In the meantime you can still evaluate the binary bits of this RC
since they won't change.
Best,
Chao
On Mon, Feb 21, 2022 at 10:26 AM Chao Sun <su...@apache.org> wrote:
> Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
> finishes successfully [1] and is not part of the released Maven artifacts,
> I'm thinking of just replacing the existing one in
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
> another RC. What do you think?
>
> [1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
>
> Best,
> Chao
>
> On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
>
>> Thanks Chao for your great work and thanks Viraj's careful checks here.
>> After checking to build from source and setting up a pseudo cluster based
>> on the
>> RC4, it seems that it is almost ready for release-3.3.2 beside update
>> changelog, right?
>> Please feel free to share information if you meet any blocker issues to
>> push this release
>> progress forward.
>> Thanks Chao again.
>>
>> Best,
>> - He Xiaoqiao
>>
>> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>>> I am curious if this requires new RC or you would like to update
>>> Changelog
>>> in the existing RC. Either way, once Changelog is updated, and since
>>> other
>>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>>
>>>
>>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>>
>>> > Thanks again Viraj!
>>> >
>>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>>> >
>>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>>> the
>>> > fix version tag.
>>> >
>>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> > present.
>>> >
>>> > Removed the fix version tag for this too.
>>> >
>>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found
>>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>>> >
>>> > I think HADOOP-17936 is already in branch-3.3.2?
>>> >
>>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>>> tag.
>>> >
>>> > Please check again when you have a chance. Thanks.
>>> >
>>> > Best,
>>> > Chao
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >
>>> >> Thanks Chao. I just re-executed the script and found very minor
>>> >> differences:
>>> >>
>>> >> 1. Incorrect fix versions:
>>> >> HADOOP-17988
>>> >> HADOOP-17728
>>> >>
>>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>>> >> present.
>>> >>
>>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit
>>> found on
>>> >> 3.3.2:
>>> >> HADOOP-17936
>>> >> HADOOP-18066
>>> >>
>>> >>
>>> >>
>>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>> >>
>>> >>> Thank you so much Viraj! I've no idea that I missed tagging these
>>> many
>>> >>> JIRAs. The script is super useful!
>>> >>>
>>> >>> I just fixed the "fix version" of these. Could you double check?
>>> Really
>>> >>> appreciate you putting effort to do a thorough check on this.
>>> >>>
>>> >>> Chao
>>> >>>
>>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>>
>>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>>> resolved
>>> >>>> and
>>> >>>> changelist updated, will change my vote to +1 (non-binding).
>>> >>>>
>>> >>>> Basic RC verification using hadoop-vote.sh
>>> >>>> <
>>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >>>> >:
>>> >>>>
>>> >>>> * Signature: ok
>>> >>>> * Checksum : ok
>>> >>>> * Rat check (1.8.0_301): ok
>>> >>>> - mvn clean apache-rat:check
>>> >>>> * Built from source (1.8.0_301): ok
>>> >>>> - mvn clean install -DskipTests
>>> >>>> * Built tar from source (1.8.0_301): ok
>>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> >>>> -Dmaven.javadoc.skip=true
>>> >>>>
>>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>>> from
>>> >>>> previous RC.
>>> >>>>
>>> >>>> Found some Git/Jira version discrepancies (script used from PR
>>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>>> >>>>
>>> >>>> Jiras with missing fixVersion: 3.3.2
>>> >>>>
>>> >>>> HADOOP-17198
>>> >>>> HDFS-16344
>>> >>>> HDFS-16339
>>> >>>> YARN-11007
>>> >>>> HDFS-16171
>>> >>>> HDFS-16350
>>> >>>> HDFS-16336
>>> >>>> HADOOP-17975
>>> >>>> YARN-10991
>>> >>>> HDFS-16332
>>> >>>> HADOOP-17857
>>> >>>> HDFS-16271
>>> >>>> HADOOP-17195
>>> >>>> HADOOP-17290
>>> >>>> HADOOP-17819
>>> >>>> YARN-9551
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> >>>> wrote:
>>> >>>>
>>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>>> testing.
>>> >>>> >
>>> >>>> >
>>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>>> wrote:
>>> >>>> >
>>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>>> >>>> again?
>>> >>>> >> Thanks!
>>> >>>> >>
>>> >>>> >> Chao
>>> >>>> >>
>>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vjasani@apache.org
>>> >
>>> >>>> wrote:
>>> >>>> >>
>>> >>>> >>> > The RC is available at:
>>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>
>>> >>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>> >>>
>>> >>>> >>>
>>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>> >>>> wrote:
>>> >>>> >>>
>>> >>>> >>>> Hi all,
>>> >>>> >>>>
>>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>>> have
>>> >>>> >>>> requested
>>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>> >>>>
>>> >>>> >>>> The RC is available at:
>>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> >>>> The RC tag is at:
>>> >>>> >>>>
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> >>>> The Maven artifacts are staged at:
>>> >>>> >>>>
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>> >>>>
>>> >>>> >>>> You can find my public key at:
>>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>> >>>>
>>> >>>> >>>> The deltas between this and RC3 are the addition of the
>>> following
>>> >>>> fixes:
>>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>> >>>> directory
>>> >>>> >>>> rather
>>> >>>> >>>> than deleting.
>>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5
>>> in
>>> >>>> YARN
>>> >>>> >>>> application catalog webapp
>>> >>>> >>>>
>>> >>>> >>>> Same as before, I've done the following verification and they
>>> look
>>> >>>> good:
>>> >>>> >>>> - Ran all the unit tests
>>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> >>>> commands
>>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>> >>>>
>>> >>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>> >>>>
>>> >>>> >>>> Best,
>>> >>>> >>>> Chao
>>> >>>> >>>>
>>> >>>> >>>
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
finishes successfully [1] and is not part of the released Maven artifacts,
I'm thinking of just replacing the existing one in
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
another RC. What do you think?
[1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
Best,
Chao
On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
> Thanks Chao for your great work and thanks Viraj's careful checks here.
> After checking to build from source and setting up a pseudo cluster based
> on the
> RC4, it seems that it is almost ready for release-3.3.2 beside update
> changelog, right?
> Please feel free to share information if you meet any blocker issues to
> push this release
> progress forward.
> Thanks Chao again.
>
> Best,
> - He Xiaoqiao
>
> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>> I am curious if this requires new RC or you would like to update Changelog
>> in the existing RC. Either way, once Changelog is updated, and since other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>> >
>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>> the
>> > fix version tag.
>> >
>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> > present.
>> >
>> > Removed the fix version tag for this too.
>> >
>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>> >
>> > I think HADOOP-17936 is already in branch-3.3.2?
>> >
>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>> tag.
>> >
>> > Please check again when you have a chance. Thanks.
>> >
>> > Best,
>> > Chao
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >
>> >> Thanks Chao. I just re-executed the script and found very minor
>> >> differences:
>> >>
>> >> 1. Incorrect fix versions:
>> >> HADOOP-17988
>> >> HADOOP-17728
>> >>
>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> >> present.
>> >>
>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> on
>> >> 3.3.2:
>> >> HADOOP-17936
>> >> HADOOP-18066
>> >>
>> >>
>> >>
>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>> >>
>> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> >>> JIRAs. The script is super useful!
>> >>>
>> >>> I just fixed the "fix version" of these. Could you double check?
>> Really
>> >>> appreciate you putting effort to do a thorough check on this.
>> >>>
>> >>> Chao
>> >>>
>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>>
>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>> resolved
>> >>>> and
>> >>>> changelist updated, will change my vote to +1 (non-binding).
>> >>>>
>> >>>> Basic RC verification using hadoop-vote.sh
>> >>>> <
>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>> >>>> >:
>> >>>>
>> >>>> * Signature: ok
>> >>>> * Checksum : ok
>> >>>> * Rat check (1.8.0_301): ok
>> >>>> - mvn clean apache-rat:check
>> >>>> * Built from source (1.8.0_301): ok
>> >>>> - mvn clean install -DskipTests
>> >>>> * Built tar from source (1.8.0_301): ok
>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>> >>>> -Dmaven.javadoc.skip=true
>> >>>>
>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>> from
>> >>>> previous RC.
>> >>>>
>> >>>> Found some Git/Jira version discrepancies (script used from PR
>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>> >>>>
>> >>>> Jiras with missing fixVersion: 3.3.2
>> >>>>
>> >>>> HADOOP-17198
>> >>>> HDFS-16344
>> >>>> HDFS-16339
>> >>>> YARN-11007
>> >>>> HDFS-16171
>> >>>> HDFS-16350
>> >>>> HDFS-16336
>> >>>> HADOOP-17975
>> >>>> YARN-10991
>> >>>> HDFS-16332
>> >>>> HADOOP-17857
>> >>>> HDFS-16271
>> >>>> HADOOP-17195
>> >>>> HADOOP-17290
>> >>>> HADOOP-17819
>> >>>> YARN-9551
>> >>>>
>> >>>>
>> >>>>
>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>> testing.
>> >>>> >
>> >>>> >
>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>> wrote:
>> >>>> >
>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>> >>>> again?
>> >>>> >> Thanks!
>> >>>> >>
>> >>>> >> Chao
>> >>>> >>
>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >>> > The RC is available at:
>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>
>> >>>> >>> Chao, the RC folder seems empty as of now.
>> >>>> >>>
>> >>>> >>>
>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>> >>>> wrote:
>> >>>> >>>
>> >>>> >>>> Hi all,
>> >>>> >>>>
>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>> have
>> >>>> >>>> requested
>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>> >>>>
>> >>>> >>>> The RC is available at:
>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>> The RC tag is at:
>> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> >>>> The Maven artifacts are staged at:
>> >>>> >>>>
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>> >>>>
>> >>>> >>>> You can find my public key at:
>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>> >>>>
>> >>>> >>>> The deltas between this and RC3 are the addition of the
>> following
>> >>>> fixes:
>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>> >>>> directory
>> >>>> >>>> rather
>> >>>> >>>> than deleting.
>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>> >>>> YARN
>> >>>> >>>> application catalog webapp
>> >>>> >>>>
>> >>>> >>>> Same as before, I've done the following verification and they
>> look
>> >>>> good:
>> >>>> >>>> - Ran all the unit tests
>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>> >>>> commands
>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>> >>>>
>> >>>> >>>> Please evaluate the RC and vote, thanks!
>> >>>> >>>>
>> >>>> >>>> Best,
>> >>>> >>>> Chao
>> >>>> >>>>
>> >>>> >>>
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
finishes successfully [1] and is not part of the released Maven artifacts,
I'm thinking of just replacing the existing one in
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
another RC. What do you think?
[1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
Best,
Chao
On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
> Thanks Chao for your great work and thanks Viraj's careful checks here.
> After checking to build from source and setting up a pseudo cluster based
> on the
> RC4, it seems that it is almost ready for release-3.3.2 beside update
> changelog, right?
> Please feel free to share information if you meet any blocker issues to
> push this release
> progress forward.
> Thanks Chao again.
>
> Best,
> - He Xiaoqiao
>
> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>> I am curious if this requires new RC or you would like to update Changelog
>> in the existing RC. Either way, once Changelog is updated, and since other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>> >
>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>> the
>> > fix version tag.
>> >
>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> > present.
>> >
>> > Removed the fix version tag for this too.
>> >
>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>> >
>> > I think HADOOP-17936 is already in branch-3.3.2?
>> >
>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>> tag.
>> >
>> > Please check again when you have a chance. Thanks.
>> >
>> > Best,
>> > Chao
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >
>> >> Thanks Chao. I just re-executed the script and found very minor
>> >> differences:
>> >>
>> >> 1. Incorrect fix versions:
>> >> HADOOP-17988
>> >> HADOOP-17728
>> >>
>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> >> present.
>> >>
>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> on
>> >> 3.3.2:
>> >> HADOOP-17936
>> >> HADOOP-18066
>> >>
>> >>
>> >>
>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>> >>
>> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> >>> JIRAs. The script is super useful!
>> >>>
>> >>> I just fixed the "fix version" of these. Could you double check?
>> Really
>> >>> appreciate you putting effort to do a thorough check on this.
>> >>>
>> >>> Chao
>> >>>
>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>>
>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>> resolved
>> >>>> and
>> >>>> changelist updated, will change my vote to +1 (non-binding).
>> >>>>
>> >>>> Basic RC verification using hadoop-vote.sh
>> >>>> <
>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>> >>>> >:
>> >>>>
>> >>>> * Signature: ok
>> >>>> * Checksum : ok
>> >>>> * Rat check (1.8.0_301): ok
>> >>>> - mvn clean apache-rat:check
>> >>>> * Built from source (1.8.0_301): ok
>> >>>> - mvn clean install -DskipTests
>> >>>> * Built tar from source (1.8.0_301): ok
>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>> >>>> -Dmaven.javadoc.skip=true
>> >>>>
>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>> from
>> >>>> previous RC.
>> >>>>
>> >>>> Found some Git/Jira version discrepancies (script used from PR
>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>> >>>>
>> >>>> Jiras with missing fixVersion: 3.3.2
>> >>>>
>> >>>> HADOOP-17198
>> >>>> HDFS-16344
>> >>>> HDFS-16339
>> >>>> YARN-11007
>> >>>> HDFS-16171
>> >>>> HDFS-16350
>> >>>> HDFS-16336
>> >>>> HADOOP-17975
>> >>>> YARN-10991
>> >>>> HDFS-16332
>> >>>> HADOOP-17857
>> >>>> HDFS-16271
>> >>>> HADOOP-17195
>> >>>> HADOOP-17290
>> >>>> HADOOP-17819
>> >>>> YARN-9551
>> >>>>
>> >>>>
>> >>>>
>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>> testing.
>> >>>> >
>> >>>> >
>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>> wrote:
>> >>>> >
>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>> >>>> again?
>> >>>> >> Thanks!
>> >>>> >>
>> >>>> >> Chao
>> >>>> >>
>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >>> > The RC is available at:
>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>
>> >>>> >>> Chao, the RC folder seems empty as of now.
>> >>>> >>>
>> >>>> >>>
>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>> >>>> wrote:
>> >>>> >>>
>> >>>> >>>> Hi all,
>> >>>> >>>>
>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>> have
>> >>>> >>>> requested
>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>> >>>>
>> >>>> >>>> The RC is available at:
>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>> The RC tag is at:
>> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> >>>> The Maven artifacts are staged at:
>> >>>> >>>>
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>> >>>>
>> >>>> >>>> You can find my public key at:
>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>> >>>>
>> >>>> >>>> The deltas between this and RC3 are the addition of the
>> following
>> >>>> fixes:
>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>> >>>> directory
>> >>>> >>>> rather
>> >>>> >>>> than deleting.
>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>> >>>> YARN
>> >>>> >>>> application catalog webapp
>> >>>> >>>>
>> >>>> >>>> Same as before, I've done the following verification and they
>> look
>> >>>> good:
>> >>>> >>>> - Ran all the unit tests
>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>> >>>> commands
>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>> >>>>
>> >>>> >>>> Please evaluate the RC and vote, thanks!
>> >>>> >>>>
>> >>>> >>>> Best,
>> >>>> >>>> Chao
>> >>>> >>>>
>> >>>> >>>
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
finishes successfully [1] and is not part of the released Maven artifacts,
I'm thinking of just replacing the existing one in
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
another RC. What do you think?
[1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
Best,
Chao
On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
> Thanks Chao for your great work and thanks Viraj's careful checks here.
> After checking to build from source and setting up a pseudo cluster based
> on the
> RC4, it seems that it is almost ready for release-3.3.2 beside update
> changelog, right?
> Please feel free to share information if you meet any blocker issues to
> push this release
> progress forward.
> Thanks Chao again.
>
> Best,
> - He Xiaoqiao
>
> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>> I am curious if this requires new RC or you would like to update Changelog
>> in the existing RC. Either way, once Changelog is updated, and since other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>> >
>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>> the
>> > fix version tag.
>> >
>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> > present.
>> >
>> > Removed the fix version tag for this too.
>> >
>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>> >
>> > I think HADOOP-17936 is already in branch-3.3.2?
>> >
>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>> tag.
>> >
>> > Please check again when you have a chance. Thanks.
>> >
>> > Best,
>> > Chao
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >
>> >> Thanks Chao. I just re-executed the script and found very minor
>> >> differences:
>> >>
>> >> 1. Incorrect fix versions:
>> >> HADOOP-17988
>> >> HADOOP-17728
>> >>
>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> >> present.
>> >>
>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> on
>> >> 3.3.2:
>> >> HADOOP-17936
>> >> HADOOP-18066
>> >>
>> >>
>> >>
>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>> >>
>> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> >>> JIRAs. The script is super useful!
>> >>>
>> >>> I just fixed the "fix version" of these. Could you double check?
>> Really
>> >>> appreciate you putting effort to do a thorough check on this.
>> >>>
>> >>> Chao
>> >>>
>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>>
>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>> resolved
>> >>>> and
>> >>>> changelist updated, will change my vote to +1 (non-binding).
>> >>>>
>> >>>> Basic RC verification using hadoop-vote.sh
>> >>>> <
>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>> >>>> >:
>> >>>>
>> >>>> * Signature: ok
>> >>>> * Checksum : ok
>> >>>> * Rat check (1.8.0_301): ok
>> >>>> - mvn clean apache-rat:check
>> >>>> * Built from source (1.8.0_301): ok
>> >>>> - mvn clean install -DskipTests
>> >>>> * Built tar from source (1.8.0_301): ok
>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>> >>>> -Dmaven.javadoc.skip=true
>> >>>>
>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>> from
>> >>>> previous RC.
>> >>>>
>> >>>> Found some Git/Jira version discrepancies (script used from PR
>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>> >>>>
>> >>>> Jiras with missing fixVersion: 3.3.2
>> >>>>
>> >>>> HADOOP-17198
>> >>>> HDFS-16344
>> >>>> HDFS-16339
>> >>>> YARN-11007
>> >>>> HDFS-16171
>> >>>> HDFS-16350
>> >>>> HDFS-16336
>> >>>> HADOOP-17975
>> >>>> YARN-10991
>> >>>> HDFS-16332
>> >>>> HADOOP-17857
>> >>>> HDFS-16271
>> >>>> HADOOP-17195
>> >>>> HADOOP-17290
>> >>>> HADOOP-17819
>> >>>> YARN-9551
>> >>>>
>> >>>>
>> >>>>
>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>> testing.
>> >>>> >
>> >>>> >
>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>> wrote:
>> >>>> >
>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>> >>>> again?
>> >>>> >> Thanks!
>> >>>> >>
>> >>>> >> Chao
>> >>>> >>
>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >>> > The RC is available at:
>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>
>> >>>> >>> Chao, the RC folder seems empty as of now.
>> >>>> >>>
>> >>>> >>>
>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>> >>>> wrote:
>> >>>> >>>
>> >>>> >>>> Hi all,
>> >>>> >>>>
>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>> have
>> >>>> >>>> requested
>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>> >>>>
>> >>>> >>>> The RC is available at:
>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>> The RC tag is at:
>> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> >>>> The Maven artifacts are staged at:
>> >>>> >>>>
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>> >>>>
>> >>>> >>>> You can find my public key at:
>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>> >>>>
>> >>>> >>>> The deltas between this and RC3 are the addition of the
>> following
>> >>>> fixes:
>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>> >>>> directory
>> >>>> >>>> rather
>> >>>> >>>> than deleting.
>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>> >>>> YARN
>> >>>> >>>> application catalog webapp
>> >>>> >>>>
>> >>>> >>>> Same as before, I've done the following verification and they
>> look
>> >>>> good:
>> >>>> >>>> - Ran all the unit tests
>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>> >>>> commands
>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>> >>>>
>> >>>> >>>> Please evaluate the RC and vote, thanks!
>> >>>> >>>>
>> >>>> >>>> Best,
>> >>>> >>>> Chao
>> >>>> >>>>
>> >>>> >>>
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks Viraj and Xiaoqiao! Since CHANGELOG is published after the voting
finishes successfully [1] and is not part of the released Maven artifacts,
I'm thinking of just replacing the existing one in
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/ instead of starting
another RC. What do you think?
[1]: https://cwiki.apache.org/confluence/display/HADOOP2/HowToRelease
Best,
Chao
On Mon, Feb 21, 2022 at 5:18 AM Xiaoqiao He <he...@apache.org> wrote:
> Thanks Chao for your great work and thanks Viraj's careful checks here.
> After checking to build from source and setting up a pseudo cluster based
> on the
> RC4, it seems that it is almost ready for release-3.3.2 beside update
> changelog, right?
> Please feel free to share information if you meet any blocker issues to
> push this release
> progress forward.
> Thanks Chao again.
>
> Best,
> - He Xiaoqiao
>
> On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao, things look good with the Jira fixVersion discrepancies.
>> I am curious if this requires new RC or you would like to update Changelog
>> in the existing RC. Either way, once Changelog is updated, and since other
>> functional testing looks good anyways, my vote would be +1 (non-binding).
>>
>>
>> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>>
>> > Thanks again Viraj!
>> >
>> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>> >
>> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
>> the
>> > fix version tag.
>> >
>> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> > present.
>> >
>> > Removed the fix version tag for this too.
>> >
>> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> > on 3.3.2: HADOOP-17936, HADOOP-18066
>> >
>> > I think HADOOP-17936 is already in branch-3.3.2?
>> >
>> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
>> > HADOOP-18066 is resolved as invalid so I just removed the fix version
>> tag.
>> >
>> > Please check again when you have a chance. Thanks.
>> >
>> > Best,
>> > Chao
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >
>> >> Thanks Chao. I just re-executed the script and found very minor
>> >> differences:
>> >>
>> >> 1. Incorrect fix versions:
>> >> HADOOP-17988
>> >> HADOOP-17728
>> >>
>> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> >> present.
>> >>
>> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
>> on
>> >> 3.3.2:
>> >> HADOOP-17936
>> >> HADOOP-18066
>> >>
>> >>
>> >>
>> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>> >>
>> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> >>> JIRAs. The script is super useful!
>> >>>
>> >>> I just fixed the "fix version" of these. Could you double check?
>> Really
>> >>> appreciate you putting effort to do a thorough check on this.
>> >>>
>> >>> Chao
>> >>>
>> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>>
>> >>>> -0 (non-binding), due to git/jira version discrepancies. Once
>> resolved
>> >>>> and
>> >>>> changelist updated, will change my vote to +1 (non-binding).
>> >>>>
>> >>>> Basic RC verification using hadoop-vote.sh
>> >>>> <
>> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>> >>>> >:
>> >>>>
>> >>>> * Signature: ok
>> >>>> * Checksum : ok
>> >>>> * Rat check (1.8.0_301): ok
>> >>>> - mvn clean apache-rat:check
>> >>>> * Built from source (1.8.0_301): ok
>> >>>> - mvn clean install -DskipTests
>> >>>> * Built tar from source (1.8.0_301): ok
>> >>>> - mvn clean package -Pdist -DskipTests -Dtar
>> >>>> -Dmaven.javadoc.skip=true
>> >>>>
>> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
>> from
>> >>>> previous RC.
>> >>>>
>> >>>> Found some Git/Jira version discrepancies (script used from PR
>> >>>> <https://github.com/apache/hadoop/pull/3991>):
>> >>>>
>> >>>> Jiras with missing fixVersion: 3.3.2
>> >>>>
>> >>>> HADOOP-17198
>> >>>> HDFS-16344
>> >>>> HDFS-16339
>> >>>> YARN-11007
>> >>>> HDFS-16171
>> >>>> HDFS-16350
>> >>>> HDFS-16336
>> >>>> HADOOP-17975
>> >>>> YARN-10991
>> >>>> HDFS-16332
>> >>>> HADOOP-17857
>> >>>> HDFS-16271
>> >>>> HADOOP-17195
>> >>>> HADOOP-17290
>> >>>> HADOOP-17819
>> >>>> YARN-9551
>> >>>>
>> >>>>
>> >>>>
>> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>> > Thanks Chao. Yes contents are now present, I will start the
>> testing.
>> >>>> >
>> >>>> >
>> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
>> wrote:
>> >>>> >
>> >>>> >> Oops, sorry about that. They should be there now. Can you check
>> >>>> again?
>> >>>> >> Thanks!
>> >>>> >>
>> >>>> >> Chao
>> >>>> >>
>> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> >>>> wrote:
>> >>>> >>
>> >>>> >>> > The RC is available at:
>> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>
>> >>>> >>> Chao, the RC folder seems empty as of now.
>> >>>> >>>
>> >>>> >>>
>> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>> >>>> wrote:
>> >>>> >>>
>> >>>> >>>> Hi all,
>> >>>> >>>>
>> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people
>> have
>> >>>> >>>> requested
>> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>> >>>>
>> >>>> >>>> The RC is available at:
>> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> >>>> The RC tag is at:
>> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> >>>> The Maven artifacts are staged at:
>> >>>> >>>>
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>> >>>>
>> >>>> >>>> You can find my public key at:
>> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>> >>>>
>> >>>> >>>> The deltas between this and RC3 are the addition of the
>> following
>> >>>> fixes:
>> >>>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>> >>>> directory
>> >>>> >>>> rather
>> >>>> >>>> than deleting.
>> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>> >>>> YARN
>> >>>> >>>> application catalog webapp
>> >>>> >>>>
>> >>>> >>>> Same as before, I've done the following verification and they
>> look
>> >>>> good:
>> >>>> >>>> - Ran all the unit tests
>> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
>> >>>> commands
>> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>> >>>>
>> >>>> >>>> Please evaluate the RC and vote, thanks!
>> >>>> >>>>
>> >>>> >>>> Best,
>> >>>> >>>> Chao
>> >>>> >>>>
>> >>>> >>>
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Chao for your great work and thanks Viraj's careful checks here.
After checking to build from source and setting up a pseudo cluster based
on the
RC4, it seems that it is almost ready for release-3.3.2 beside update
changelog, right?
Please feel free to share information if you meet any blocker issues to
push this release
progress forward.
Thanks Chao again.
Best,
- He Xiaoqiao
On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao, things look good with the Jira fixVersion discrepancies.
> I am curious if this requires new RC or you would like to update Changelog
> in the existing RC. Either way, once Changelog is updated, and since other
> functional testing looks good anyways, my vote would be +1 (non-binding).
>
>
> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>
> > Thanks again Viraj!
> >
> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
> >
> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
> the
> > fix version tag.
> >
> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> > present.
> >
> > Removed the fix version tag for this too.
> >
> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> > on 3.3.2: HADOOP-17936, HADOOP-18066
> >
> > I think HADOOP-17936 is already in branch-3.3.2?
> >
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> > HADOOP-18066 is resolved as invalid so I just removed the fix version
> tag.
> >
> > Please check again when you have a chance. Thanks.
> >
> > Best,
> > Chao
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
> wrote:
> >
> >> Thanks Chao. I just re-executed the script and found very minor
> >> differences:
> >>
> >> 1. Incorrect fix versions:
> >> HADOOP-17988
> >> HADOOP-17728
> >>
> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> >> present.
> >>
> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on
> >> 3.3.2:
> >> HADOOP-17936
> >> HADOOP-18066
> >>
> >>
> >>
> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> >>
> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
> >>> JIRAs. The script is super useful!
> >>>
> >>> I just fixed the "fix version" of these. Could you double check? Really
> >>> appreciate you putting effort to do a thorough check on this.
> >>>
> >>> Chao
> >>>
> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>>
> >>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
> >>>> and
> >>>> changelist updated, will change my vote to +1 (non-binding).
> >>>>
> >>>> Basic RC verification using hadoop-vote.sh
> >>>> <
> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
> >>>> >:
> >>>>
> >>>> * Signature: ok
> >>>> * Checksum : ok
> >>>> * Rat check (1.8.0_301): ok
> >>>> - mvn clean apache-rat:check
> >>>> * Built from source (1.8.0_301): ok
> >>>> - mvn clean install -DskipTests
> >>>> * Built tar from source (1.8.0_301): ok
> >>>> - mvn clean package -Pdist -DskipTests -Dtar
> >>>> -Dmaven.javadoc.skip=true
> >>>>
> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
> from
> >>>> previous RC.
> >>>>
> >>>> Found some Git/Jira version discrepancies (script used from PR
> >>>> <https://github.com/apache/hadoop/pull/3991>):
> >>>>
> >>>> Jiras with missing fixVersion: 3.3.2
> >>>>
> >>>> HADOOP-17198
> >>>> HDFS-16344
> >>>> HDFS-16339
> >>>> YARN-11007
> >>>> HDFS-16171
> >>>> HDFS-16350
> >>>> HDFS-16336
> >>>> HADOOP-17975
> >>>> YARN-10991
> >>>> HDFS-16332
> >>>> HADOOP-17857
> >>>> HDFS-16271
> >>>> HADOOP-17195
> >>>> HADOOP-17290
> >>>> HADOOP-17819
> >>>> YARN-9551
> >>>>
> >>>>
> >>>>
> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>>
> >>>> > Thanks Chao. Yes contents are now present, I will start the testing.
> >>>> >
> >>>> >
> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
> wrote:
> >>>> >
> >>>> >> Oops, sorry about that. They should be there now. Can you check
> >>>> again?
> >>>> >> Thanks!
> >>>> >>
> >>>> >> Chao
> >>>> >>
> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>> >>
> >>>> >>> > The RC is available at:
> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>
> >>>> >>> Chao, the RC folder seems empty as of now.
> >>>> >>>
> >>>> >>>
> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
> >>>> wrote:
> >>>> >>>
> >>>> >>>> Hi all,
> >>>> >>>>
> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> >>>> requested
> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>> >>>>
> >>>> >>>> The RC is available at:
> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>> The RC tag is at:
> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> >>>> The Maven artifacts are staged at:
> >>>> >>>>
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>> >>>>
> >>>> >>>> You can find my public key at:
> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>> >>>>
> >>>> >>>> The deltas between this and RC3 are the addition of the following
> >>>> fixes:
> >>>> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
> >>>> directory
> >>>> >>>> rather
> >>>> >>>> than deleting.
> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
> >>>> YARN
> >>>> >>>> application catalog webapp
> >>>> >>>>
> >>>> >>>> Same as before, I've done the following verification and they
> look
> >>>> good:
> >>>> >>>> - Ran all the unit tests
> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
> >>>> commands
> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>> >>>>
> >>>> >>>> Please evaluate the RC and vote, thanks!
> >>>> >>>>
> >>>> >>>> Best,
> >>>> >>>> Chao
> >>>> >>>>
> >>>> >>>
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Chao for your great work and thanks Viraj's careful checks here.
After checking to build from source and setting up a pseudo cluster based
on the
RC4, it seems that it is almost ready for release-3.3.2 beside update
changelog, right?
Please feel free to share information if you meet any blocker issues to
push this release
progress forward.
Thanks Chao again.
Best,
- He Xiaoqiao
On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao, things look good with the Jira fixVersion discrepancies.
> I am curious if this requires new RC or you would like to update Changelog
> in the existing RC. Either way, once Changelog is updated, and since other
> functional testing looks good anyways, my vote would be +1 (non-binding).
>
>
> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>
> > Thanks again Viraj!
> >
> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
> >
> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
> the
> > fix version tag.
> >
> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> > present.
> >
> > Removed the fix version tag for this too.
> >
> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> > on 3.3.2: HADOOP-17936, HADOOP-18066
> >
> > I think HADOOP-17936 is already in branch-3.3.2?
> >
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> > HADOOP-18066 is resolved as invalid so I just removed the fix version
> tag.
> >
> > Please check again when you have a chance. Thanks.
> >
> > Best,
> > Chao
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
> wrote:
> >
> >> Thanks Chao. I just re-executed the script and found very minor
> >> differences:
> >>
> >> 1. Incorrect fix versions:
> >> HADOOP-17988
> >> HADOOP-17728
> >>
> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> >> present.
> >>
> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on
> >> 3.3.2:
> >> HADOOP-17936
> >> HADOOP-18066
> >>
> >>
> >>
> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> >>
> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
> >>> JIRAs. The script is super useful!
> >>>
> >>> I just fixed the "fix version" of these. Could you double check? Really
> >>> appreciate you putting effort to do a thorough check on this.
> >>>
> >>> Chao
> >>>
> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>>
> >>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
> >>>> and
> >>>> changelist updated, will change my vote to +1 (non-binding).
> >>>>
> >>>> Basic RC verification using hadoop-vote.sh
> >>>> <
> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
> >>>> >:
> >>>>
> >>>> * Signature: ok
> >>>> * Checksum : ok
> >>>> * Rat check (1.8.0_301): ok
> >>>> - mvn clean apache-rat:check
> >>>> * Built from source (1.8.0_301): ok
> >>>> - mvn clean install -DskipTests
> >>>> * Built tar from source (1.8.0_301): ok
> >>>> - mvn clean package -Pdist -DskipTests -Dtar
> >>>> -Dmaven.javadoc.skip=true
> >>>>
> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
> from
> >>>> previous RC.
> >>>>
> >>>> Found some Git/Jira version discrepancies (script used from PR
> >>>> <https://github.com/apache/hadoop/pull/3991>):
> >>>>
> >>>> Jiras with missing fixVersion: 3.3.2
> >>>>
> >>>> HADOOP-17198
> >>>> HDFS-16344
> >>>> HDFS-16339
> >>>> YARN-11007
> >>>> HDFS-16171
> >>>> HDFS-16350
> >>>> HDFS-16336
> >>>> HADOOP-17975
> >>>> YARN-10991
> >>>> HDFS-16332
> >>>> HADOOP-17857
> >>>> HDFS-16271
> >>>> HADOOP-17195
> >>>> HADOOP-17290
> >>>> HADOOP-17819
> >>>> YARN-9551
> >>>>
> >>>>
> >>>>
> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>>
> >>>> > Thanks Chao. Yes contents are now present, I will start the testing.
> >>>> >
> >>>> >
> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
> wrote:
> >>>> >
> >>>> >> Oops, sorry about that. They should be there now. Can you check
> >>>> again?
> >>>> >> Thanks!
> >>>> >>
> >>>> >> Chao
> >>>> >>
> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>> >>
> >>>> >>> > The RC is available at:
> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>
> >>>> >>> Chao, the RC folder seems empty as of now.
> >>>> >>>
> >>>> >>>
> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
> >>>> wrote:
> >>>> >>>
> >>>> >>>> Hi all,
> >>>> >>>>
> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> >>>> requested
> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>> >>>>
> >>>> >>>> The RC is available at:
> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>> The RC tag is at:
> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> >>>> The Maven artifacts are staged at:
> >>>> >>>>
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>> >>>>
> >>>> >>>> You can find my public key at:
> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>> >>>>
> >>>> >>>> The deltas between this and RC3 are the addition of the following
> >>>> fixes:
> >>>> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
> >>>> directory
> >>>> >>>> rather
> >>>> >>>> than deleting.
> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
> >>>> YARN
> >>>> >>>> application catalog webapp
> >>>> >>>>
> >>>> >>>> Same as before, I've done the following verification and they
> look
> >>>> good:
> >>>> >>>> - Ran all the unit tests
> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
> >>>> commands
> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>> >>>>
> >>>> >>>> Please evaluate the RC and vote, thanks!
> >>>> >>>>
> >>>> >>>> Best,
> >>>> >>>> Chao
> >>>> >>>>
> >>>> >>>
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Chao for your great work and thanks Viraj's careful checks here.
After checking to build from source and setting up a pseudo cluster based
on the
RC4, it seems that it is almost ready for release-3.3.2 beside update
changelog, right?
Please feel free to share information if you meet any blocker issues to
push this release
progress forward.
Thanks Chao again.
Best,
- He Xiaoqiao
On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao, things look good with the Jira fixVersion discrepancies.
> I am curious if this requires new RC or you would like to update Changelog
> in the existing RC. Either way, once Changelog is updated, and since other
> functional testing looks good anyways, my vote would be +1 (non-binding).
>
>
> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>
> > Thanks again Viraj!
> >
> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
> >
> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
> the
> > fix version tag.
> >
> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> > present.
> >
> > Removed the fix version tag for this too.
> >
> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> > on 3.3.2: HADOOP-17936, HADOOP-18066
> >
> > I think HADOOP-17936 is already in branch-3.3.2?
> >
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> > HADOOP-18066 is resolved as invalid so I just removed the fix version
> tag.
> >
> > Please check again when you have a chance. Thanks.
> >
> > Best,
> > Chao
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
> wrote:
> >
> >> Thanks Chao. I just re-executed the script and found very minor
> >> differences:
> >>
> >> 1. Incorrect fix versions:
> >> HADOOP-17988
> >> HADOOP-17728
> >>
> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> >> present.
> >>
> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on
> >> 3.3.2:
> >> HADOOP-17936
> >> HADOOP-18066
> >>
> >>
> >>
> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> >>
> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
> >>> JIRAs. The script is super useful!
> >>>
> >>> I just fixed the "fix version" of these. Could you double check? Really
> >>> appreciate you putting effort to do a thorough check on this.
> >>>
> >>> Chao
> >>>
> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>>
> >>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
> >>>> and
> >>>> changelist updated, will change my vote to +1 (non-binding).
> >>>>
> >>>> Basic RC verification using hadoop-vote.sh
> >>>> <
> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
> >>>> >:
> >>>>
> >>>> * Signature: ok
> >>>> * Checksum : ok
> >>>> * Rat check (1.8.0_301): ok
> >>>> - mvn clean apache-rat:check
> >>>> * Built from source (1.8.0_301): ok
> >>>> - mvn clean install -DskipTests
> >>>> * Built tar from source (1.8.0_301): ok
> >>>> - mvn clean package -Pdist -DskipTests -Dtar
> >>>> -Dmaven.javadoc.skip=true
> >>>>
> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
> from
> >>>> previous RC.
> >>>>
> >>>> Found some Git/Jira version discrepancies (script used from PR
> >>>> <https://github.com/apache/hadoop/pull/3991>):
> >>>>
> >>>> Jiras with missing fixVersion: 3.3.2
> >>>>
> >>>> HADOOP-17198
> >>>> HDFS-16344
> >>>> HDFS-16339
> >>>> YARN-11007
> >>>> HDFS-16171
> >>>> HDFS-16350
> >>>> HDFS-16336
> >>>> HADOOP-17975
> >>>> YARN-10991
> >>>> HDFS-16332
> >>>> HADOOP-17857
> >>>> HDFS-16271
> >>>> HADOOP-17195
> >>>> HADOOP-17290
> >>>> HADOOP-17819
> >>>> YARN-9551
> >>>>
> >>>>
> >>>>
> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>>
> >>>> > Thanks Chao. Yes contents are now present, I will start the testing.
> >>>> >
> >>>> >
> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
> wrote:
> >>>> >
> >>>> >> Oops, sorry about that. They should be there now. Can you check
> >>>> again?
> >>>> >> Thanks!
> >>>> >>
> >>>> >> Chao
> >>>> >>
> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>> >>
> >>>> >>> > The RC is available at:
> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>
> >>>> >>> Chao, the RC folder seems empty as of now.
> >>>> >>>
> >>>> >>>
> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
> >>>> wrote:
> >>>> >>>
> >>>> >>>> Hi all,
> >>>> >>>>
> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> >>>> requested
> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>> >>>>
> >>>> >>>> The RC is available at:
> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>> The RC tag is at:
> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> >>>> The Maven artifacts are staged at:
> >>>> >>>>
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>> >>>>
> >>>> >>>> You can find my public key at:
> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>> >>>>
> >>>> >>>> The deltas between this and RC3 are the addition of the following
> >>>> fixes:
> >>>> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
> >>>> directory
> >>>> >>>> rather
> >>>> >>>> than deleting.
> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
> >>>> YARN
> >>>> >>>> application catalog webapp
> >>>> >>>>
> >>>> >>>> Same as before, I've done the following verification and they
> look
> >>>> good:
> >>>> >>>> - Ran all the unit tests
> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
> >>>> commands
> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>> >>>>
> >>>> >>>> Please evaluate the RC and vote, thanks!
> >>>> >>>>
> >>>> >>>> Best,
> >>>> >>>> Chao
> >>>> >>>>
> >>>> >>>
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Chao for your great work and thanks Viraj's careful checks here.
After checking to build from source and setting up a pseudo cluster based
on the
RC4, it seems that it is almost ready for release-3.3.2 beside update
changelog, right?
Please feel free to share information if you meet any blocker issues to
push this release
progress forward.
Thanks Chao again.
Best,
- He Xiaoqiao
On Wed, Feb 16, 2022 at 12:43 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao, things look good with the Jira fixVersion discrepancies.
> I am curious if this requires new RC or you would like to update Changelog
> in the existing RC. Either way, once Changelog is updated, and since other
> functional testing looks good anyways, my vote would be +1 (non-binding).
>
>
> On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
>
> > Thanks again Viraj!
> >
> > > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
> >
> > I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed
> the
> > fix version tag.
> >
> > 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> > present.
> >
> > Removed the fix version tag for this too.
> >
> > > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> > on 3.3.2: HADOOP-17936, HADOOP-18066
> >
> > I think HADOOP-17936 is already in branch-3.3.2?
> >
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> > HADOOP-18066 is resolved as invalid so I just removed the fix version
> tag.
> >
> > Please check again when you have a chance. Thanks.
> >
> > Best,
> > Chao
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org>
> wrote:
> >
> >> Thanks Chao. I just re-executed the script and found very minor
> >> differences:
> >>
> >> 1. Incorrect fix versions:
> >> HADOOP-17988
> >> HADOOP-17728
> >>
> >> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> >> present.
> >>
> >> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on
> >> 3.3.2:
> >> HADOOP-17936
> >> HADOOP-18066
> >>
> >>
> >>
> >> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> >>
> >>> Thank you so much Viraj! I've no idea that I missed tagging these many
> >>> JIRAs. The script is super useful!
> >>>
> >>> I just fixed the "fix version" of these. Could you double check? Really
> >>> appreciate you putting effort to do a thorough check on this.
> >>>
> >>> Chao
> >>>
> >>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>>
> >>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
> >>>> and
> >>>> changelist updated, will change my vote to +1 (non-binding).
> >>>>
> >>>> Basic RC verification using hadoop-vote.sh
> >>>> <
> https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
> >>>> >:
> >>>>
> >>>> * Signature: ok
> >>>> * Checksum : ok
> >>>> * Rat check (1.8.0_301): ok
> >>>> - mvn clean apache-rat:check
> >>>> * Built from source (1.8.0_301): ok
> >>>> - mvn clean install -DskipTests
> >>>> * Built tar from source (1.8.0_301): ok
> >>>> - mvn clean package -Pdist -DskipTests -Dtar
> >>>> -Dmaven.javadoc.skip=true
> >>>>
> >>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded
> from
> >>>> previous RC.
> >>>>
> >>>> Found some Git/Jira version discrepancies (script used from PR
> >>>> <https://github.com/apache/hadoop/pull/3991>):
> >>>>
> >>>> Jiras with missing fixVersion: 3.3.2
> >>>>
> >>>> HADOOP-17198
> >>>> HDFS-16344
> >>>> HDFS-16339
> >>>> YARN-11007
> >>>> HDFS-16171
> >>>> HDFS-16350
> >>>> HDFS-16336
> >>>> HADOOP-17975
> >>>> YARN-10991
> >>>> HDFS-16332
> >>>> HADOOP-17857
> >>>> HDFS-16271
> >>>> HADOOP-17195
> >>>> HADOOP-17290
> >>>> HADOOP-17819
> >>>> YARN-9551
> >>>>
> >>>>
> >>>>
> >>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>>
> >>>> > Thanks Chao. Yes contents are now present, I will start the testing.
> >>>> >
> >>>> >
> >>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org>
> wrote:
> >>>> >
> >>>> >> Oops, sorry about that. They should be there now. Can you check
> >>>> again?
> >>>> >> Thanks!
> >>>> >>
> >>>> >> Chao
> >>>> >>
> >>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> >>>> wrote:
> >>>> >>
> >>>> >>> > The RC is available at:
> >>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>
> >>>> >>> Chao, the RC folder seems empty as of now.
> >>>> >>>
> >>>> >>>
> >>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
> >>>> wrote:
> >>>> >>>
> >>>> >>>> Hi all,
> >>>> >>>>
> >>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> >>>> requested
> >>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>> >>>>
> >>>> >>>> The RC is available at:
> >>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> >>>> The RC tag is at:
> >>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> >>>> The Maven artifacts are staged at:
> >>>> >>>>
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>> >>>>
> >>>> >>>> You can find my public key at:
> >>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>> >>>>
> >>>> >>>> The deltas between this and RC3 are the addition of the following
> >>>> fixes:
> >>>> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
> >>>> directory
> >>>> >>>> rather
> >>>> >>>> than deleting.
> >>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
> >>>> YARN
> >>>> >>>> application catalog webapp
> >>>> >>>>
> >>>> >>>> Same as before, I've done the following verification and they
> look
> >>>> good:
> >>>> >>>> - Ran all the unit tests
> >>>> >>>> - Started a single node HDFS cluster and tested a few simple
> >>>> commands
> >>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>> >>>>
> >>>> >>>> Please evaluate the RC and vote, thanks!
> >>>> >>>>
> >>>> >>>> Best,
> >>>> >>>> Chao
> >>>> >>>>
> >>>> >>>
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao, things look good with the Jira fixVersion discrepancies.
I am curious if this requires new RC or you would like to update Changelog
in the existing RC. Either way, once Changelog is updated, and since other
functional testing looks good anyways, my vote would be +1 (non-binding).
On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
> Thanks again Viraj!
>
> > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>
> I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
> fix version tag.
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> Removed the fix version tag for this too.
>
> > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on 3.3.2: HADOOP-17936, HADOOP-18066
>
> I think HADOOP-17936 is already in branch-3.3.2?
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
>
> Please check again when you have a chance. Thanks.
>
> Best,
> Chao
>
>
>
>
>
>
>
>
>
>
> On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao. I just re-executed the script and found very minor
>> differences:
>>
>> 1. Incorrect fix versions:
>> HADOOP-17988
>> HADOOP-17728
>>
>> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> present.
>>
>> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
>> 3.3.2:
>> HADOOP-17936
>> HADOOP-18066
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>
>>> Thank you so much Viraj! I've no idea that I missed tagging these many
>>> JIRAs. The script is super useful!
>>>
>>> I just fixed the "fix version" of these. Could you double check? Really
>>> appreciate you putting effort to do a thorough check on this.
>>>
>>> Chao
>>>
>>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>>
>>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>>> and
>>>> changelist updated, will change my vote to +1 (non-binding).
>>>>
>>>> Basic RC verification using hadoop-vote.sh
>>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >:
>>>>
>>>> * Signature: ok
>>>> * Checksum : ok
>>>> * Rat check (1.8.0_301): ok
>>>> - mvn clean apache-rat:check
>>>> * Built from source (1.8.0_301): ok
>>>> - mvn clean install -DskipTests
>>>> * Built tar from source (1.8.0_301): ok
>>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> -Dmaven.javadoc.skip=true
>>>>
>>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>>> previous RC.
>>>>
>>>> Found some Git/Jira version discrepancies (script used from PR
>>>> <https://github.com/apache/hadoop/pull/3991>):
>>>>
>>>> Jiras with missing fixVersion: 3.3.2
>>>>
>>>> HADOOP-17198
>>>> HDFS-16344
>>>> HDFS-16339
>>>> YARN-11007
>>>> HDFS-16171
>>>> HDFS-16350
>>>> HDFS-16336
>>>> HADOOP-17975
>>>> YARN-10991
>>>> HDFS-16332
>>>> HADOOP-17857
>>>> HDFS-16271
>>>> HADOOP-17195
>>>> HADOOP-17290
>>>> HADOOP-17819
>>>> YARN-9551
>>>>
>>>>
>>>>
>>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>>
>>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>>> >
>>>> >
>>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>>> >
>>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> again?
>>>> >> Thanks!
>>>> >>
>>>> >> Chao
>>>> >>
>>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> > The RC is available at:
>>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>
>>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>
>>>> >>>
>>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi all,
>>>> >>>>
>>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> >>>> requested
>>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>>
>>>> >>>> The RC is available at:
>>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> The RC tag is at:
>>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> The Maven artifacts are staged at:
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>>
>>>> >>>> You can find my public key at:
>>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>>
>>>> >>>> The deltas between this and RC3 are the addition of the following
>>>> fixes:
>>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> directory
>>>> >>>> rather
>>>> >>>> than deleting.
>>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>>> YARN
>>>> >>>> application catalog webapp
>>>> >>>>
>>>> >>>> Same as before, I've done the following verification and they look
>>>> good:
>>>> >>>> - Ran all the unit tests
>>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> commands
>>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>>
>>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Chao
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao, things look good with the Jira fixVersion discrepancies.
I am curious if this requires new RC or you would like to update Changelog
in the existing RC. Either way, once Changelog is updated, and since other
functional testing looks good anyways, my vote would be +1 (non-binding).
On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
> Thanks again Viraj!
>
> > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>
> I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
> fix version tag.
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> Removed the fix version tag for this too.
>
> > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on 3.3.2: HADOOP-17936, HADOOP-18066
>
> I think HADOOP-17936 is already in branch-3.3.2?
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
>
> Please check again when you have a chance. Thanks.
>
> Best,
> Chao
>
>
>
>
>
>
>
>
>
>
> On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao. I just re-executed the script and found very minor
>> differences:
>>
>> 1. Incorrect fix versions:
>> HADOOP-17988
>> HADOOP-17728
>>
>> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> present.
>>
>> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
>> 3.3.2:
>> HADOOP-17936
>> HADOOP-18066
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>
>>> Thank you so much Viraj! I've no idea that I missed tagging these many
>>> JIRAs. The script is super useful!
>>>
>>> I just fixed the "fix version" of these. Could you double check? Really
>>> appreciate you putting effort to do a thorough check on this.
>>>
>>> Chao
>>>
>>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>>
>>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>>> and
>>>> changelist updated, will change my vote to +1 (non-binding).
>>>>
>>>> Basic RC verification using hadoop-vote.sh
>>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >:
>>>>
>>>> * Signature: ok
>>>> * Checksum : ok
>>>> * Rat check (1.8.0_301): ok
>>>> - mvn clean apache-rat:check
>>>> * Built from source (1.8.0_301): ok
>>>> - mvn clean install -DskipTests
>>>> * Built tar from source (1.8.0_301): ok
>>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> -Dmaven.javadoc.skip=true
>>>>
>>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>>> previous RC.
>>>>
>>>> Found some Git/Jira version discrepancies (script used from PR
>>>> <https://github.com/apache/hadoop/pull/3991>):
>>>>
>>>> Jiras with missing fixVersion: 3.3.2
>>>>
>>>> HADOOP-17198
>>>> HDFS-16344
>>>> HDFS-16339
>>>> YARN-11007
>>>> HDFS-16171
>>>> HDFS-16350
>>>> HDFS-16336
>>>> HADOOP-17975
>>>> YARN-10991
>>>> HDFS-16332
>>>> HADOOP-17857
>>>> HDFS-16271
>>>> HADOOP-17195
>>>> HADOOP-17290
>>>> HADOOP-17819
>>>> YARN-9551
>>>>
>>>>
>>>>
>>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>>
>>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>>> >
>>>> >
>>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>>> >
>>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> again?
>>>> >> Thanks!
>>>> >>
>>>> >> Chao
>>>> >>
>>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> > The RC is available at:
>>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>
>>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>
>>>> >>>
>>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi all,
>>>> >>>>
>>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> >>>> requested
>>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>>
>>>> >>>> The RC is available at:
>>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> The RC tag is at:
>>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> The Maven artifacts are staged at:
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>>
>>>> >>>> You can find my public key at:
>>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>>
>>>> >>>> The deltas between this and RC3 are the addition of the following
>>>> fixes:
>>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> directory
>>>> >>>> rather
>>>> >>>> than deleting.
>>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>>> YARN
>>>> >>>> application catalog webapp
>>>> >>>>
>>>> >>>> Same as before, I've done the following verification and they look
>>>> good:
>>>> >>>> - Ran all the unit tests
>>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> commands
>>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>>
>>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Chao
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao, things look good with the Jira fixVersion discrepancies.
I am curious if this requires new RC or you would like to update Changelog
in the existing RC. Either way, once Changelog is updated, and since other
functional testing looks good anyways, my vote would be +1 (non-binding).
On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
> Thanks again Viraj!
>
> > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>
> I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
> fix version tag.
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> Removed the fix version tag for this too.
>
> > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on 3.3.2: HADOOP-17936, HADOOP-18066
>
> I think HADOOP-17936 is already in branch-3.3.2?
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
>
> Please check again when you have a chance. Thanks.
>
> Best,
> Chao
>
>
>
>
>
>
>
>
>
>
> On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao. I just re-executed the script and found very minor
>> differences:
>>
>> 1. Incorrect fix versions:
>> HADOOP-17988
>> HADOOP-17728
>>
>> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> present.
>>
>> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
>> 3.3.2:
>> HADOOP-17936
>> HADOOP-18066
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>
>>> Thank you so much Viraj! I've no idea that I missed tagging these many
>>> JIRAs. The script is super useful!
>>>
>>> I just fixed the "fix version" of these. Could you double check? Really
>>> appreciate you putting effort to do a thorough check on this.
>>>
>>> Chao
>>>
>>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>>
>>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>>> and
>>>> changelist updated, will change my vote to +1 (non-binding).
>>>>
>>>> Basic RC verification using hadoop-vote.sh
>>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >:
>>>>
>>>> * Signature: ok
>>>> * Checksum : ok
>>>> * Rat check (1.8.0_301): ok
>>>> - mvn clean apache-rat:check
>>>> * Built from source (1.8.0_301): ok
>>>> - mvn clean install -DskipTests
>>>> * Built tar from source (1.8.0_301): ok
>>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> -Dmaven.javadoc.skip=true
>>>>
>>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>>> previous RC.
>>>>
>>>> Found some Git/Jira version discrepancies (script used from PR
>>>> <https://github.com/apache/hadoop/pull/3991>):
>>>>
>>>> Jiras with missing fixVersion: 3.3.2
>>>>
>>>> HADOOP-17198
>>>> HDFS-16344
>>>> HDFS-16339
>>>> YARN-11007
>>>> HDFS-16171
>>>> HDFS-16350
>>>> HDFS-16336
>>>> HADOOP-17975
>>>> YARN-10991
>>>> HDFS-16332
>>>> HADOOP-17857
>>>> HDFS-16271
>>>> HADOOP-17195
>>>> HADOOP-17290
>>>> HADOOP-17819
>>>> YARN-9551
>>>>
>>>>
>>>>
>>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>>
>>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>>> >
>>>> >
>>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>>> >
>>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> again?
>>>> >> Thanks!
>>>> >>
>>>> >> Chao
>>>> >>
>>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> > The RC is available at:
>>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>
>>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>
>>>> >>>
>>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi all,
>>>> >>>>
>>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> >>>> requested
>>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>>
>>>> >>>> The RC is available at:
>>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> The RC tag is at:
>>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> The Maven artifacts are staged at:
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>>
>>>> >>>> You can find my public key at:
>>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>>
>>>> >>>> The deltas between this and RC3 are the addition of the following
>>>> fixes:
>>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> directory
>>>> >>>> rather
>>>> >>>> than deleting.
>>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>>> YARN
>>>> >>>> application catalog webapp
>>>> >>>>
>>>> >>>> Same as before, I've done the following verification and they look
>>>> good:
>>>> >>>> - Ran all the unit tests
>>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> commands
>>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>>
>>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Chao
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao, things look good with the Jira fixVersion discrepancies.
I am curious if this requires new RC or you would like to update Changelog
in the existing RC. Either way, once Changelog is updated, and since other
functional testing looks good anyways, my vote would be +1 (non-binding).
On Tue, 15 Feb 2022 at 11:27 PM, Chao Sun <su...@apache.org> wrote:
> Thanks again Viraj!
>
> > 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
>
> I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
> fix version tag.
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> Removed the fix version tag for this too.
>
> > 3. Resolved with 3.3.2 fixversion but no no corresponding commit found
> on 3.3.2: HADOOP-17936, HADOOP-18066
>
> I think HADOOP-17936 is already in branch-3.3.2?
> https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
> HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
>
> Please check again when you have a chance. Thanks.
>
> Best,
> Chao
>
>
>
>
>
>
>
>
>
>
> On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
>
>> Thanks Chao. I just re-executed the script and found very minor
>> differences:
>>
>> 1. Incorrect fix versions:
>> HADOOP-17988
>> HADOOP-17728
>>
>> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
>> present.
>>
>> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
>> 3.3.2:
>> HADOOP-17936
>> HADOOP-18066
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>>
>>> Thank you so much Viraj! I've no idea that I missed tagging these many
>>> JIRAs. The script is super useful!
>>>
>>> I just fixed the "fix version" of these. Could you double check? Really
>>> appreciate you putting effort to do a thorough check on this.
>>>
>>> Chao
>>>
>>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>>
>>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>>> and
>>>> changelist updated, will change my vote to +1 (non-binding).
>>>>
>>>> Basic RC verification using hadoop-vote.sh
>>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>>> >:
>>>>
>>>> * Signature: ok
>>>> * Checksum : ok
>>>> * Rat check (1.8.0_301): ok
>>>> - mvn clean apache-rat:check
>>>> * Built from source (1.8.0_301): ok
>>>> - mvn clean install -DskipTests
>>>> * Built tar from source (1.8.0_301): ok
>>>> - mvn clean package -Pdist -DskipTests -Dtar
>>>> -Dmaven.javadoc.skip=true
>>>>
>>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>>> previous RC.
>>>>
>>>> Found some Git/Jira version discrepancies (script used from PR
>>>> <https://github.com/apache/hadoop/pull/3991>):
>>>>
>>>> Jiras with missing fixVersion: 3.3.2
>>>>
>>>> HADOOP-17198
>>>> HDFS-16344
>>>> HDFS-16339
>>>> YARN-11007
>>>> HDFS-16171
>>>> HDFS-16350
>>>> HDFS-16336
>>>> HADOOP-17975
>>>> YARN-10991
>>>> HDFS-16332
>>>> HADOOP-17857
>>>> HDFS-16271
>>>> HADOOP-17195
>>>> HADOOP-17290
>>>> HADOOP-17819
>>>> YARN-9551
>>>>
>>>>
>>>>
>>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>>
>>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>>> >
>>>> >
>>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>>> >
>>>> >> Oops, sorry about that. They should be there now. Can you check
>>>> again?
>>>> >> Thanks!
>>>> >>
>>>> >> Chao
>>>> >>
>>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>>> wrote:
>>>> >>
>>>> >>> > The RC is available at:
>>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>
>>>> >>> Chao, the RC folder seems empty as of now.
>>>> >>>
>>>> >>>
>>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org>
>>>> wrote:
>>>> >>>
>>>> >>>> Hi all,
>>>> >>>>
>>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> >>>> requested
>>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>> >>>>
>>>> >>>> The RC is available at:
>>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> >>>> The RC tag is at:
>>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> >>>> The Maven artifacts are staged at:
>>>> >>>>
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>> >>>>
>>>> >>>> You can find my public key at:
>>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>>> >>>>
>>>> >>>> The deltas between this and RC3 are the addition of the following
>>>> fixes:
>>>> >>>> - HADOOP-17198. Support S3 Access Points
>>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home
>>>> directory
>>>> >>>> rather
>>>> >>>> than deleting.
>>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>>> YARN
>>>> >>>> application catalog webapp
>>>> >>>>
>>>> >>>> Same as before, I've done the following verification and they look
>>>> good:
>>>> >>>> - Ran all the unit tests
>>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>>> commands
>>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>>> >>>>
>>>> >>>> Please evaluate the RC and vote, thanks!
>>>> >>>>
>>>> >>>> Best,
>>>> >>>> Chao
>>>> >>>>
>>>> >>>
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks again Viraj!
> 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
fix version tag.
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
Removed the fix version tag for this too.
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2: HADOOP-17936, HADOOP-18066
I think HADOOP-17936 is already in branch-3.3.2?
https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
Please check again when you have a chance. Thanks.
Best,
Chao
On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. I just re-executed the script and found very minor
> differences:
>
> 1. Incorrect fix versions:
> HADOOP-17988
> HADOOP-17728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>
>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> JIRAs. The script is super useful!
>>
>> I just fixed the "fix version" of these. Could you double check? Really
>> appreciate you putting effort to do a thorough check on this.
>>
>> Chao
>>
>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>> and
>>> changelist updated, will change my vote to +1 (non-binding).
>>>
>>> Basic RC verification using hadoop-vote.sh
>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >:
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> -Dmaven.javadoc.skip=true
>>>
>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>> previous RC.
>>>
>>> Found some Git/Jira version discrepancies (script used from PR
>>> <https://github.com/apache/hadoop/pull/3991>):
>>>
>>> Jiras with missing fixVersion: 3.3.2
>>>
>>> HADOOP-17198
>>> HDFS-16344
>>> HDFS-16339
>>> YARN-11007
>>> HDFS-16171
>>> HDFS-16350
>>> HDFS-16336
>>> HADOOP-17975
>>> YARN-10991
>>> HDFS-16332
>>> HADOOP-17857
>>> HDFS-16271
>>> HADOOP-17195
>>> HADOOP-17290
>>> HADOOP-17819
>>> YARN-9551
>>>
>>>
>>>
>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>> >
>>> >
>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>> >
>>> >> Oops, sorry about that. They should be there now. Can you check again?
>>> >> Thanks!
>>> >>
>>> >> Chao
>>> >>
>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>
>>> >>> > The RC is available at:
>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>
>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>
>>> >>>
>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>> >>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>> >>>> requested
>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>>
>>> >>>> The RC is available at:
>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> The RC tag is at:
>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> The Maven artifacts are staged at:
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>>
>>> >>>> You can find my public key at:
>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>>
>>> >>>> The deltas between this and RC3 are the addition of the following
>>> fixes:
>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> >>>> rather
>>> >>>> than deleting.
>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>> YARN
>>> >>>> application catalog webapp
>>> >>>>
>>> >>>> Same as before, I've done the following verification and they look
>>> good:
>>> >>>> - Ran all the unit tests
>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> commands
>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>>
>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>>
>>> >>>> Best,
>>> >>>> Chao
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks again Viraj!
> 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
fix version tag.
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
Removed the fix version tag for this too.
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2: HADOOP-17936, HADOOP-18066
I think HADOOP-17936 is already in branch-3.3.2?
https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
Please check again when you have a chance. Thanks.
Best,
Chao
On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. I just re-executed the script and found very minor
> differences:
>
> 1. Incorrect fix versions:
> HADOOP-17988
> HADOOP-17728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>
>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> JIRAs. The script is super useful!
>>
>> I just fixed the "fix version" of these. Could you double check? Really
>> appreciate you putting effort to do a thorough check on this.
>>
>> Chao
>>
>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>> and
>>> changelist updated, will change my vote to +1 (non-binding).
>>>
>>> Basic RC verification using hadoop-vote.sh
>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >:
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> -Dmaven.javadoc.skip=true
>>>
>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>> previous RC.
>>>
>>> Found some Git/Jira version discrepancies (script used from PR
>>> <https://github.com/apache/hadoop/pull/3991>):
>>>
>>> Jiras with missing fixVersion: 3.3.2
>>>
>>> HADOOP-17198
>>> HDFS-16344
>>> HDFS-16339
>>> YARN-11007
>>> HDFS-16171
>>> HDFS-16350
>>> HDFS-16336
>>> HADOOP-17975
>>> YARN-10991
>>> HDFS-16332
>>> HADOOP-17857
>>> HDFS-16271
>>> HADOOP-17195
>>> HADOOP-17290
>>> HADOOP-17819
>>> YARN-9551
>>>
>>>
>>>
>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>> >
>>> >
>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>> >
>>> >> Oops, sorry about that. They should be there now. Can you check again?
>>> >> Thanks!
>>> >>
>>> >> Chao
>>> >>
>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>
>>> >>> > The RC is available at:
>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>
>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>
>>> >>>
>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>> >>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>> >>>> requested
>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>>
>>> >>>> The RC is available at:
>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> The RC tag is at:
>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> The Maven artifacts are staged at:
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>>
>>> >>>> You can find my public key at:
>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>>
>>> >>>> The deltas between this and RC3 are the addition of the following
>>> fixes:
>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> >>>> rather
>>> >>>> than deleting.
>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>> YARN
>>> >>>> application catalog webapp
>>> >>>>
>>> >>>> Same as before, I've done the following verification and they look
>>> good:
>>> >>>> - Ran all the unit tests
>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> commands
>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>>
>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>>
>>> >>>> Best,
>>> >>>> Chao
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks again Viraj!
> 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
fix version tag.
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
Removed the fix version tag for this too.
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2: HADOOP-17936, HADOOP-18066
I think HADOOP-17936 is already in branch-3.3.2?
https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
Please check again when you have a chance. Thanks.
Best,
Chao
On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. I just re-executed the script and found very minor
> differences:
>
> 1. Incorrect fix versions:
> HADOOP-17988
> HADOOP-17728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>
>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> JIRAs. The script is super useful!
>>
>> I just fixed the "fix version" of these. Could you double check? Really
>> appreciate you putting effort to do a thorough check on this.
>>
>> Chao
>>
>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>> and
>>> changelist updated, will change my vote to +1 (non-binding).
>>>
>>> Basic RC verification using hadoop-vote.sh
>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >:
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> -Dmaven.javadoc.skip=true
>>>
>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>> previous RC.
>>>
>>> Found some Git/Jira version discrepancies (script used from PR
>>> <https://github.com/apache/hadoop/pull/3991>):
>>>
>>> Jiras with missing fixVersion: 3.3.2
>>>
>>> HADOOP-17198
>>> HDFS-16344
>>> HDFS-16339
>>> YARN-11007
>>> HDFS-16171
>>> HDFS-16350
>>> HDFS-16336
>>> HADOOP-17975
>>> YARN-10991
>>> HDFS-16332
>>> HADOOP-17857
>>> HDFS-16271
>>> HADOOP-17195
>>> HADOOP-17290
>>> HADOOP-17819
>>> YARN-9551
>>>
>>>
>>>
>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>> >
>>> >
>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>> >
>>> >> Oops, sorry about that. They should be there now. Can you check again?
>>> >> Thanks!
>>> >>
>>> >> Chao
>>> >>
>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>
>>> >>> > The RC is available at:
>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>
>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>
>>> >>>
>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>> >>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>> >>>> requested
>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>>
>>> >>>> The RC is available at:
>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> The RC tag is at:
>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> The Maven artifacts are staged at:
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>>
>>> >>>> You can find my public key at:
>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>>
>>> >>>> The deltas between this and RC3 are the addition of the following
>>> fixes:
>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> >>>> rather
>>> >>>> than deleting.
>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>> YARN
>>> >>>> application catalog webapp
>>> >>>>
>>> >>>> Same as before, I've done the following verification and they look
>>> good:
>>> >>>> - Ran all the unit tests
>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> commands
>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>>
>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>>
>>> >>>> Best,
>>> >>>> Chao
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thanks again Viraj!
> 1. Incorrect fix versions: HADOOP-17988, HADOOP-17728
I fixed HADOOP-17988. HADOOP-17728 is resolved as invalid so I removed the
fix version tag.
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
Removed the fix version tag for this too.
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2: HADOOP-17936, HADOOP-18066
I think HADOOP-17936 is already in branch-3.3.2?
https://github.com/apache/hadoop/commit/6931b70a004de2c84b0630bdb92a2c9f62879c24
HADOOP-18066 is resolved as invalid so I just removed the fix version tag.
Please check again when you have a chance. Thanks.
Best,
Chao
On Mon, Feb 14, 2022 at 11:51 PM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. I just re-executed the script and found very minor
> differences:
>
> 1. Incorrect fix versions:
> HADOOP-17988
> HADOOP-17728
>
> 2. HADOOP-17873 is not yet resolved but the corresponding commit is
> present.
>
> 3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
> 3.3.2:
> HADOOP-17936
> HADOOP-18066
>
>
>
> On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
>
>> Thank you so much Viraj! I've no idea that I missed tagging these many
>> JIRAs. The script is super useful!
>>
>> I just fixed the "fix version" of these. Could you double check? Really
>> appreciate you putting effort to do a thorough check on this.
>>
>> Chao
>>
>> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> -0 (non-binding), due to git/jira version discrepancies. Once resolved
>>> and
>>> changelist updated, will change my vote to +1 (non-binding).
>>>
>>> Basic RC verification using hadoop-vote.sh
>>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh
>>> >:
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar
>>> -Dmaven.javadoc.skip=true
>>>
>>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>>> previous RC.
>>>
>>> Found some Git/Jira version discrepancies (script used from PR
>>> <https://github.com/apache/hadoop/pull/3991>):
>>>
>>> Jiras with missing fixVersion: 3.3.2
>>>
>>> HADOOP-17198
>>> HDFS-16344
>>> HDFS-16339
>>> YARN-11007
>>> HDFS-16171
>>> HDFS-16350
>>> HDFS-16336
>>> HADOOP-17975
>>> YARN-10991
>>> HDFS-16332
>>> HADOOP-17857
>>> HDFS-16271
>>> HADOOP-17195
>>> HADOOP-17290
>>> HADOOP-17819
>>> YARN-9551
>>>
>>>
>>>
>>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>>
>>> > Thanks Chao. Yes contents are now present, I will start the testing.
>>> >
>>> >
>>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>>> >
>>> >> Oops, sorry about that. They should be there now. Can you check again?
>>> >> Thanks!
>>> >>
>>> >> Chao
>>> >>
>>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>>> wrote:
>>> >>
>>> >>> > The RC is available at:
>>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>
>>> >>> Chao, the RC folder seems empty as of now.
>>> >>>
>>> >>>
>>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>> >>>
>>> >>>> Hi all,
>>> >>>>
>>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>>> >>>> requested
>>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>> >>>>
>>> >>>> The RC is available at:
>>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> >>>> The RC tag is at:
>>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> >>>> The Maven artifacts are staged at:
>>> >>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>> >>>>
>>> >>>> You can find my public key at:
>>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>>> >>>>
>>> >>>> The deltas between this and RC3 are the addition of the following
>>> fixes:
>>> >>>> - HADOOP-17198. Support S3 Access Points
>>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> >>>> rather
>>> >>>> than deleting.
>>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in
>>> YARN
>>> >>>> application catalog webapp
>>> >>>>
>>> >>>> Same as before, I've done the following verification and they look
>>> good:
>>> >>>> - Ran all the unit tests
>>> >>>> - Started a single node HDFS cluster and tested a few simple
>>> commands
>>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>>> >>>>
>>> >>>> Please evaluate the RC and vote, thanks!
>>> >>>>
>>> >>>> Best,
>>> >>>> Chao
>>> >>>>
>>> >>>
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. I just re-executed the script and found very minor differences:
1. Incorrect fix versions:
HADOOP-17988
HADOOP-17728
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2:
HADOOP-17936
HADOOP-18066
On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> Thank you so much Viraj! I've no idea that I missed tagging these many
> JIRAs. The script is super useful!
>
> I just fixed the "fix version" of these. Could you double check? Really
> appreciate you putting effort to do a thorough check on this.
>
> Chao
>
> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
>> changelist updated, will change my vote to +1 (non-binding).
>>
>> Basic RC verification using hadoop-vote.sh
>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar
>> -Dmaven.javadoc.skip=true
>>
>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>> previous RC.
>>
>> Found some Git/Jira version discrepancies (script used from PR
>> <https://github.com/apache/hadoop/pull/3991>):
>>
>> Jiras with missing fixVersion: 3.3.2
>>
>> HADOOP-17198
>> HDFS-16344
>> HDFS-16339
>> YARN-11007
>> HDFS-16171
>> HDFS-16350
>> HDFS-16336
>> HADOOP-17975
>> YARN-10991
>> HDFS-16332
>> HADOOP-17857
>> HDFS-16271
>> HADOOP-17195
>> HADOOP-17290
>> HADOOP-17819
>> YARN-9551
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>> > Thanks Chao. Yes contents are now present, I will start the testing.
>> >
>> >
>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>> >
>> >> Oops, sorry about that. They should be there now. Can you check again?
>> >> Thanks!
>> >>
>> >> Chao
>> >>
>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>
>> >>> > The RC is available at:
>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>
>> >>> Chao, the RC folder seems empty as of now.
>> >>>
>> >>>
>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>> >>>
>> >>>> Hi all,
>> >>>>
>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>> >>>> requested
>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>>
>> >>>> The RC is available at:
>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> The RC tag is at:
>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> The Maven artifacts are staged at:
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>>
>> >>>> You can find my public key at:
>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>>
>> >>>> The deltas between this and RC3 are the addition of the following
>> fixes:
>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> >>>> rather
>> >>>> than deleting.
>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> >>>> application catalog webapp
>> >>>>
>> >>>> Same as before, I've done the following verification and they look
>> good:
>> >>>> - Ran all the unit tests
>> >>>> - Started a single node HDFS cluster and tested a few simple commands
>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>>
>> >>>> Please evaluate the RC and vote, thanks!
>> >>>>
>> >>>> Best,
>> >>>> Chao
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. I just re-executed the script and found very minor differences:
1. Incorrect fix versions:
HADOOP-17988
HADOOP-17728
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2:
HADOOP-17936
HADOOP-18066
On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> Thank you so much Viraj! I've no idea that I missed tagging these many
> JIRAs. The script is super useful!
>
> I just fixed the "fix version" of these. Could you double check? Really
> appreciate you putting effort to do a thorough check on this.
>
> Chao
>
> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
>> changelist updated, will change my vote to +1 (non-binding).
>>
>> Basic RC verification using hadoop-vote.sh
>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar
>> -Dmaven.javadoc.skip=true
>>
>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>> previous RC.
>>
>> Found some Git/Jira version discrepancies (script used from PR
>> <https://github.com/apache/hadoop/pull/3991>):
>>
>> Jiras with missing fixVersion: 3.3.2
>>
>> HADOOP-17198
>> HDFS-16344
>> HDFS-16339
>> YARN-11007
>> HDFS-16171
>> HDFS-16350
>> HDFS-16336
>> HADOOP-17975
>> YARN-10991
>> HDFS-16332
>> HADOOP-17857
>> HDFS-16271
>> HADOOP-17195
>> HADOOP-17290
>> HADOOP-17819
>> YARN-9551
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>> > Thanks Chao. Yes contents are now present, I will start the testing.
>> >
>> >
>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>> >
>> >> Oops, sorry about that. They should be there now. Can you check again?
>> >> Thanks!
>> >>
>> >> Chao
>> >>
>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>
>> >>> > The RC is available at:
>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>
>> >>> Chao, the RC folder seems empty as of now.
>> >>>
>> >>>
>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>> >>>
>> >>>> Hi all,
>> >>>>
>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>> >>>> requested
>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>>
>> >>>> The RC is available at:
>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> The RC tag is at:
>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> The Maven artifacts are staged at:
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>>
>> >>>> You can find my public key at:
>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>>
>> >>>> The deltas between this and RC3 are the addition of the following
>> fixes:
>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> >>>> rather
>> >>>> than deleting.
>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> >>>> application catalog webapp
>> >>>>
>> >>>> Same as before, I've done the following verification and they look
>> good:
>> >>>> - Ran all the unit tests
>> >>>> - Started a single node HDFS cluster and tested a few simple commands
>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>>
>> >>>> Please evaluate the RC and vote, thanks!
>> >>>>
>> >>>> Best,
>> >>>> Chao
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. I just re-executed the script and found very minor differences:
1. Incorrect fix versions:
HADOOP-17988
HADOOP-17728
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2:
HADOOP-17936
HADOOP-18066
On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> Thank you so much Viraj! I've no idea that I missed tagging these many
> JIRAs. The script is super useful!
>
> I just fixed the "fix version" of these. Could you double check? Really
> appreciate you putting effort to do a thorough check on this.
>
> Chao
>
> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
>> changelist updated, will change my vote to +1 (non-binding).
>>
>> Basic RC verification using hadoop-vote.sh
>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar
>> -Dmaven.javadoc.skip=true
>>
>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>> previous RC.
>>
>> Found some Git/Jira version discrepancies (script used from PR
>> <https://github.com/apache/hadoop/pull/3991>):
>>
>> Jiras with missing fixVersion: 3.3.2
>>
>> HADOOP-17198
>> HDFS-16344
>> HDFS-16339
>> YARN-11007
>> HDFS-16171
>> HDFS-16350
>> HDFS-16336
>> HADOOP-17975
>> YARN-10991
>> HDFS-16332
>> HADOOP-17857
>> HDFS-16271
>> HADOOP-17195
>> HADOOP-17290
>> HADOOP-17819
>> YARN-9551
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>> > Thanks Chao. Yes contents are now present, I will start the testing.
>> >
>> >
>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>> >
>> >> Oops, sorry about that. They should be there now. Can you check again?
>> >> Thanks!
>> >>
>> >> Chao
>> >>
>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>
>> >>> > The RC is available at:
>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>
>> >>> Chao, the RC folder seems empty as of now.
>> >>>
>> >>>
>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>> >>>
>> >>>> Hi all,
>> >>>>
>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>> >>>> requested
>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>>
>> >>>> The RC is available at:
>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> The RC tag is at:
>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> The Maven artifacts are staged at:
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>>
>> >>>> You can find my public key at:
>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>>
>> >>>> The deltas between this and RC3 are the addition of the following
>> fixes:
>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> >>>> rather
>> >>>> than deleting.
>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> >>>> application catalog webapp
>> >>>>
>> >>>> Same as before, I've done the following verification and they look
>> good:
>> >>>> - Ran all the unit tests
>> >>>> - Started a single node HDFS cluster and tested a few simple commands
>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>>
>> >>>> Please evaluate the RC and vote, thanks!
>> >>>>
>> >>>> Best,
>> >>>> Chao
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. I just re-executed the script and found very minor differences:
1. Incorrect fix versions:
HADOOP-17988
HADOOP-17728
2. HADOOP-17873 is not yet resolved but the corresponding commit is present.
3. Resolved with 3.3.2 fixversion but no no corresponding commit found on
3.3.2:
HADOOP-17936
HADOOP-18066
On Mon, Feb 14, 2022 at 11:49 PM Chao Sun <su...@apache.org> wrote:
> Thank you so much Viraj! I've no idea that I missed tagging these many
> JIRAs. The script is super useful!
>
> I just fixed the "fix version" of these. Could you double check? Really
> appreciate you putting effort to do a thorough check on this.
>
> Chao
>
> On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
>> changelist updated, will change my vote to +1 (non-binding).
>>
>> Basic RC verification using hadoop-vote.sh
>> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar
>> -Dmaven.javadoc.skip=true
>>
>> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
>> previous RC.
>>
>> Found some Git/Jira version discrepancies (script used from PR
>> <https://github.com/apache/hadoop/pull/3991>):
>>
>> Jiras with missing fixVersion: 3.3.2
>>
>> HADOOP-17198
>> HDFS-16344
>> HDFS-16339
>> YARN-11007
>> HDFS-16171
>> HDFS-16350
>> HDFS-16336
>> HADOOP-17975
>> YARN-10991
>> HDFS-16332
>> HADOOP-17857
>> HDFS-16271
>> HADOOP-17195
>> HADOOP-17290
>> HADOOP-17819
>> YARN-9551
>>
>>
>>
>> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>> > Thanks Chao. Yes contents are now present, I will start the testing.
>> >
>> >
>> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>> >
>> >> Oops, sorry about that. They should be there now. Can you check again?
>> >> Thanks!
>> >>
>> >> Chao
>> >>
>> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
>> wrote:
>> >>
>> >>> > The RC is available at:
>> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>
>> >>> Chao, the RC folder seems empty as of now.
>> >>>
>> >>>
>> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>> >>>
>> >>>> Hi all,
>> >>>>
>> >>>> Sorry for the delay! was waiting for a few fixes that people have
>> >>>> requested
>> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>> >>>>
>> >>>> The RC is available at:
>> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> >>>> The RC tag is at:
>> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> >>>> The Maven artifacts are staged at:
>> >>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>> >>>>
>> >>>> You can find my public key at:
>> >>>> https://downloads.apache.org/hadoop/common/KEYS
>> >>>>
>> >>>> The deltas between this and RC3 are the addition of the following
>> fixes:
>> >>>> - HADOOP-17198. Support S3 Access Points
>> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> >>>> rather
>> >>>> than deleting.
>> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> >>>> application catalog webapp
>> >>>>
>> >>>> Same as before, I've done the following verification and they look
>> good:
>> >>>> - Ran all the unit tests
>> >>>> - Started a single node HDFS cluster and tested a few simple commands
>> >>>> - Ran all the tests in Spark using the RC4 artifacts
>> >>>>
>> >>>> Please evaluate the RC and vote, thanks!
>> >>>>
>> >>>> Best,
>> >>>> Chao
>> >>>>
>> >>>
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thank you so much Viraj! I've no idea that I missed tagging these many
JIRAs. The script is super useful!
I just fixed the "fix version" of these. Could you double check? Really
appreciate you putting effort to do a thorough check on this.
Chao
On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
> changelist updated, will change my vote to +1 (non-binding).
>
> Basic RC verification using hadoop-vote.sh
> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar
> -Dmaven.javadoc.skip=true
>
> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
> previous RC.
>
> Found some Git/Jira version discrepancies (script used from PR
> <https://github.com/apache/hadoop/pull/3991>):
>
> Jiras with missing fixVersion: 3.3.2
>
> HADOOP-17198
> HDFS-16344
> HDFS-16339
> YARN-11007
> HDFS-16171
> HDFS-16350
> HDFS-16336
> HADOOP-17975
> YARN-10991
> HDFS-16332
> HADOOP-17857
> HDFS-16271
> HADOOP-17195
> HADOOP-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> >
> >> Oops, sorry about that. They should be there now. Can you check again?
> >> Thanks!
> >>
> >> Chao
> >>
> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>
> >>> > The RC is available at:
> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>
> >>> Chao, the RC folder seems empty as of now.
> >>>
> >>>
> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> >>>
> >>>> Hi all,
> >>>>
> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> requested
> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>>
> >>>> The RC is available at:
> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> The RC tag is at:
> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> The Maven artifacts are staged at:
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>>
> >>>> You can find my public key at:
> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>>
> >>>> The deltas between this and RC3 are the addition of the following
> fixes:
> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
> >>>> rather
> >>>> than deleting.
> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> >>>> application catalog webapp
> >>>>
> >>>> Same as before, I've done the following verification and they look
> good:
> >>>> - Ran all the unit tests
> >>>> - Started a single node HDFS cluster and tested a few simple commands
> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>>
> >>>> Please evaluate the RC and vote, thanks!
> >>>>
> >>>> Best,
> >>>> Chao
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thank you so much Viraj! I've no idea that I missed tagging these many
JIRAs. The script is super useful!
I just fixed the "fix version" of these. Could you double check? Really
appreciate you putting effort to do a thorough check on this.
Chao
On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
> changelist updated, will change my vote to +1 (non-binding).
>
> Basic RC verification using hadoop-vote.sh
> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar
> -Dmaven.javadoc.skip=true
>
> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
> previous RC.
>
> Found some Git/Jira version discrepancies (script used from PR
> <https://github.com/apache/hadoop/pull/3991>):
>
> Jiras with missing fixVersion: 3.3.2
>
> HADOOP-17198
> HDFS-16344
> HDFS-16339
> YARN-11007
> HDFS-16171
> HDFS-16350
> HDFS-16336
> HADOOP-17975
> YARN-10991
> HDFS-16332
> HADOOP-17857
> HDFS-16271
> HADOOP-17195
> HADOOP-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> >
> >> Oops, sorry about that. They should be there now. Can you check again?
> >> Thanks!
> >>
> >> Chao
> >>
> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>
> >>> > The RC is available at:
> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>
> >>> Chao, the RC folder seems empty as of now.
> >>>
> >>>
> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> >>>
> >>>> Hi all,
> >>>>
> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> requested
> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>>
> >>>> The RC is available at:
> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> The RC tag is at:
> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> The Maven artifacts are staged at:
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>>
> >>>> You can find my public key at:
> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>>
> >>>> The deltas between this and RC3 are the addition of the following
> fixes:
> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
> >>>> rather
> >>>> than deleting.
> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> >>>> application catalog webapp
> >>>>
> >>>> Same as before, I've done the following verification and they look
> good:
> >>>> - Ran all the unit tests
> >>>> - Started a single node HDFS cluster and tested a few simple commands
> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>>
> >>>> Please evaluate the RC and vote, thanks!
> >>>>
> >>>> Best,
> >>>> Chao
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thank you so much Viraj! I've no idea that I missed tagging these many
JIRAs. The script is super useful!
I just fixed the "fix version" of these. Could you double check? Really
appreciate you putting effort to do a thorough check on this.
Chao
On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
> changelist updated, will change my vote to +1 (non-binding).
>
> Basic RC verification using hadoop-vote.sh
> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar
> -Dmaven.javadoc.skip=true
>
> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
> previous RC.
>
> Found some Git/Jira version discrepancies (script used from PR
> <https://github.com/apache/hadoop/pull/3991>):
>
> Jiras with missing fixVersion: 3.3.2
>
> HADOOP-17198
> HDFS-16344
> HDFS-16339
> YARN-11007
> HDFS-16171
> HDFS-16350
> HDFS-16336
> HADOOP-17975
> YARN-10991
> HDFS-16332
> HADOOP-17857
> HDFS-16271
> HADOOP-17195
> HADOOP-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> >
> >> Oops, sorry about that. They should be there now. Can you check again?
> >> Thanks!
> >>
> >> Chao
> >>
> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>
> >>> > The RC is available at:
> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>
> >>> Chao, the RC folder seems empty as of now.
> >>>
> >>>
> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> >>>
> >>>> Hi all,
> >>>>
> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> requested
> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>>
> >>>> The RC is available at:
> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> The RC tag is at:
> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> The Maven artifacts are staged at:
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>>
> >>>> You can find my public key at:
> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>>
> >>>> The deltas between this and RC3 are the addition of the following
> fixes:
> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
> >>>> rather
> >>>> than deleting.
> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> >>>> application catalog webapp
> >>>>
> >>>> Same as before, I've done the following verification and they look
> good:
> >>>> - Ran all the unit tests
> >>>> - Started a single node HDFS cluster and tested a few simple commands
> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>>
> >>>> Please evaluate the RC and vote, thanks!
> >>>>
> >>>> Best,
> >>>> Chao
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Thank you so much Viraj! I've no idea that I missed tagging these many
JIRAs. The script is super useful!
I just fixed the "fix version" of these. Could you double check? Really
appreciate you putting effort to do a thorough check on this.
Chao
On Mon, Feb 14, 2022 at 3:10 AM Viraj Jasani <vj...@apache.org> wrote:
> -0 (non-binding), due to git/jira version discrepancies. Once resolved and
> changelist updated, will change my vote to +1 (non-binding).
>
> Basic RC verification using hadoop-vote.sh
> <https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar
> -Dmaven.javadoc.skip=true
>
> Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
> previous RC.
>
> Found some Git/Jira version discrepancies (script used from PR
> <https://github.com/apache/hadoop/pull/3991>):
>
> Jiras with missing fixVersion: 3.3.2
>
> HADOOP-17198
> HDFS-16344
> HDFS-16339
> YARN-11007
> HDFS-16171
> HDFS-16350
> HDFS-16336
> HADOOP-17975
> YARN-10991
> HDFS-16332
> HADOOP-17857
> HDFS-16271
> HADOOP-17195
> HADOOP-17290
> HADOOP-17819
> YARN-9551
>
>
>
> On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
>
> > Thanks Chao. Yes contents are now present, I will start the testing.
> >
> >
> > On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> >
> >> Oops, sorry about that. They should be there now. Can you check again?
> >> Thanks!
> >>
> >> Chao
> >>
> >> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org>
> wrote:
> >>
> >>> > The RC is available at:
> >>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>
> >>> Chao, the RC folder seems empty as of now.
> >>>
> >>>
> >>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> >>>
> >>>> Hi all,
> >>>>
> >>>> Sorry for the delay! was waiting for a few fixes that people have
> >>>> requested
> >>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
> >>>>
> >>>> The RC is available at:
> >>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> >>>> The RC tag is at:
> >>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> >>>> The Maven artifacts are staged at:
> >>>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
> >>>>
> >>>> You can find my public key at:
> >>>> https://downloads.apache.org/hadoop/common/KEYS
> >>>>
> >>>> The deltas between this and RC3 are the addition of the following
> fixes:
> >>>> - HADOOP-17198. Support S3 Access Points
> >>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
> >>>> rather
> >>>> than deleting.
> >>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> >>>> application catalog webapp
> >>>>
> >>>> Same as before, I've done the following verification and they look
> good:
> >>>> - Ran all the unit tests
> >>>> - Started a single node HDFS cluster and tested a few simple commands
> >>>> - Ran all the tests in Spark using the RC4 artifacts
> >>>>
> >>>> Please evaluate the RC and vote, thanks!
> >>>>
> >>>> Best,
> >>>> Chao
> >>>>
> >>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
-0 (non-binding), due to git/jira version discrepancies. Once resolved and
changelist updated, will change my vote to +1 (non-binding).
Basic RC verification using hadoop-vote.sh
<https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar
-Dmaven.javadoc.skip=true
Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
previous RC.
Found some Git/Jira version discrepancies (script used from PR
<https://github.com/apache/hadoop/pull/3991>):
Jiras with missing fixVersion: 3.3.2
HADOOP-17198
HDFS-16344
HDFS-16339
YARN-11007
HDFS-16171
HDFS-16350
HDFS-16336
HADOOP-17975
YARN-10991
HDFS-16332
HADOOP-17857
HDFS-16271
HADOOP-17195
HADOOP-17290
HADOOP-17819
YARN-9551
On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. Yes contents are now present, I will start the testing.
>
>
> On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>
>> Oops, sorry about that. They should be there now. Can you check again?
>> Thanks!
>>
>> Chao
>>
>> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> > The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>
>>> Chao, the RC folder seems empty as of now.
>>>
>>>
>>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> requested
>>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>>
>>>> The RC is available at:
>>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> The RC tag is at:
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> The Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>>
>>>> You can find my public key at:
>>>> https://downloads.apache.org/hadoop/common/KEYS
>>>>
>>>> The deltas between this and RC3 are the addition of the following fixes:
>>>> - HADOOP-17198. Support S3 Access Points
>>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>>> rather
>>>> than deleting.
>>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>>> application catalog webapp
>>>>
>>>> Same as before, I've done the following verification and they look good:
>>>> - Ran all the unit tests
>>>> - Started a single node HDFS cluster and tested a few simple commands
>>>> - Ran all the tests in Spark using the RC4 artifacts
>>>>
>>>> Please evaluate the RC and vote, thanks!
>>>>
>>>> Best,
>>>> Chao
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
-0 (non-binding), due to git/jira version discrepancies. Once resolved and
changelist updated, will change my vote to +1 (non-binding).
Basic RC verification using hadoop-vote.sh
<https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar
-Dmaven.javadoc.skip=true
Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
previous RC.
Found some Git/Jira version discrepancies (script used from PR
<https://github.com/apache/hadoop/pull/3991>):
Jiras with missing fixVersion: 3.3.2
HADOOP-17198
HDFS-16344
HDFS-16339
YARN-11007
HDFS-16171
HDFS-16350
HDFS-16336
HADOOP-17975
YARN-10991
HDFS-16332
HADOOP-17857
HDFS-16271
HADOOP-17195
HADOOP-17290
HADOOP-17819
YARN-9551
On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. Yes contents are now present, I will start the testing.
>
>
> On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>
>> Oops, sorry about that. They should be there now. Can you check again?
>> Thanks!
>>
>> Chao
>>
>> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> > The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>
>>> Chao, the RC folder seems empty as of now.
>>>
>>>
>>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> requested
>>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>>
>>>> The RC is available at:
>>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> The RC tag is at:
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> The Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>>
>>>> You can find my public key at:
>>>> https://downloads.apache.org/hadoop/common/KEYS
>>>>
>>>> The deltas between this and RC3 are the addition of the following fixes:
>>>> - HADOOP-17198. Support S3 Access Points
>>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>>> rather
>>>> than deleting.
>>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>>> application catalog webapp
>>>>
>>>> Same as before, I've done the following verification and they look good:
>>>> - Ran all the unit tests
>>>> - Started a single node HDFS cluster and tested a few simple commands
>>>> - Ran all the tests in Spark using the RC4 artifacts
>>>>
>>>> Please evaluate the RC and vote, thanks!
>>>>
>>>> Best,
>>>> Chao
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
-0 (non-binding), due to git/jira version discrepancies. Once resolved and
changelist updated, will change my vote to +1 (non-binding).
Basic RC verification using hadoop-vote.sh
<https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar
-Dmaven.javadoc.skip=true
Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
previous RC.
Found some Git/Jira version discrepancies (script used from PR
<https://github.com/apache/hadoop/pull/3991>):
Jiras with missing fixVersion: 3.3.2
HADOOP-17198
HDFS-16344
HDFS-16339
YARN-11007
HDFS-16171
HDFS-16350
HDFS-16336
HADOOP-17975
YARN-10991
HDFS-16332
HADOOP-17857
HDFS-16271
HADOOP-17195
HADOOP-17290
HADOOP-17819
YARN-9551
On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. Yes contents are now present, I will start the testing.
>
>
> On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>
>> Oops, sorry about that. They should be there now. Can you check again?
>> Thanks!
>>
>> Chao
>>
>> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> > The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>
>>> Chao, the RC folder seems empty as of now.
>>>
>>>
>>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> requested
>>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>>
>>>> The RC is available at:
>>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> The RC tag is at:
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> The Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>>
>>>> You can find my public key at:
>>>> https://downloads.apache.org/hadoop/common/KEYS
>>>>
>>>> The deltas between this and RC3 are the addition of the following fixes:
>>>> - HADOOP-17198. Support S3 Access Points
>>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>>> rather
>>>> than deleting.
>>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>>> application catalog webapp
>>>>
>>>> Same as before, I've done the following verification and they look good:
>>>> - Ran all the unit tests
>>>> - Started a single node HDFS cluster and tested a few simple commands
>>>> - Ran all the tests in Spark using the RC4 artifacts
>>>>
>>>> Please evaluate the RC and vote, thanks!
>>>>
>>>> Best,
>>>> Chao
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
-0 (non-binding), due to git/jira version discrepancies. Once resolved and
changelist updated, will change my vote to +1 (non-binding).
Basic RC verification using hadoop-vote.sh
<https://github.com/apache/hadoop/blob/trunk/dev-support/hadoop-vote.sh>:
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar
-Dmaven.javadoc.skip=true
Functional validation of HDFS, MapReduce and ATSv2 carry-forwarded from
previous RC.
Found some Git/Jira version discrepancies (script used from PR
<https://github.com/apache/hadoop/pull/3991>):
Jiras with missing fixVersion: 3.3.2
HADOOP-17198
HDFS-16344
HDFS-16339
YARN-11007
HDFS-16171
HDFS-16350
HDFS-16336
HADOOP-17975
YARN-10991
HDFS-16332
HADOOP-17857
HDFS-16271
HADOOP-17195
HADOOP-17290
HADOOP-17819
YARN-9551
On Mon, Feb 14, 2022 at 11:10 AM Viraj Jasani <vj...@apache.org> wrote:
> Thanks Chao. Yes contents are now present, I will start the testing.
>
>
> On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
>
>> Oops, sorry about that. They should be there now. Can you check again?
>> Thanks!
>>
>> Chao
>>
>> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>>
>>> > The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>
>>> Chao, the RC folder seems empty as of now.
>>>
>>>
>>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Sorry for the delay! was waiting for a few fixes that people have
>>>> requested
>>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>>
>>>> The RC is available at:
>>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>>> The RC tag is at:
>>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>>> The Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>>
>>>> You can find my public key at:
>>>> https://downloads.apache.org/hadoop/common/KEYS
>>>>
>>>> The deltas between this and RC3 are the addition of the following fixes:
>>>> - HADOOP-17198. Support S3 Access Points
>>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>>> rather
>>>> than deleting.
>>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>>> application catalog webapp
>>>>
>>>> Same as before, I've done the following verification and they look good:
>>>> - Ran all the unit tests
>>>> - Started a single node HDFS cluster and tested a few simple commands
>>>> - Ran all the tests in Spark using the RC4 artifacts
>>>>
>>>> Please evaluate the RC and vote, thanks!
>>>>
>>>> Best,
>>>> Chao
>>>>
>>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. Yes contents are now present, I will start the testing.
On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> Oops, sorry about that. They should be there now. Can you check again?
> Thanks!
>
> Chao
>
> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>
>> Chao, the RC folder seems empty as of now.
>>
>>
>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>
>>> Hi all,
>>>
>>> Sorry for the delay! was waiting for a few fixes that people have
>>> requested
>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>
>>> The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> The deltas between this and RC3 are the addition of the following fixes:
>>> - HADOOP-17198. Support S3 Access Points
>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> rather
>>> than deleting.
>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>> application catalog webapp
>>>
>>> Same as before, I've done the following verification and they look good:
>>> - Ran all the unit tests
>>> - Started a single node HDFS cluster and tested a few simple commands
>>> - Ran all the tests in Spark using the RC4 artifacts
>>>
>>> Please evaluate the RC and vote, thanks!
>>>
>>> Best,
>>> Chao
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. Yes contents are now present, I will start the testing.
On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> Oops, sorry about that. They should be there now. Can you check again?
> Thanks!
>
> Chao
>
> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>
>> Chao, the RC folder seems empty as of now.
>>
>>
>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>
>>> Hi all,
>>>
>>> Sorry for the delay! was waiting for a few fixes that people have
>>> requested
>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>
>>> The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> The deltas between this and RC3 are the addition of the following fixes:
>>> - HADOOP-17198. Support S3 Access Points
>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> rather
>>> than deleting.
>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>> application catalog webapp
>>>
>>> Same as before, I've done the following verification and they look good:
>>> - Ran all the unit tests
>>> - Started a single node HDFS cluster and tested a few simple commands
>>> - Ran all the tests in Spark using the RC4 artifacts
>>>
>>> Please evaluate the RC and vote, thanks!
>>>
>>> Best,
>>> Chao
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. Yes contents are now present, I will start the testing.
On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> Oops, sorry about that. They should be there now. Can you check again?
> Thanks!
>
> Chao
>
> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>
>> Chao, the RC folder seems empty as of now.
>>
>>
>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>
>>> Hi all,
>>>
>>> Sorry for the delay! was waiting for a few fixes that people have
>>> requested
>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>
>>> The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> The deltas between this and RC3 are the addition of the following fixes:
>>> - HADOOP-17198. Support S3 Access Points
>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> rather
>>> than deleting.
>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>> application catalog webapp
>>>
>>> Same as before, I've done the following verification and they look good:
>>> - Ran all the unit tests
>>> - Started a single node HDFS cluster and tested a few simple commands
>>> - Ran all the tests in Spark using the RC4 artifacts
>>>
>>> Please evaluate the RC and vote, thanks!
>>>
>>> Best,
>>> Chao
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
Thanks Chao. Yes contents are now present, I will start the testing.
On Mon, 14 Feb 2022 at 2:13 AM, Chao Sun <su...@apache.org> wrote:
> Oops, sorry about that. They should be there now. Can you check again?
> Thanks!
>
> Chao
>
> On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
>
>> > The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>
>> Chao, the RC folder seems empty as of now.
>>
>>
>> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>>
>>> Hi all,
>>>
>>> Sorry for the delay! was waiting for a few fixes that people have
>>> requested
>>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>>
>>> The RC is available at:
>>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> The deltas between this and RC3 are the addition of the following fixes:
>>> - HADOOP-17198. Support S3 Access Points
>>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>>> rather
>>> than deleting.
>>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>>> application catalog webapp
>>>
>>> Same as before, I've done the following verification and they look good:
>>> - Ran all the unit tests
>>> - Started a single node HDFS cluster and tested a few simple commands
>>> - Ran all the tests in Spark using the RC4 artifacts
>>>
>>> Please evaluate the RC and vote, thanks!
>>>
>>> Best,
>>> Chao
>>>
>>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Oops, sorry about that. They should be there now. Can you check again?
Thanks!
Chao
On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>
> Chao, the RC folder seems empty as of now.
>
>
> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The deltas between this and RC3 are the addition of the following fixes:
>> - HADOOP-17198. Support S3 Access Points
>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> rather
>> than deleting.
>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> application catalog webapp
>>
>> Same as before, I've done the following verification and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC4 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Oops, sorry about that. They should be there now. Can you check again?
Thanks!
Chao
On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>
> Chao, the RC folder seems empty as of now.
>
>
> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The deltas between this and RC3 are the addition of the following fixes:
>> - HADOOP-17198. Support S3 Access Points
>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> rather
>> than deleting.
>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> application catalog webapp
>>
>> Same as before, I've done the following verification and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC4 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Oops, sorry about that. They should be there now. Can you check again?
Thanks!
Chao
On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>
> Chao, the RC folder seems empty as of now.
>
>
> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The deltas between this and RC3 are the addition of the following fixes:
>> - HADOOP-17198. Support S3 Access Points
>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> rather
>> than deleting.
>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> application catalog webapp
>>
>> Same as before, I've done the following verification and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC4 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Chao Sun <su...@apache.org>.
Oops, sorry about that. They should be there now. Can you check again?
Thanks!
Chao
On Sun, Feb 13, 2022 at 6:47 AM Viraj Jasani <vj...@apache.org> wrote:
> > The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>
> Chao, the RC folder seems empty as of now.
>
>
> On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
>
>> Hi all,
>>
>> Sorry for the delay! was waiting for a few fixes that people have
>> requested
>> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>>
>> The RC is available at:
>> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS
>>
>> The deltas between this and RC3 are the addition of the following fixes:
>> - HADOOP-17198. Support S3 Access Points
>> - HADOOP-18096. Distcp: Sync moves filtered file to home directory
>> rather
>> than deleting.
>> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
>> application catalog webapp
>>
>> Same as before, I've done the following verification and they look good:
>> - Ran all the unit tests
>> - Started a single node HDFS cluster and tested a few simple commands
>> - Ran all the tests in Spark using the RC4 artifacts
>>
>> Please evaluate the RC and vote, thanks!
>>
>> Best,
>> Chao
>>
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
> The RC is available at:
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
Chao, the RC folder seems empty as of now.
On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> Sorry for the delay! was waiting for a few fixes that people have requested
> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The deltas between this and RC3 are the addition of the following fixes:
> - HADOOP-17198. Support S3 Access Points
> - HADOOP-18096. Distcp: Sync moves filtered file to home directory rather
> than deleting.
> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> application catalog webapp
>
> Same as before, I've done the following verification and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC4 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
> The RC is available at:
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
Chao, the RC folder seems empty as of now.
On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> Sorry for the delay! was waiting for a few fixes that people have requested
> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The deltas between this and RC3 are the addition of the following fixes:
> - HADOOP-17198. Support S3 Access Points
> - HADOOP-18096. Distcp: Sync moves filtered file to home directory rather
> than deleting.
> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> application catalog webapp
>
> Same as before, I've done the following verification and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC4 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
> The RC is available at:
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
Chao, the RC folder seems empty as of now.
On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> Sorry for the delay! was waiting for a few fixes that people have requested
> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The deltas between this and RC3 are the addition of the following fixes:
> - HADOOP-17198. Support S3 Access Points
> - HADOOP-18096. Distcp: Sync moves filtered file to home directory rather
> than deleting.
> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> application catalog webapp
>
> Same as before, I've done the following verification and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC4 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>
Re: [VOTE] Release Apache Hadoop 3.3.2 - RC4
Posted by Viraj Jasani <vj...@apache.org>.
> The RC is available at:
http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
Chao, the RC folder seems empty as of now.
On Sat, Feb 12, 2022 at 3:12 AM Chao Sun <su...@apache.org> wrote:
> Hi all,
>
> Sorry for the delay! was waiting for a few fixes that people have requested
> to backport. I've just put together Hadoop 3.3.2 RC4 below:
>
> The RC is available at:
> http://people.apache.org/~sunchao/hadoop-3.3.2-RC4/
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC4
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1334/
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> The deltas between this and RC3 are the addition of the following fixes:
> - HADOOP-17198. Support S3 Access Points
> - HADOOP-18096. Distcp: Sync moves filtered file to home directory rather
> than deleting.
> - YARN-10561. Upgrade node.js to 12.22.1 and yarn to 1.22.5 in YARN
> application catalog webapp
>
> Same as before, I've done the following verification and they look good:
> - Ran all the unit tests
> - Started a single node HDFS cluster and tested a few simple commands
> - Ran all the tests in Spark using the RC4 artifacts
>
> Please evaluate the RC and vote, thanks!
>
> Best,
> Chao
>