You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Brahma Reddy Battula <br...@apache.org> on 2021/08/10 09:54:36 UTC
Hadoop-3.2.3 Release Update
Hi All,
I cut branch-3.2.3 and it is ready for release. Please commit to
branch-3.2.3 if any critical/blocker issues need to go.
*This time I am thinking of having downstream projects and companies'
voices,let's know how this can go. *
- Planning to check with downstream projects like Spark,HBase and Hive
if they can help on validation(Or running their UT on this branch)
- Collecting info from Companies who are already deployed and using the
branch-3.2
so that we can make a more stable release on 3.2 (so that features released
on this branch impact can be known) ,please let me know anybody from these
communities who can help on this.
Planning to create RC by this month end. Any suggestions are welcome.
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Hi to raise the awareness,
it looks like reverting the FoldedTreeSet HDFS-13671
<https://issues.apache.org/jira/browse/HDFS-13671> breaks TestBlockManager
in branch-3.2. Branch-3.3 is good.
tracking jira: HDFS-16258 <https://issues.apache.org/jira/browse/HDFS-16258>
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
I cherry-picked some commits and edited JIRA issues
based on the warnigs of git_jira_fix_version_check.py.
The warning about HADOOP-17592 can be ignored since it is caused by
wrong issue id in the commit log (HADOOP-17952 instead of HADOOP-17592).
$ ./venv/bin/python dev-support/git-jira-validation/git_jira_fix_version_check.py
...
Any resolved Jira with fixVersion 3.2.3 but corresponding commit not present
Starting diff: ##############################################
HADOOP-17592 is marked resolved with fixVersion 3.2.3 but no corresponding commit found
Completed diff: ##############################################
$ git log --grep 'Fix the wrong CIDR range example in Proxy User documentation'
commit 35855007f6e18298c849f7830c0d6550ffba9e9a
Author: kwangsun <no...@gmail.com>
Date: Mon Mar 22 11:43:32 2021 +0900
HADOOP-17952. Fix the wrong CIDR range example in Proxy User documentation. (#2780)
Signed-off-by: Akira Ajisaka <aa...@apache.org>
(cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef)
I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation).
Thanks,
Masatake Iwasaki
On 2022/03/11 22:17, Xiaoqiao He wrote:
> Thanks Masatake for the update. Sounds great! Please ping me if I could help with something.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release <https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release>
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3 <https://github.com/apache/hadoop/tree/branch-3.2.3>
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718 <https://issues.apache.org/jira/browse/HADOOP-17718>
>
> * Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125 <https://issues.apache.org/jira/browse/HADOOP-18125>
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
> https://issues.apache.org/jira/browse/HADOOP-18088 <https://issues.apache.org/jira/browse/HADOOP-18088>
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605> <https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org> <mailto:weichiu@apache.org <ma...@apache.org>>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160> <https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>>
> > >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop> <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org> <mailto:hexiaoqiao@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
I cherry-picked some commits and edited JIRA issues
based on the warnigs of git_jira_fix_version_check.py.
The warning about HADOOP-17592 can be ignored since it is caused by
wrong issue id in the commit log (HADOOP-17952 instead of HADOOP-17592).
$ ./venv/bin/python dev-support/git-jira-validation/git_jira_fix_version_check.py
...
Any resolved Jira with fixVersion 3.2.3 but corresponding commit not present
Starting diff: ##############################################
HADOOP-17592 is marked resolved with fixVersion 3.2.3 but no corresponding commit found
Completed diff: ##############################################
$ git log --grep 'Fix the wrong CIDR range example in Proxy User documentation'
commit 35855007f6e18298c849f7830c0d6550ffba9e9a
Author: kwangsun <no...@gmail.com>
Date: Mon Mar 22 11:43:32 2021 +0900
HADOOP-17952. Fix the wrong CIDR range example in Proxy User documentation. (#2780)
Signed-off-by: Akira Ajisaka <aa...@apache.org>
(cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef)
I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation).
Thanks,
Masatake Iwasaki
On 2022/03/11 22:17, Xiaoqiao He wrote:
> Thanks Masatake for the update. Sounds great! Please ping me if I could help with something.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release <https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release>
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3 <https://github.com/apache/hadoop/tree/branch-3.2.3>
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718 <https://issues.apache.org/jira/browse/HADOOP-17718>
>
> * Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125 <https://issues.apache.org/jira/browse/HADOOP-18125>
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
> https://issues.apache.org/jira/browse/HADOOP-18088 <https://issues.apache.org/jira/browse/HADOOP-18088>
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605> <https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org> <mailto:weichiu@apache.org <ma...@apache.org>>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160> <https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>>
> > >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop> <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org> <mailto:hexiaoqiao@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
I cherry-picked some commits and edited JIRA issues
based on the warnigs of git_jira_fix_version_check.py.
The warning about HADOOP-17592 can be ignored since it is caused by
wrong issue id in the commit log (HADOOP-17952 instead of HADOOP-17592).
$ ./venv/bin/python dev-support/git-jira-validation/git_jira_fix_version_check.py
...
Any resolved Jira with fixVersion 3.2.3 but corresponding commit not present
Starting diff: ##############################################
HADOOP-17592 is marked resolved with fixVersion 3.2.3 but no corresponding commit found
Completed diff: ##############################################
$ git log --grep 'Fix the wrong CIDR range example in Proxy User documentation'
commit 35855007f6e18298c849f7830c0d6550ffba9e9a
Author: kwangsun <no...@gmail.com>
Date: Mon Mar 22 11:43:32 2021 +0900
HADOOP-17952. Fix the wrong CIDR range example in Proxy User documentation. (#2780)
Signed-off-by: Akira Ajisaka <aa...@apache.org>
(cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef)
I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation).
Thanks,
Masatake Iwasaki
On 2022/03/11 22:17, Xiaoqiao He wrote:
> Thanks Masatake for the update. Sounds great! Please ping me if I could help with something.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release <https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release>
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3 <https://github.com/apache/hadoop/tree/branch-3.2.3>
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718 <https://issues.apache.org/jira/browse/HADOOP-17718>
>
> * Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125 <https://issues.apache.org/jira/browse/HADOOP-18125>
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
> https://issues.apache.org/jira/browse/HADOOP-18088 <https://issues.apache.org/jira/browse/HADOOP-18088>
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605> <https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org> <mailto:weichiu@apache.org <ma...@apache.org>>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160> <https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>>
> > >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop> <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org> <mailto:hexiaoqiao@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
I cherry-picked some commits and edited JIRA issues
based on the warnigs of git_jira_fix_version_check.py.
The warning about HADOOP-17592 can be ignored since it is caused by
wrong issue id in the commit log (HADOOP-17952 instead of HADOOP-17592).
$ ./venv/bin/python dev-support/git-jira-validation/git_jira_fix_version_check.py
...
Any resolved Jira with fixVersion 3.2.3 but corresponding commit not present
Starting diff: ##############################################
HADOOP-17592 is marked resolved with fixVersion 3.2.3 but no corresponding commit found
Completed diff: ##############################################
$ git log --grep 'Fix the wrong CIDR range example in Proxy User documentation'
commit 35855007f6e18298c849f7830c0d6550ffba9e9a
Author: kwangsun <no...@gmail.com>
Date: Mon Mar 22 11:43:32 2021 +0900
HADOOP-17952. Fix the wrong CIDR range example in Proxy User documentation. (#2780)
Signed-off-by: Akira Ajisaka <aa...@apache.org>
(cherry picked from commit c8d327a4f1a7f15d6be35051414199d1d3fdc5ef)
I will create RC0 shortly after updating index.md.vm (which is the top page of site documentation).
Thanks,
Masatake Iwasaki
On 2022/03/11 22:17, Xiaoqiao He wrote:
> Thanks Masatake for the update. Sounds great! Please ping me if I could help with something.
>
> Best Regards,
> - He Xiaoqiao
>
> On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release <https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release>
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3 <https://github.com/apache/hadoop/tree/branch-3.2.3>
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718 <https://issues.apache.org/jira/browse/HADOOP-17718>
>
> * Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125 <https://issues.apache.org/jira/browse/HADOOP-18125>
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
> https://issues.apache.org/jira/browse/HADOOP-18088 <https://issues.apache.org/jira/browse/HADOOP-18088>
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605> <https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org> <mailto:weichiu@apache.org <ma...@apache.org>>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com> <mailto:xq.he2009@gmail.com <ma...@gmail.com>>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160> <https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>>
> > >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp> <mailto:iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org> <mailto:aajisaka@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop> <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>>
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff> <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org> <mailto:hexiaoqiao@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org> <mailto:brahma@apache.org <ma...@apache.org>>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org> <mailto:common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>>
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for the update. Sounds great! Please ping me if I could
help with something.
Best Regards,
- He Xiaoqiao
On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running
> create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718
>
> * Checking git commit / Jira fixVersion discrepancies by script added by
> HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3
> without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we
> need.
> https://issues.apache.org/jira/browse/HADOOP-18088
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there
> is no more bandwidth, I think we should involve other volunteers to make
> it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <
> https://issues.apache.org/jira/browse/BIGTOP-3605>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress
> on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <
> weichiu@apache.org <ma...@apache.org>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <
> brahma@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <
> aajisaka@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for
> the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and
> branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it
> seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible.
> I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651
> HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have
> enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 &
> branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3
> , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC
> next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <
> https://issues.apache.org/jira/browse/HDFS-15160>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <mailto:
> aajisaka@apache.org>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>>
> > >>>>>>>>>> Looks all are build related issues when you try with
> bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by
> Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required
> phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to
> Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> <
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have
> JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making
> hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in
> touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy
> Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release.
> Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need
> to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream
> projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects
> like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running
> their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are
> already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2
> (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me
> know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any
> suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>>
> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <mailto:
> common-dev-unsubscribe@hadoop.apache.org>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <mailto:
> common-dev-help@hadoop.apache.org>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for the update. Sounds great! Please ping me if I could
help with something.
Best Regards,
- He Xiaoqiao
On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running
> create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718
>
> * Checking git commit / Jira fixVersion discrepancies by script added by
> HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3
> without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we
> need.
> https://issues.apache.org/jira/browse/HADOOP-18088
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there
> is no more bandwidth, I think we should involve other volunteers to make
> it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <
> https://issues.apache.org/jira/browse/BIGTOP-3605>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress
> on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <
> weichiu@apache.org <ma...@apache.org>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <
> brahma@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <
> aajisaka@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for
> the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and
> branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it
> seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible.
> I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651
> HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have
> enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 &
> branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3
> , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC
> next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <
> https://issues.apache.org/jira/browse/HDFS-15160>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <mailto:
> aajisaka@apache.org>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>>
> > >>>>>>>>>> Looks all are build related issues when you try with
> bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by
> Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required
> phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to
> Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> <
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have
> JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making
> hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in
> touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy
> Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release.
> Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need
> to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream
> projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects
> like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running
> their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are
> already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2
> (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me
> know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any
> suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>>
> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <mailto:
> common-dev-unsubscribe@hadoop.apache.org>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <mailto:
> common-dev-help@hadoop.apache.org>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for the update. Sounds great! Please ping me if I could
help with something.
Best Regards,
- He Xiaoqiao
On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running
> create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718
>
> * Checking git commit / Jira fixVersion discrepancies by script added by
> HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3
> without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we
> need.
> https://issues.apache.org/jira/browse/HADOOP-18088
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there
> is no more bandwidth, I think we should involve other volunteers to make
> it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <
> https://issues.apache.org/jira/browse/BIGTOP-3605>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress
> on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <
> weichiu@apache.org <ma...@apache.org>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <
> brahma@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <
> aajisaka@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for
> the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and
> branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it
> seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible.
> I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651
> HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have
> enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 &
> branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3
> , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC
> next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <
> https://issues.apache.org/jira/browse/HDFS-15160>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <mailto:
> aajisaka@apache.org>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>>
> > >>>>>>>>>> Looks all are build related issues when you try with
> bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by
> Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required
> phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to
> Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> <
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have
> JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making
> hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in
> touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy
> Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release.
> Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need
> to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream
> projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects
> like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running
> their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are
> already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2
> (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me
> know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any
> suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>>
> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <mailto:
> common-dev-unsubscribe@hadoop.apache.org>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <mailto:
> common-dev-help@hadoop.apache.org>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for the update. Sounds great! Please ping me if I could
help with something.
Best Regards,
- He Xiaoqiao
On Thu, Mar 10, 2022 at 6:16 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
>
> I'm going to cut RC0 on behalf of Brahma on this weekend.
>
> There looks no blocker/critical issues on JIRA.
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
>
> branch-3.2.3 was cut and version was set by Brahma.
> https://github.com/apache/hadoop/tree/branch-3.2.3
>
> I found some TODOs to cut RC from branch-3.2.3.
>
> * Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running
> create-release script.
> https://issues.apache.org/jira/browse/HADOOP-17718
>
> * Checking git commit / Jira fixVersion discrepancies by script added by
> HADOOP-18125.
> https://issues.apache.org/jira/browse/HADOOP-18125
>
> While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3
> without this.
> We can release 3.2.4 right after 3.2.3 just for reload4j migration if we
> need.
> https://issues.apache.org/jira/browse/HADOOP-18088
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/03/10 12:23, Xiaoqiao He wrote:
> > Thanks Masatake for reaching out.
> >
> > Not sure if Brahma has bandwidth to push this release forward. If there
> is no more bandwidth, I think we should involve other volunteers to make
> it happen.
> > Or Masatake, are you interested in continuing the 3.2.3 release? I would
> like to offer some bandwidth if need any help.
> > Thanks again.
> >
> > Regards
> > - He Xiaoqiao
> >
> > On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >
> > Hi Brahma,
> >
> > I would like to use 3.2.3 for next minor release of Bigtop.
> > https://issues.apache.org/jira/browse/BIGTOP-3605 <
> https://issues.apache.org/jira/browse/BIGTOP-3605>
> >
> > Let me know if there is any blocker I can help.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > > Sorry, I was looking for some CVE’s fixes.will make it progress
> on this…
> > >
> > >
> > > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <
> weichiu@apache.org <ma...@apache.org>> wrote:
> > >
> > >> Is this still making progress?
> > >>
> > >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <
> brahma@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>
> > >>> Hi Akira,
> > >>>
> > >>> Thanks for your email!!
> > >>>
> > >>> I am evaluating the CVE’s which needs to go for this release..
> > >>>
> > >>> Will update soon!!
> > >>>
> > >>>
> > >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <
> aajisaka@apache.org <ma...@apache.org>>
> > >> wrote:
> > >>>
> > >>>> Hi Brahma,
> > >>>>
> > >>>> What is the release process going on? Is there any blocker for
> the RC?
> > >>>>
> > >>>> -Akira
> > >>>>
> > >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >> wrote:
> > >>>>
> > >>>>> Hi Brahma,
> > >>>>>
> > >>>>> The feature 'BPServiceActor processes commands from NameNode
> > >>>>> asynchronously' has been ready for both branch-3.2 and
> branch-3.2.3.
> > >>>> While
> > >>>>> cherry-picking there is only minor conflict, So I checked in
> > >> directly.
> > >>>> BTW,
> > >>>>> run some unit tests and build pseudo cluster to verify, it
> seems to
> > >>> work
> > >>>>> fine.
> > >>>>> FYI.
> > >>>>>
> > >>>>> Regards,
> > >>>>> - He Xiaoqiao
> > >>>>>
> > >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > >>> brahma@apache.org <ma...@apache.org>
> > >>>>>
> > >>>>> wrote:
> > >>>>>
> > >>>>>> Please go ahead. Let me know any help required on review.
> > >>>>>>
> > >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>
> > >>>>>>> Hi Brahma,
> > >>>>>>>
> > >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible.
> I have
> > >>>>>>> resolved the conflict and verified them locally.
> > >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651
> HDFS-15113.
> > >>>>>>> I would like to hear some more response that if we have
> enough time
> > >>> to
> > >>>>>>> wait for it to be ready.
> > >>>>>>> Thanks.
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> - He Xiaoqiao
> > >>>>>>>
> > >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <
> xq.he2009@gmail.com <ma...@gmail.com>>
> > >>>> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 &
> branch-3.2.3.
> > >> FYI.
> > >>>>>>>>
> > >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > >>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>>> Hi All,
> > >>>>>>>>>
> > >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3
> , mostly
> > >>>> this
> > >>>>>>>>> can
> > >>>>>>>>> be done by this week,then I will try to create the RC
> next if
> > >> there
> > >>>> is
> > >>>>>>>>> no
> > >>>>>>>>> objection.
> > >>>>>>>>>
> > >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <
> https://issues.apache.org/jira/browse/HDFS-15160>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <mailto:
> aajisaka@apache.org>> and @Masatake Iwasaki
> > >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>>
> > >>>>>>>>>> Looks all are build related issues when you try with
> bigtop. We
> > >>> can
> > >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> > >>>>>>>>>>
> > >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>>>>>>> iwasakims@oss.nttdata.co.jp <mailto:
> iwasakims@oss.nttdata.co.jp>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>
> > >>>>>>>>>>> I filed HADOOP-17849 for this.
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> > >>>>>>>>> background.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for building hadoop-3.2.2 against
> zookeeper-3.4.14.
> > >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> > >>>>>>>>> zooekeper-3.4.13,
> > >>>>>>>>>>>> while it would be harmless to add the exclusion even
> for
> > >>>>>>>>>>> zooekeeper-3.4.13.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> These are relevant to directory structure used by
> Bigtop
> > >>>> package.
> > >>>>>>>>>>>> If the fix does not break the tarball dist,
> > >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> -
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required
> phantomjs.
> > >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> > >> YARN-UI2
> > >>>> on
> > >>>>>>>>>>> packaging.
> > >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>>>>>>>>>> Thanks, I'll check them out.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> > >>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to
> Hadoop
> > >>>>>>>>> 3.2.2.
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> <
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In these patches, how about backporting the following
> > >> issues
> > >>>> to
> > >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> > >>>>>>>>>>>>>> - HADOOP-14922
> > >>>>>>>>>>>>>> - HADOOP-15939
> > >>>>>>>>>>>>>> - HADOOP-17569
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> In addition, there are some patches that don't have
> JIRA
> > >>> issue
> > >>>>>>>>> ID.
> > >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > >>>>>>>>>>>>>> -
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>
> > >>>>
> > >>>
> > >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> <
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> Thanks and regards,
> > >>>>>>>>>>>>>> Akira
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making
> hadoop-3.2.3
> > >>>>>>>>> release
> > >>>>>>>>>>> happen.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> > >> latest
> > >>>>>>>>> release
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>>> trunk branch).
> > >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in
> touch
> > >> with
> > >>>>>>>>> Chao
> > >>>>>>>>>>>>>> already).
> > >>>>>>>>>>>>>>> once RC is out.
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> Thanks and Regards,
> > >>>>>>>>>>>>>>> - He Xiaoqiao
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy
> Battula <
> > >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> > >>>>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Hi All,
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release.
> Please
> > >>>> commit
> > >>>>>>>>> to
> > >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need
> to go.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> *This time I am thinking of having downstream
> projects
> > >> and
> > >>>>>>>>>>> companies'
> > >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> - Planning to check with downstream projects
> like
> > >>>>>>>>> Spark,HBase
> > >>>>>>>>>>> and
> > >>>>>>>>>>>>>> Hive
> > >>>>>>>>>>>>>>>> if they can help on validation(Or running
> their UT
> > >> on
> > >>>> this
> > >>>>>>>>>>> branch)
> > >>>>>>>>>>>>>>>> - Collecting info from Companies who are
> already
> > >>>> deployed
> > >>>>>>>>> and
> > >>>>>>>>>>> using
> > >>>>>>>>>>>>>> the
> > >>>>>>>>>>>>>>>> branch-3.2
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2
> (so
> > >> that
> > >>>>>>>>> features
> > >>>>>>>>>>>>>> released
> > >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me
> know
> > >>>>>>>>> anybody from
> > >>>>>>>>>>>>>> these
> > >>>>>>>>>>>>>>>> communities who can help on this.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any
> suggestions
> > >>> are
> > >>>>>>>>>>> welcome.
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>>>>>>>
> > >>>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>
> > >>>
> ---------------------------------------------------------------------
> > >>>>>>>>>>>> To unsubscribe, e-mail:
> > >>>> common-dev-unsubscribe@hadoop.apache.org <mailto:
> common-dev-unsubscribe@hadoop.apache.org>
> > >>>>>>>>>>>> For additional commands, e-mail:
> > >>>>>>>>> common-dev-help@hadoop.apache.org <mailto:
> common-dev-help@hadoop.apache.org>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --Brahma Reddy Battula
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>
> > >>>>>> --
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> --Brahma Reddy Battula
> > >>>>>>
> > >>>>>
> > >>>>
> > >>> --
> > >>>
> > >>>
> > >>>
> > >>> --Brahma Reddy Battula
> > >>>
> > >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> <ma...@hadoop.apache.org>
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> <ma...@hadoop.apache.org>
> >
>
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
I'm going to cut RC0 on behalf of Brahma on this weekend.
There looks no blocker/critical issues on JIRA.
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
branch-3.2.3 was cut and version was set by Brahma.
https://github.com/apache/hadoop/tree/branch-3.2.3
I found some TODOs to cut RC from branch-3.2.3.
* Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
https://issues.apache.org/jira/browse/HADOOP-17718
* Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
https://issues.apache.org/jira/browse/HADOOP-18125
While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
https://issues.apache.org/jira/browse/HADOOP-18088
Thanks,
Masatake Iwasaki
On 2022/03/10 12:23, Xiaoqiao He wrote:
> Thanks Masatake for reaching out.
>
> Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> Thanks again.
>
> Regards
> - He Xiaoqiao
>
> On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org>> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org>>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org <ma...@apache.org>
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>> and @Masatake Iwasaki
> >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
I'm going to cut RC0 on behalf of Brahma on this weekend.
There looks no blocker/critical issues on JIRA.
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
branch-3.2.3 was cut and version was set by Brahma.
https://github.com/apache/hadoop/tree/branch-3.2.3
I found some TODOs to cut RC from branch-3.2.3.
* Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
https://issues.apache.org/jira/browse/HADOOP-17718
* Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
https://issues.apache.org/jira/browse/HADOOP-18125
While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
https://issues.apache.org/jira/browse/HADOOP-18088
Thanks,
Masatake Iwasaki
On 2022/03/10 12:23, Xiaoqiao He wrote:
> Thanks Masatake for reaching out.
>
> Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> Thanks again.
>
> Regards
> - He Xiaoqiao
>
> On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org>> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org>>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org <ma...@apache.org>
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>> and @Masatake Iwasaki
> >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
I'm going to cut RC0 on behalf of Brahma on this weekend.
There looks no blocker/critical issues on JIRA.
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
branch-3.2.3 was cut and version was set by Brahma.
https://github.com/apache/hadoop/tree/branch-3.2.3
I found some TODOs to cut RC from branch-3.2.3.
* Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
https://issues.apache.org/jira/browse/HADOOP-17718
* Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
https://issues.apache.org/jira/browse/HADOOP-18125
While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
https://issues.apache.org/jira/browse/HADOOP-18088
Thanks,
Masatake Iwasaki
On 2022/03/10 12:23, Xiaoqiao He wrote:
> Thanks Masatake for reaching out.
>
> Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> Thanks again.
>
> Regards
> - He Xiaoqiao
>
> On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org>> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org>>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org <ma...@apache.org>
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>> and @Masatake Iwasaki
> >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
I'm going to cut RC0 on behalf of Brahma on this weekend.
There looks no blocker/critical issues on JIRA.
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.2+Release
branch-3.2.3 was cut and version was set by Brahma.
https://github.com/apache/hadoop/tree/branch-3.2.3
I found some TODOs to cut RC from branch-3.2.3.
* Cherry-picking HADOOP-17718 to branch-3.2 to fix error on running create-release script.
https://issues.apache.org/jira/browse/HADOOP-17718
* Checking git commit / Jira fixVersion discrepancies by script added by HADOOP-18125.
https://issues.apache.org/jira/browse/HADOOP-18125
While HADOOP-18088 is targeted to 3.2.3, I think we can release 3.2.3 without this.
We can release 3.2.4 right after 3.2.3 just for reload4j migration if we need.
https://issues.apache.org/jira/browse/HADOOP-18088
Thanks,
Masatake Iwasaki
On 2022/03/10 12:23, Xiaoqiao He wrote:
> Thanks Masatake for reaching out.
>
> Not sure if Brahma has bandwidth to push this release forward. If there is no more bandwidth, I think we should involve other volunteers to make it happen.
> Or Masatake, are you interested in continuing the 3.2.3 release? I would like to offer some bandwidth if need any help.
> Thanks again.
>
> Regards
> - He Xiaoqiao
>
> On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605 <https://issues.apache.org/jira/browse/BIGTOP-3605>
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <weichiu@apache.org <ma...@apache.org>> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <brahma@apache.org <ma...@apache.org>>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org <ma...@apache.org>
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2009@gmail.com <ma...@gmail.com>>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160 <https://issues.apache.org/jira/browse/HDFS-15160>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aajisaka@apache.org <ma...@apache.org>> and @Masatake Iwasaki
> >>>>>>>>>> <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org <ma...@apache.org>>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop <https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff>
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff <https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org <ma...@apache.org>>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: common-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for reaching out.
Not sure if Brahma has bandwidth to push this release forward. If there is
no more bandwidth, I think we should involve other volunteers to make
it happen.
Or Masatake, are you interested in continuing the 3.2.3 release? I would
like to offer some bandwidth if need any help.
Thanks again.
Regards
- He Xiaoqiao
On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>>>>>>> <iw...@oss.nttdata.co.jp>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for reaching out.
Not sure if Brahma has bandwidth to push this release forward. If there is
no more bandwidth, I think we should involve other volunteers to make
it happen.
Or Masatake, are you interested in continuing the 3.2.3 release? I would
like to offer some bandwidth if need any help.
Thanks again.
Regards
- He Xiaoqiao
On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>>>>>>> <iw...@oss.nttdata.co.jp>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for reaching out.
Not sure if Brahma has bandwidth to push this release forward. If there is
no more bandwidth, I think we should involve other volunteers to make
it happen.
Or Masatake, are you interested in continuing the 3.2.3 release? I would
like to offer some bandwidth if need any help.
Thanks again.
Regards
- He Xiaoqiao
On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>>>>>>> <iw...@oss.nttdata.co.jp>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Masatake for reaching out.
Not sure if Brahma has bandwidth to push this release forward. If there is
no more bandwidth, I think we should involve other volunteers to make
it happen.
Or Masatake, are you interested in continuing the 3.2.3 release? I would
like to offer some bandwidth if need any help.
Thanks again.
Regards
- He Xiaoqiao
On Thu, Mar 3, 2022 at 10:11 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi Brahma,
>
> I would like to use 3.2.3 for next minor release of Bigtop.
> https://issues.apache.org/jira/browse/BIGTOP-3605
>
> Let me know if there is any blocker I can help.
>
> Thanks,
> Masatake Iwasaki
>
> On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> > Sorry, I was looking for some CVE’s fixes.will make it progress on this…
> >
> >
> > On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org>
> wrote:
> >
> >> Is this still making progress?
> >>
> >> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> >> wrote:
> >>
> >>> Hi Akira,
> >>>
> >>> Thanks for your email!!
> >>>
> >>> I am evaluating the CVE’s which needs to go for this release..
> >>>
> >>> Will update soon!!
> >>>
> >>>
> >>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >>>
> >>>> Hi Brahma,
> >>>>
> >>>> What is the release process going on? Is there any blocker for the RC?
> >>>>
> >>>> -Akira
> >>>>
> >>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> >> wrote:
> >>>>
> >>>>> Hi Brahma,
> >>>>>
> >>>>> The feature 'BPServiceActor processes commands from NameNode
> >>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> >>>> While
> >>>>> cherry-picking there is only minor conflict, So I checked in
> >> directly.
> >>>> BTW,
> >>>>> run some unit tests and build pseudo cluster to verify, it seems to
> >>> work
> >>>>> fine.
> >>>>> FYI.
> >>>>>
> >>>>> Regards,
> >>>>> - He Xiaoqiao
> >>>>>
> >>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> >>> brahma@apache.org
> >>>>>
> >>>>> wrote:
> >>>>>
> >>>>>> Please go ahead. Let me know any help required on review.
> >>>>>>
> >>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>
> >>>>>>> Hi Brahma,
> >>>>>>>
> >>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>>>>>> resolved the conflict and verified them locally.
> >>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>>>>>> I would like to hear some more response that if we have enough time
> >>> to
> >>>>>>> wait for it to be ready.
> >>>>>>> Thanks.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> - He Xiaoqiao
> >>>>>>>
> >>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> >>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> >> FYI.
> >>>>>>>>
> >>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> >>>> brahma@apache.org>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>>> Hi All,
> >>>>>>>>>
> >>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> >>>> this
> >>>>>>>>> can
> >>>>>>>>> be done by this week,then I will try to create the RC next if
> >> there
> >>>> is
> >>>>>>>>> no
> >>>>>>>>> objection.
> >>>>>>>>>
> >>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>>>>>> brahma@apache.org>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>>>>>>> <iw...@oss.nttdata.co.jp>
> >>>>>>>>>> Looks all are build related issues when you try with bigtop. We
> >>> can
> >>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
> >>>>>>>>>>
> >>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
> >>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>
> >>>>>>>>>>> I filed HADOOP-17849 for this.
> >>>>>>>>>>>
> >>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
> >>>>>>>>> background.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
> >>>>>>>>> zooekeper-3.4.13,
> >>>>>>>>>>>> while it would be harmless to add the exclusion even for
> >>>>>>>>>>> zooekeeper-3.4.13.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> These are relevant to directory structure used by Bigtop
> >>>> package.
> >>>>>>>>>>>> If the fix does not break the tarball dist,
> >>>>>>>>>>>> it would be nice to have these on Hadoop too.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> -
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>
> >>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
> >> YARN-UI2
> >>>> on
> >>>>>>>>>>> packaging.
> >>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>>>>>>>>>> Thanks, I'll check them out.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>>>>>> aajisaka@apache.org>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>>>>>> 3.2.2.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In these patches, how about backporting the following
> >> issues
> >>>> to
> >>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
> >>>>>>>>>>>>>> - HADOOP-14922
> >>>>>>>>>>>>>> - HADOOP-15939
> >>>>>>>>>>>>>> - HADOOP-17569
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
> >>> issue
> >>>>>>>>> ID.
> >>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>>>>>>>>>>> -
> >>>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>
> >>>>
> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Thanks and regards,
> >>>>>>>>>>>>>> Akira
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>>>>>> hexiaoqiao@apache.org>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>>>>>> release
> >>>>>>>>>>> happen.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I would like to validate the HBase project (both the
> >> latest
> >>>>>>>>> release
> >>>>>>>>>>> and
> >>>>>>>>>>>>>>> trunk branch).
> >>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
> >> with
> >>>>>>>>> Chao
> >>>>>>>>>>>>>> already).
> >>>>>>>>>>>>>>> once RC is out.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Thanks and Regards,
> >>>>>>>>>>>>>>> - He Xiaoqiao
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>>>>>>>> brahma@apache.org>
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Hi All,
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
> >>>> commit
> >>>>>>>>> to
> >>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
> >> and
> >>>>>>>>>>> companies'
> >>>>>>>>>>>>>>>> voices,let's know how this can go. *
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> - Planning to check with downstream projects like
> >>>>>>>>> Spark,HBase
> >>>>>>>>>>> and
> >>>>>>>>>>>>>> Hive
> >>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
> >> on
> >>>> this
> >>>>>>>>>>> branch)
> >>>>>>>>>>>>>>>> - Collecting info from Companies who are already
> >>>> deployed
> >>>>>>>>> and
> >>>>>>>>>>> using
> >>>>>>>>>>>>>> the
> >>>>>>>>>>>>>>>> branch-3.2
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
> >> that
> >>>>>>>>> features
> >>>>>>>>>>>>>> released
> >>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
> >>>>>>>>> anybody from
> >>>>>>>>>>>>>> these
> >>>>>>>>>>>>>>>> communities who can help on this.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
> >>> are
> >>>>>>>>>>> welcome.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>
> >>> ---------------------------------------------------------------------
> >>>>>>>>>>>> To unsubscribe, e-mail:
> >>>> common-dev-unsubscribe@hadoop.apache.org
> >>>>>>>>>>>> For additional commands, e-mail:
> >>>>>>>>> common-dev-help@hadoop.apache.org
> >>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --Brahma Reddy Battula
> >>>>>>>>>
> >>>>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --Brahma Reddy Battula
> >>>>>>
> >>>>>
> >>>>
> >>> --
> >>>
> >>>
> >>>
> >>> --Brahma Reddy Battula
> >>>
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hi Brahma,
I would like to use 3.2.3 for next minor release of Bigtop.
https://issues.apache.org/jira/browse/BIGTOP-3605
Let me know if there is any blocker I can help.
Thanks,
Masatake Iwasaki
On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> Sorry, I was looking for some CVE’s fixes.will make it progress on this…
>
>
> On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> Is this still making progress?
>>
>> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi Akira,
>>>
>>> Thanks for your email!!
>>>
>>> I am evaluating the CVE’s which needs to go for this release..
>>>
>>> Will update soon!!
>>>
>>>
>>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>>>
>>>> Hi Brahma,
>>>>
>>>> What is the release process going on? Is there any blocker for the RC?
>>>>
>>>> -Akira
>>>>
>>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
>> wrote:
>>>>
>>>>> Hi Brahma,
>>>>>
>>>>> The feature 'BPServiceActor processes commands from NameNode
>>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
>>>> While
>>>>> cherry-picking there is only minor conflict, So I checked in
>> directly.
>>>> BTW,
>>>>> run some unit tests and build pseudo cluster to verify, it seems to
>>> work
>>>>> fine.
>>>>> FYI.
>>>>>
>>>>> Regards,
>>>>> - He Xiaoqiao
>>>>>
>>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
>>> brahma@apache.org
>>>>>
>>>>> wrote:
>>>>>
>>>>>> Please go ahead. Let me know any help required on review.
>>>>>>
>>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>
>>>>>>> Hi Brahma,
>>>>>>>
>>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>>>>>> resolved the conflict and verified them locally.
>>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>>>>>> I would like to hear some more response that if we have enough time
>>> to
>>>>>>> wait for it to be ready.
>>>>>>> Thanks.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> - He Xiaoqiao
>>>>>>>
>>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
>> FYI.
>>>>>>>>
>>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
>>>> brahma@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
>>>> this
>>>>>>>>> can
>>>>>>>>> be done by this week,then I will try to create the RC next if
>> there
>>>> is
>>>>>>>>> no
>>>>>>>>> objection.
>>>>>>>>>
>>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>>>>>> brahma@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>>>>>>> <iw...@oss.nttdata.co.jp>
>>>>>>>>>> Looks all are build related issues when you try with bigtop. We
>>> can
>>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
>>>>>>>>>>
>>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>
>>>>>>>>>>> I filed HADOOP-17849 for this.
>>>>>>>>>>>
>>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
>>>>>>>>> background.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>
>>>>>>>>>>>> These are relevant to directory structure used by Bigtop
>>>> package.
>>>>>>>>>>>> If the fix does not break the tarball dist,
>>>>>>>>>>>> it would be nice to have these on Hadoop too.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
>>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
>> YARN-UI2
>>>> on
>>>>>>>>>>> packaging.
>>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>>>>>>>>>> Thanks, I'll check them out.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>>>>>> aajisaka@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>>>>>> 3.2.2.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In these patches, how about backporting the following
>> issues
>>>> to
>>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
>>>>>>>>>>>>>> - HADOOP-14922
>>>>>>>>>>>>>> - HADOOP-15939
>>>>>>>>>>>>>> - HADOOP-17569
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
>>> issue
>>>>>>>>> ID.
>>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks and regards,
>>>>>>>>>>>>>> Akira
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>>>>>> hexiaoqiao@apache.org>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>>>>>> release
>>>>>>>>>>> happen.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I would like to validate the HBase project (both the
>> latest
>>>>>>>>> release
>>>>>>>>>>> and
>>>>>>>>>>>>>>> trunk branch).
>>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
>> with
>>>>>>>>> Chao
>>>>>>>>>>>>>> already).
>>>>>>>>>>>>>>> once RC is out.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks and Regards,
>>>>>>>>>>>>>>> - He Xiaoqiao
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>>>>>>>> brahma@apache.org>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
>>>> commit
>>>>>>>>> to
>>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
>> and
>>>>>>>>>>> companies'
>>>>>>>>>>>>>>>> voices,let's know how this can go. *
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Planning to check with downstream projects like
>>>>>>>>> Spark,HBase
>>>>>>>>>>> and
>>>>>>>>>>>>>> Hive
>>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
>> on
>>>> this
>>>>>>>>>>> branch)
>>>>>>>>>>>>>>>> - Collecting info from Companies who are already
>>>> deployed
>>>>>>>>> and
>>>>>>>>>>> using
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> branch-3.2
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
>> that
>>>>>>>>> features
>>>>>>>>>>>>>> released
>>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
>>>>>>>>> anybody from
>>>>>>>>>>>>>> these
>>>>>>>>>>>>>>>> communities who can help on this.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
>>> are
>>>>>>>>>>> welcome.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>
>>> ---------------------------------------------------------------------
>>>>>>>>>>>> To unsubscribe, e-mail:
>>>> common-dev-unsubscribe@hadoop.apache.org
>>>>>>>>>>>> For additional commands, e-mail:
>>>>>>>>> common-dev-help@hadoop.apache.org
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> --Brahma Reddy Battula
>>>>>>
>>>>>
>>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hi Brahma,
I would like to use 3.2.3 for next minor release of Bigtop.
https://issues.apache.org/jira/browse/BIGTOP-3605
Let me know if there is any blocker I can help.
Thanks,
Masatake Iwasaki
On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> Sorry, I was looking for some CVE’s fixes.will make it progress on this…
>
>
> On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> Is this still making progress?
>>
>> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi Akira,
>>>
>>> Thanks for your email!!
>>>
>>> I am evaluating the CVE’s which needs to go for this release..
>>>
>>> Will update soon!!
>>>
>>>
>>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>>>
>>>> Hi Brahma,
>>>>
>>>> What is the release process going on? Is there any blocker for the RC?
>>>>
>>>> -Akira
>>>>
>>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
>> wrote:
>>>>
>>>>> Hi Brahma,
>>>>>
>>>>> The feature 'BPServiceActor processes commands from NameNode
>>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
>>>> While
>>>>> cherry-picking there is only minor conflict, So I checked in
>> directly.
>>>> BTW,
>>>>> run some unit tests and build pseudo cluster to verify, it seems to
>>> work
>>>>> fine.
>>>>> FYI.
>>>>>
>>>>> Regards,
>>>>> - He Xiaoqiao
>>>>>
>>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
>>> brahma@apache.org
>>>>>
>>>>> wrote:
>>>>>
>>>>>> Please go ahead. Let me know any help required on review.
>>>>>>
>>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>
>>>>>>> Hi Brahma,
>>>>>>>
>>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>>>>>> resolved the conflict and verified them locally.
>>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>>>>>> I would like to hear some more response that if we have enough time
>>> to
>>>>>>> wait for it to be ready.
>>>>>>> Thanks.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> - He Xiaoqiao
>>>>>>>
>>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
>> FYI.
>>>>>>>>
>>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
>>>> brahma@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
>>>> this
>>>>>>>>> can
>>>>>>>>> be done by this week,then I will try to create the RC next if
>> there
>>>> is
>>>>>>>>> no
>>>>>>>>> objection.
>>>>>>>>>
>>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>>>>>> brahma@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>>>>>>> <iw...@oss.nttdata.co.jp>
>>>>>>>>>> Looks all are build related issues when you try with bigtop. We
>>> can
>>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
>>>>>>>>>>
>>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>
>>>>>>>>>>> I filed HADOOP-17849 for this.
>>>>>>>>>>>
>>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
>>>>>>>>> background.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>
>>>>>>>>>>>> These are relevant to directory structure used by Bigtop
>>>> package.
>>>>>>>>>>>> If the fix does not break the tarball dist,
>>>>>>>>>>>> it would be nice to have these on Hadoop too.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
>>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
>> YARN-UI2
>>>> on
>>>>>>>>>>> packaging.
>>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>>>>>>>>>> Thanks, I'll check them out.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>>>>>> aajisaka@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>>>>>> 3.2.2.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In these patches, how about backporting the following
>> issues
>>>> to
>>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
>>>>>>>>>>>>>> - HADOOP-14922
>>>>>>>>>>>>>> - HADOOP-15939
>>>>>>>>>>>>>> - HADOOP-17569
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
>>> issue
>>>>>>>>> ID.
>>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks and regards,
>>>>>>>>>>>>>> Akira
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>>>>>> hexiaoqiao@apache.org>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>>>>>> release
>>>>>>>>>>> happen.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I would like to validate the HBase project (both the
>> latest
>>>>>>>>> release
>>>>>>>>>>> and
>>>>>>>>>>>>>>> trunk branch).
>>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
>> with
>>>>>>>>> Chao
>>>>>>>>>>>>>> already).
>>>>>>>>>>>>>>> once RC is out.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks and Regards,
>>>>>>>>>>>>>>> - He Xiaoqiao
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>>>>>>>> brahma@apache.org>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
>>>> commit
>>>>>>>>> to
>>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
>> and
>>>>>>>>>>> companies'
>>>>>>>>>>>>>>>> voices,let's know how this can go. *
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Planning to check with downstream projects like
>>>>>>>>> Spark,HBase
>>>>>>>>>>> and
>>>>>>>>>>>>>> Hive
>>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
>> on
>>>> this
>>>>>>>>>>> branch)
>>>>>>>>>>>>>>>> - Collecting info from Companies who are already
>>>> deployed
>>>>>>>>> and
>>>>>>>>>>> using
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> branch-3.2
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
>> that
>>>>>>>>> features
>>>>>>>>>>>>>> released
>>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
>>>>>>>>> anybody from
>>>>>>>>>>>>>> these
>>>>>>>>>>>>>>>> communities who can help on this.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
>>> are
>>>>>>>>>>> welcome.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>
>>> ---------------------------------------------------------------------
>>>>>>>>>>>> To unsubscribe, e-mail:
>>>> common-dev-unsubscribe@hadoop.apache.org
>>>>>>>>>>>> For additional commands, e-mail:
>>>>>>>>> common-dev-help@hadoop.apache.org
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> --Brahma Reddy Battula
>>>>>>
>>>>>
>>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hi Brahma,
I would like to use 3.2.3 for next minor release of Bigtop.
https://issues.apache.org/jira/browse/BIGTOP-3605
Let me know if there is any blocker I can help.
Thanks,
Masatake Iwasaki
On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> Sorry, I was looking for some CVE’s fixes.will make it progress on this…
>
>
> On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> Is this still making progress?
>>
>> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi Akira,
>>>
>>> Thanks for your email!!
>>>
>>> I am evaluating the CVE’s which needs to go for this release..
>>>
>>> Will update soon!!
>>>
>>>
>>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>>>
>>>> Hi Brahma,
>>>>
>>>> What is the release process going on? Is there any blocker for the RC?
>>>>
>>>> -Akira
>>>>
>>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
>> wrote:
>>>>
>>>>> Hi Brahma,
>>>>>
>>>>> The feature 'BPServiceActor processes commands from NameNode
>>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
>>>> While
>>>>> cherry-picking there is only minor conflict, So I checked in
>> directly.
>>>> BTW,
>>>>> run some unit tests and build pseudo cluster to verify, it seems to
>>> work
>>>>> fine.
>>>>> FYI.
>>>>>
>>>>> Regards,
>>>>> - He Xiaoqiao
>>>>>
>>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
>>> brahma@apache.org
>>>>>
>>>>> wrote:
>>>>>
>>>>>> Please go ahead. Let me know any help required on review.
>>>>>>
>>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>
>>>>>>> Hi Brahma,
>>>>>>>
>>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>>>>>> resolved the conflict and verified them locally.
>>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>>>>>> I would like to hear some more response that if we have enough time
>>> to
>>>>>>> wait for it to be ready.
>>>>>>> Thanks.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> - He Xiaoqiao
>>>>>>>
>>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
>> FYI.
>>>>>>>>
>>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
>>>> brahma@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
>>>> this
>>>>>>>>> can
>>>>>>>>> be done by this week,then I will try to create the RC next if
>> there
>>>> is
>>>>>>>>> no
>>>>>>>>> objection.
>>>>>>>>>
>>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>>>>>> brahma@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>>>>>>> <iw...@oss.nttdata.co.jp>
>>>>>>>>>> Looks all are build related issues when you try with bigtop. We
>>> can
>>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
>>>>>>>>>>
>>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>
>>>>>>>>>>> I filed HADOOP-17849 for this.
>>>>>>>>>>>
>>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
>>>>>>>>> background.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>
>>>>>>>>>>>> These are relevant to directory structure used by Bigtop
>>>> package.
>>>>>>>>>>>> If the fix does not break the tarball dist,
>>>>>>>>>>>> it would be nice to have these on Hadoop too.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
>>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
>> YARN-UI2
>>>> on
>>>>>>>>>>> packaging.
>>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>>>>>>>>>> Thanks, I'll check them out.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>>>>>> aajisaka@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>>>>>> 3.2.2.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In these patches, how about backporting the following
>> issues
>>>> to
>>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
>>>>>>>>>>>>>> - HADOOP-14922
>>>>>>>>>>>>>> - HADOOP-15939
>>>>>>>>>>>>>> - HADOOP-17569
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
>>> issue
>>>>>>>>> ID.
>>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks and regards,
>>>>>>>>>>>>>> Akira
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>>>>>> hexiaoqiao@apache.org>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>>>>>> release
>>>>>>>>>>> happen.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I would like to validate the HBase project (both the
>> latest
>>>>>>>>> release
>>>>>>>>>>> and
>>>>>>>>>>>>>>> trunk branch).
>>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
>> with
>>>>>>>>> Chao
>>>>>>>>>>>>>> already).
>>>>>>>>>>>>>>> once RC is out.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks and Regards,
>>>>>>>>>>>>>>> - He Xiaoqiao
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>>>>>>>> brahma@apache.org>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
>>>> commit
>>>>>>>>> to
>>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
>> and
>>>>>>>>>>> companies'
>>>>>>>>>>>>>>>> voices,let's know how this can go. *
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Planning to check with downstream projects like
>>>>>>>>> Spark,HBase
>>>>>>>>>>> and
>>>>>>>>>>>>>> Hive
>>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
>> on
>>>> this
>>>>>>>>>>> branch)
>>>>>>>>>>>>>>>> - Collecting info from Companies who are already
>>>> deployed
>>>>>>>>> and
>>>>>>>>>>> using
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> branch-3.2
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
>> that
>>>>>>>>> features
>>>>>>>>>>>>>> released
>>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
>>>>>>>>> anybody from
>>>>>>>>>>>>>> these
>>>>>>>>>>>>>>>> communities who can help on this.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
>>> are
>>>>>>>>>>> welcome.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>
>>> ---------------------------------------------------------------------
>>>>>>>>>>>> To unsubscribe, e-mail:
>>>> common-dev-unsubscribe@hadoop.apache.org
>>>>>>>>>>>> For additional commands, e-mail:
>>>>>>>>> common-dev-help@hadoop.apache.org
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> --Brahma Reddy Battula
>>>>>>
>>>>>
>>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hi Brahma,
I would like to use 3.2.3 for next minor release of Bigtop.
https://issues.apache.org/jira/browse/BIGTOP-3605
Let me know if there is any blocker I can help.
Thanks,
Masatake Iwasaki
On 2022/01/12 4:41, Brahma Reddy Battula wrote:
> Sorry, I was looking for some CVE’s fixes.will make it progress on this…
>
>
> On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
>
>> Is this still making progress?
>>
>> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi Akira,
>>>
>>> Thanks for your email!!
>>>
>>> I am evaluating the CVE’s which needs to go for this release..
>>>
>>> Will update soon!!
>>>
>>>
>>> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>>>
>>>> Hi Brahma,
>>>>
>>>> What is the release process going on? Is there any blocker for the RC?
>>>>
>>>> -Akira
>>>>
>>>> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
>> wrote:
>>>>
>>>>> Hi Brahma,
>>>>>
>>>>> The feature 'BPServiceActor processes commands from NameNode
>>>>> asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
>>>> While
>>>>> cherry-picking there is only minor conflict, So I checked in
>> directly.
>>>> BTW,
>>>>> run some unit tests and build pseudo cluster to verify, it seems to
>>> work
>>>>> fine.
>>>>> FYI.
>>>>>
>>>>> Regards,
>>>>> - He Xiaoqiao
>>>>>
>>>>> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
>>> brahma@apache.org
>>>>>
>>>>> wrote:
>>>>>
>>>>>> Please go ahead. Let me know any help required on review.
>>>>>>
>>>>>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>
>>>>>>> Hi Brahma,
>>>>>>>
>>>>>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>>>>>> resolved the conflict and verified them locally.
>>>>>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>>>>>> I would like to hear some more response that if we have enough time
>>> to
>>>>>>> wait for it to be ready.
>>>>>>> Thanks.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> - He Xiaoqiao
>>>>>>>
>>>>>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
>>>> wrote:
>>>>>>>
>>>>>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
>> FYI.
>>>>>>>>
>>>>>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
>>>> brahma@apache.org>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi All,
>>>>>>>>>
>>>>>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
>>>> this
>>>>>>>>> can
>>>>>>>>> be done by this week,then I will try to create the RC next if
>> there
>>>> is
>>>>>>>>> no
>>>>>>>>> objection.
>>>>>>>>>
>>>>>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>>>>>> brahma@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>>>>>>> <iw...@oss.nttdata.co.jp>
>>>>>>>>>> Looks all are build related issues when you try with bigtop. We
>>> can
>>>>>>>>>> discuss and prioritize this.. Will connect with you guys.
>>>>>>>>>>
>>>>>>>>>> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>>>>>>> iwasakims@oss.nttdata.co.jp> wrote:
>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>
>>>>>>>>>>> I filed HADOOP-17849 for this.
>>>>>>>>>>>
>>>>>>>>>>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>>>>>>>>> Thanks for bringing this up, Akira. Let me explain some
>>>>>>>>> background.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>>>>>>>>> we do not see the issue usually since branch-3.2 uses
>>>>>>>>> zooekeper-3.4.13,
>>>>>>>>>>>> while it would be harmless to add the exclusion even for
>>>>>>>>>>> zooekeeper-3.4.13.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>
>>>>>>>>>>>> These are relevant to directory structure used by Bigtop
>>>> package.
>>>>>>>>>>>> If the fix does not break the tarball dist,
>>>>>>>>>>>> it would be nice to have these on Hadoop too.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> -
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>
>>>>>>>>>>>> This is for aarch64 and ppe64le lacking required phantomjs.
>>>>>>>>>>>> It is only acceptable for Bigtop not running tests of
>> YARN-UI2
>>>> on
>>>>>>>>>>> packaging.
>>>>>>>>>>>> Hadoop needs the phantomjs for testing YARN-UI2.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>>>>>>>>>> Thanks, I'll check them out.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>>>>>> aajisaka@apache.org>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks Brahma for cutting branch-3.2.3.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>>>>>> 3.2.2.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In these patches, how about backporting the following
>> issues
>>>> to
>>>>>>>>>>>>>> branch-3.2 and branch-3.2.3?
>>>>>>>>>>>>>> - HADOOP-14922
>>>>>>>>>>>>>> - HADOOP-15939
>>>>>>>>>>>>>> - HADOOP-17569
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In addition, there are some patches that don't have JIRA
>>> issue
>>>>>>>>> ID.
>>>>>>>>>>>>>> Maybe we need to create JIRAs and fix those.
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>
>>>>
>>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks and regards,
>>>>>>>>>>>>>> Akira
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>>>>>> hexiaoqiao@apache.org>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>>>>>> release
>>>>>>>>>>> happen.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I would like to validate the HBase project (both the
>> latest
>>>>>>>>> release
>>>>>>>>>>> and
>>>>>>>>>>>>>>> trunk branch).
>>>>>>>>>>>>>>> Chao Sun will validate the Spark Project (Got in touch
>> with
>>>>>>>>> Chao
>>>>>>>>>>>>>> already).
>>>>>>>>>>>>>>> once RC is out.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks and Regards,
>>>>>>>>>>>>>>> - He Xiaoqiao
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>>>>>>>> brahma@apache.org>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I cut branch-3.2.3 and it is ready for release. Please
>>>> commit
>>>>>>>>> to
>>>>>>>>>>>>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> *This time I am thinking of having downstream projects
>> and
>>>>>>>>>>> companies'
>>>>>>>>>>>>>>>> voices,let's know how this can go. *
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> - Planning to check with downstream projects like
>>>>>>>>> Spark,HBase
>>>>>>>>>>> and
>>>>>>>>>>>>>> Hive
>>>>>>>>>>>>>>>> if they can help on validation(Or running their UT
>> on
>>>> this
>>>>>>>>>>> branch)
>>>>>>>>>>>>>>>> - Collecting info from Companies who are already
>>>> deployed
>>>>>>>>> and
>>>>>>>>>>> using
>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> branch-3.2
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> so that we can make a more stable release on 3.2 (so
>> that
>>>>>>>>> features
>>>>>>>>>>>>>> released
>>>>>>>>>>>>>>>> on this branch impact can be known) ,please let me know
>>>>>>>>> anybody from
>>>>>>>>>>>>>> these
>>>>>>>>>>>>>>>> communities who can help on this.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Planning to create RC by this month end. Any suggestions
>>> are
>>>>>>>>>>> welcome.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>
>>> ---------------------------------------------------------------------
>>>>>>>>>>>> To unsubscribe, e-mail:
>>>> common-dev-unsubscribe@hadoop.apache.org
>>>>>>>>>>>> For additional commands, e-mail:
>>>>>>>>> common-dev-help@hadoop.apache.org
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --Brahma Reddy Battula
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>>
>>>>>>
>>>>>> --Brahma Reddy Battula
>>>>>>
>>>>>
>>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Sorry, I was looking for some CVE’s fixes.will make it progress on this…
On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
> Is this still making progress?
>
> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi Akira,
> >
> > Thanks for your email!!
> >
> > I am evaluating the CVE’s which needs to go for this release..
> >
> > Will update soon!!
> >
> >
> > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >
> > > Hi Brahma,
> > >
> > > What is the release process going on? Is there any blocker for the RC?
> > >
> > > -Akira
> > >
> > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> > >
> > > > Hi Brahma,
> > > >
> > > > The feature 'BPServiceActor processes commands from NameNode
> > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > > While
> > > > cherry-picking there is only minor conflict, So I checked in
> directly.
> > > BTW,
> > > > run some unit tests and build pseudo cluster to verify, it seems to
> > work
> > > > fine.
> > > > FYI.
> > > >
> > > > Regards,
> > > > - He Xiaoqiao
> > > >
> > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > brahma@apache.org
> > > >
> > > > wrote:
> > > >
> > > >> Please go ahead. Let me know any help required on review.
> > > >>
> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>
> > > >>> Hi Brahma,
> > > >>>
> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > > >>> resolved the conflict and verified them locally.
> > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > > >>> I would like to hear some more response that if we have enough time
> > to
> > > >>> wait for it to be ready.
> > > >>> Thanks.
> > > >>>
> > > >>> Best Regards,
> > > >>> - He Xiaoqiao
> > > >>>
> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>>
> > > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> FYI.
> > > >>>>
> > > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > > brahma@apache.org>
> > > >>>> wrote:
> > > >>>>
> > > >>>>> Hi All,
> > > >>>>>
> > > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > > this
> > > >>>>> can
> > > >>>>> be done by this week,then I will try to create the RC next if
> there
> > > is
> > > >>>>> no
> > > >>>>> objection.
> > > >>>>>
> > > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > > >>>>> brahma@apache.org>
> > > >>>>> wrote:
> > > >>>>>
> > > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > > >>>>> > <iw...@oss.nttdata.co.jp>
> > > >>>>> > Looks all are build related issues when you try with bigtop. We
> > can
> > > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > > >>>>> >
> > > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > > >>>>> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >>
> > > >>>>> >> I filed HADOOP-17849 for this.
> > > >>>>> >>
> > > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > > >>>>> background.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >
> > > >>>>> >> > These are relevant to directory structure used by Bigtop
> > > package.
> > > >>>>> >> > If the fix does not break the tarball dist,
> > > >>>>> >> > it would be nice to have these on Hadoop too.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > > >>>>> >> > It is only acceptable for Bigtop not running tests of
> YARN-UI2
> > > on
> > > >>>>> >> packaging.
> > > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > > >>>>> >> >> Thanks, I'll check them out.
> > > >>>>> >> >>
> > > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > > >>>>> aajisaka@apache.org>
> > > >>>>> >> wrote:
> > > >>>>> >> >>
> > > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > > >>>>> >> >>>
> > > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > > >>>>> 3.2.2.
> > > >>>>> >> >>>
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > > >>>>> >> >>>
> > > >>>>> >> >>> In these patches, how about backporting the following
> issues
> > > to
> > > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > > >>>>> >> >>> - HADOOP-14922
> > > >>>>> >> >>> - HADOOP-15939
> > > >>>>> >> >>> - HADOOP-17569
> > > >>>>> >> >>>
> > > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> > issue
> > > >>>>> ID.
> > > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >>>
> > > >>>>> >> >>> Thanks and regards,
> > > >>>>> >> >>> Akira
> > > >>>>> >> >>>
> > > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > > >>>>> hexiaoqiao@apache.org>
> > > >>>>> >> >>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > > >>>>> release
> > > >>>>> >> happen.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> I would like to validate the HBase project (both the
> latest
> > > >>>>> release
> > > >>>>> >> and
> > > >>>>> >> >>>> trunk branch).
> > > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch
> with
> > > >>>>> Chao
> > > >>>>> >> >>> already).
> > > >>>>> >> >>>> once RC is out.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks and Regards,
> > > >>>>> >> >>>> - He Xiaoqiao
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > > >>>>> >> brahma@apache.org>
> > > >>>>> >> >>>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>> Hi All,
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > > commit
> > > >>>>> to
> > > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> *This time I am thinking of having downstream projects
> and
> > > >>>>> >> companies'
> > > >>>>> >> >>>>> voices,let's know how this can go. *
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> - Planning to check with downstream projects like
> > > >>>>> Spark,HBase
> > > >>>>> >> and
> > > >>>>> >> >>> Hive
> > > >>>>> >> >>>>> if they can help on validation(Or running their UT
> on
> > > this
> > > >>>>> >> branch)
> > > >>>>> >> >>>>> - Collecting info from Companies who are already
> > > deployed
> > > >>>>> and
> > > >>>>> >> using
> > > >>>>> >> >>> the
> > > >>>>> >> >>>>> branch-3.2
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so
> that
> > > >>>>> features
> > > >>>>> >> >>> released
> > > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > > >>>>> anybody from
> > > >>>>> >> >>> these
> > > >>>>> >> >>>>> communities who can help on this.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> > are
> > > >>>>> >> welcome.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> --Brahma Reddy Battula
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>>
> > ---------------------------------------------------------------------
> > > >>>>> >> > To unsubscribe, e-mail:
> > > common-dev-unsubscribe@hadoop.apache.org
> > > >>>>> >> > For additional commands, e-mail:
> > > >>>>> common-dev-help@hadoop.apache.org
> > > >>>>> >> >
> > > >>>>> >>
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --
> > > >>>>> >
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --Brahma Reddy Battula
> > > >>>>> >
> > > >>>>>
> > > >>>>>
> > > >>>>> --
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> --Brahma Reddy Battula
> > > >>>>>
> > > >>>>
> > > >>
> > > >> --
> > > >>
> > > >>
> > > >>
> > > >> --Brahma Reddy Battula
> > > >>
> > > >
> > >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Sorry, I was looking for some CVE’s fixes.will make it progress on this…
On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
> Is this still making progress?
>
> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi Akira,
> >
> > Thanks for your email!!
> >
> > I am evaluating the CVE’s which needs to go for this release..
> >
> > Will update soon!!
> >
> >
> > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >
> > > Hi Brahma,
> > >
> > > What is the release process going on? Is there any blocker for the RC?
> > >
> > > -Akira
> > >
> > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> > >
> > > > Hi Brahma,
> > > >
> > > > The feature 'BPServiceActor processes commands from NameNode
> > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > > While
> > > > cherry-picking there is only minor conflict, So I checked in
> directly.
> > > BTW,
> > > > run some unit tests and build pseudo cluster to verify, it seems to
> > work
> > > > fine.
> > > > FYI.
> > > >
> > > > Regards,
> > > > - He Xiaoqiao
> > > >
> > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > brahma@apache.org
> > > >
> > > > wrote:
> > > >
> > > >> Please go ahead. Let me know any help required on review.
> > > >>
> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>
> > > >>> Hi Brahma,
> > > >>>
> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > > >>> resolved the conflict and verified them locally.
> > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > > >>> I would like to hear some more response that if we have enough time
> > to
> > > >>> wait for it to be ready.
> > > >>> Thanks.
> > > >>>
> > > >>> Best Regards,
> > > >>> - He Xiaoqiao
> > > >>>
> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>>
> > > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> FYI.
> > > >>>>
> > > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > > brahma@apache.org>
> > > >>>> wrote:
> > > >>>>
> > > >>>>> Hi All,
> > > >>>>>
> > > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > > this
> > > >>>>> can
> > > >>>>> be done by this week,then I will try to create the RC next if
> there
> > > is
> > > >>>>> no
> > > >>>>> objection.
> > > >>>>>
> > > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > > >>>>> brahma@apache.org>
> > > >>>>> wrote:
> > > >>>>>
> > > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > > >>>>> > <iw...@oss.nttdata.co.jp>
> > > >>>>> > Looks all are build related issues when you try with bigtop. We
> > can
> > > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > > >>>>> >
> > > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > > >>>>> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >>
> > > >>>>> >> I filed HADOOP-17849 for this.
> > > >>>>> >>
> > > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > > >>>>> background.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >
> > > >>>>> >> > These are relevant to directory structure used by Bigtop
> > > package.
> > > >>>>> >> > If the fix does not break the tarball dist,
> > > >>>>> >> > it would be nice to have these on Hadoop too.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > > >>>>> >> > It is only acceptable for Bigtop not running tests of
> YARN-UI2
> > > on
> > > >>>>> >> packaging.
> > > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > > >>>>> >> >> Thanks, I'll check them out.
> > > >>>>> >> >>
> > > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > > >>>>> aajisaka@apache.org>
> > > >>>>> >> wrote:
> > > >>>>> >> >>
> > > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > > >>>>> >> >>>
> > > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > > >>>>> 3.2.2.
> > > >>>>> >> >>>
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > > >>>>> >> >>>
> > > >>>>> >> >>> In these patches, how about backporting the following
> issues
> > > to
> > > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > > >>>>> >> >>> - HADOOP-14922
> > > >>>>> >> >>> - HADOOP-15939
> > > >>>>> >> >>> - HADOOP-17569
> > > >>>>> >> >>>
> > > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> > issue
> > > >>>>> ID.
> > > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >>>
> > > >>>>> >> >>> Thanks and regards,
> > > >>>>> >> >>> Akira
> > > >>>>> >> >>>
> > > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > > >>>>> hexiaoqiao@apache.org>
> > > >>>>> >> >>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > > >>>>> release
> > > >>>>> >> happen.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> I would like to validate the HBase project (both the
> latest
> > > >>>>> release
> > > >>>>> >> and
> > > >>>>> >> >>>> trunk branch).
> > > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch
> with
> > > >>>>> Chao
> > > >>>>> >> >>> already).
> > > >>>>> >> >>>> once RC is out.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks and Regards,
> > > >>>>> >> >>>> - He Xiaoqiao
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > > >>>>> >> brahma@apache.org>
> > > >>>>> >> >>>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>> Hi All,
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > > commit
> > > >>>>> to
> > > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> *This time I am thinking of having downstream projects
> and
> > > >>>>> >> companies'
> > > >>>>> >> >>>>> voices,let's know how this can go. *
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> - Planning to check with downstream projects like
> > > >>>>> Spark,HBase
> > > >>>>> >> and
> > > >>>>> >> >>> Hive
> > > >>>>> >> >>>>> if they can help on validation(Or running their UT
> on
> > > this
> > > >>>>> >> branch)
> > > >>>>> >> >>>>> - Collecting info from Companies who are already
> > > deployed
> > > >>>>> and
> > > >>>>> >> using
> > > >>>>> >> >>> the
> > > >>>>> >> >>>>> branch-3.2
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so
> that
> > > >>>>> features
> > > >>>>> >> >>> released
> > > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > > >>>>> anybody from
> > > >>>>> >> >>> these
> > > >>>>> >> >>>>> communities who can help on this.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> > are
> > > >>>>> >> welcome.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> --Brahma Reddy Battula
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>>
> > ---------------------------------------------------------------------
> > > >>>>> >> > To unsubscribe, e-mail:
> > > common-dev-unsubscribe@hadoop.apache.org
> > > >>>>> >> > For additional commands, e-mail:
> > > >>>>> common-dev-help@hadoop.apache.org
> > > >>>>> >> >
> > > >>>>> >>
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --
> > > >>>>> >
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --Brahma Reddy Battula
> > > >>>>> >
> > > >>>>>
> > > >>>>>
> > > >>>>> --
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> --Brahma Reddy Battula
> > > >>>>>
> > > >>>>
> > > >>
> > > >> --
> > > >>
> > > >>
> > > >>
> > > >> --Brahma Reddy Battula
> > > >>
> > > >
> > >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Sorry, I was looking for some CVE’s fixes.will make it progress on this…
On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
> Is this still making progress?
>
> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi Akira,
> >
> > Thanks for your email!!
> >
> > I am evaluating the CVE’s which needs to go for this release..
> >
> > Will update soon!!
> >
> >
> > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >
> > > Hi Brahma,
> > >
> > > What is the release process going on? Is there any blocker for the RC?
> > >
> > > -Akira
> > >
> > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> > >
> > > > Hi Brahma,
> > > >
> > > > The feature 'BPServiceActor processes commands from NameNode
> > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > > While
> > > > cherry-picking there is only minor conflict, So I checked in
> directly.
> > > BTW,
> > > > run some unit tests and build pseudo cluster to verify, it seems to
> > work
> > > > fine.
> > > > FYI.
> > > >
> > > > Regards,
> > > > - He Xiaoqiao
> > > >
> > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > brahma@apache.org
> > > >
> > > > wrote:
> > > >
> > > >> Please go ahead. Let me know any help required on review.
> > > >>
> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>
> > > >>> Hi Brahma,
> > > >>>
> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > > >>> resolved the conflict and verified them locally.
> > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > > >>> I would like to hear some more response that if we have enough time
> > to
> > > >>> wait for it to be ready.
> > > >>> Thanks.
> > > >>>
> > > >>> Best Regards,
> > > >>> - He Xiaoqiao
> > > >>>
> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>>
> > > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> FYI.
> > > >>>>
> > > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > > brahma@apache.org>
> > > >>>> wrote:
> > > >>>>
> > > >>>>> Hi All,
> > > >>>>>
> > > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > > this
> > > >>>>> can
> > > >>>>> be done by this week,then I will try to create the RC next if
> there
> > > is
> > > >>>>> no
> > > >>>>> objection.
> > > >>>>>
> > > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > > >>>>> brahma@apache.org>
> > > >>>>> wrote:
> > > >>>>>
> > > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > > >>>>> > <iw...@oss.nttdata.co.jp>
> > > >>>>> > Looks all are build related issues when you try with bigtop. We
> > can
> > > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > > >>>>> >
> > > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > > >>>>> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >>
> > > >>>>> >> I filed HADOOP-17849 for this.
> > > >>>>> >>
> > > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > > >>>>> background.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >
> > > >>>>> >> > These are relevant to directory structure used by Bigtop
> > > package.
> > > >>>>> >> > If the fix does not break the tarball dist,
> > > >>>>> >> > it would be nice to have these on Hadoop too.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > > >>>>> >> > It is only acceptable for Bigtop not running tests of
> YARN-UI2
> > > on
> > > >>>>> >> packaging.
> > > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > > >>>>> >> >> Thanks, I'll check them out.
> > > >>>>> >> >>
> > > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > > >>>>> aajisaka@apache.org>
> > > >>>>> >> wrote:
> > > >>>>> >> >>
> > > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > > >>>>> >> >>>
> > > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > > >>>>> 3.2.2.
> > > >>>>> >> >>>
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > > >>>>> >> >>>
> > > >>>>> >> >>> In these patches, how about backporting the following
> issues
> > > to
> > > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > > >>>>> >> >>> - HADOOP-14922
> > > >>>>> >> >>> - HADOOP-15939
> > > >>>>> >> >>> - HADOOP-17569
> > > >>>>> >> >>>
> > > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> > issue
> > > >>>>> ID.
> > > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >>>
> > > >>>>> >> >>> Thanks and regards,
> > > >>>>> >> >>> Akira
> > > >>>>> >> >>>
> > > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > > >>>>> hexiaoqiao@apache.org>
> > > >>>>> >> >>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > > >>>>> release
> > > >>>>> >> happen.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> I would like to validate the HBase project (both the
> latest
> > > >>>>> release
> > > >>>>> >> and
> > > >>>>> >> >>>> trunk branch).
> > > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch
> with
> > > >>>>> Chao
> > > >>>>> >> >>> already).
> > > >>>>> >> >>>> once RC is out.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks and Regards,
> > > >>>>> >> >>>> - He Xiaoqiao
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > > >>>>> >> brahma@apache.org>
> > > >>>>> >> >>>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>> Hi All,
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > > commit
> > > >>>>> to
> > > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> *This time I am thinking of having downstream projects
> and
> > > >>>>> >> companies'
> > > >>>>> >> >>>>> voices,let's know how this can go. *
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> - Planning to check with downstream projects like
> > > >>>>> Spark,HBase
> > > >>>>> >> and
> > > >>>>> >> >>> Hive
> > > >>>>> >> >>>>> if they can help on validation(Or running their UT
> on
> > > this
> > > >>>>> >> branch)
> > > >>>>> >> >>>>> - Collecting info from Companies who are already
> > > deployed
> > > >>>>> and
> > > >>>>> >> using
> > > >>>>> >> >>> the
> > > >>>>> >> >>>>> branch-3.2
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so
> that
> > > >>>>> features
> > > >>>>> >> >>> released
> > > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > > >>>>> anybody from
> > > >>>>> >> >>> these
> > > >>>>> >> >>>>> communities who can help on this.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> > are
> > > >>>>> >> welcome.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> --Brahma Reddy Battula
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>>
> > ---------------------------------------------------------------------
> > > >>>>> >> > To unsubscribe, e-mail:
> > > common-dev-unsubscribe@hadoop.apache.org
> > > >>>>> >> > For additional commands, e-mail:
> > > >>>>> common-dev-help@hadoop.apache.org
> > > >>>>> >> >
> > > >>>>> >>
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --
> > > >>>>> >
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --Brahma Reddy Battula
> > > >>>>> >
> > > >>>>>
> > > >>>>>
> > > >>>>> --
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> --Brahma Reddy Battula
> > > >>>>>
> > > >>>>
> > > >>
> > > >> --
> > > >>
> > > >>
> > > >>
> > > >> --Brahma Reddy Battula
> > > >>
> > > >
> > >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Sorry, I was looking for some CVE’s fixes.will make it progress on this…
On Tue, 11 Jan 2022 at 5:58 PM, Wei-Chiu Chuang <we...@apache.org> wrote:
> Is this still making progress?
>
> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi Akira,
> >
> > Thanks for your email!!
> >
> > I am evaluating the CVE’s which needs to go for this release..
> >
> > Will update soon!!
> >
> >
> > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >
> > > Hi Brahma,
> > >
> > > What is the release process going on? Is there any blocker for the RC?
> > >
> > > -Akira
> > >
> > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> > >
> > > > Hi Brahma,
> > > >
> > > > The feature 'BPServiceActor processes commands from NameNode
> > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > > While
> > > > cherry-picking there is only minor conflict, So I checked in
> directly.
> > > BTW,
> > > > run some unit tests and build pseudo cluster to verify, it seems to
> > work
> > > > fine.
> > > > FYI.
> > > >
> > > > Regards,
> > > > - He Xiaoqiao
> > > >
> > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> > brahma@apache.org
> > > >
> > > > wrote:
> > > >
> > > >> Please go ahead. Let me know any help required on review.
> > > >>
> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>
> > > >>> Hi Brahma,
> > > >>>
> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > > >>> resolved the conflict and verified them locally.
> > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > > >>> I would like to hear some more response that if we have enough time
> > to
> > > >>> wait for it to be ready.
> > > >>> Thanks.
> > > >>>
> > > >>> Best Regards,
> > > >>> - He Xiaoqiao
> > > >>>
> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > > wrote:
> > > >>>
> > > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3.
> FYI.
> > > >>>>
> > > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > > brahma@apache.org>
> > > >>>> wrote:
> > > >>>>
> > > >>>>> Hi All,
> > > >>>>>
> > > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > > this
> > > >>>>> can
> > > >>>>> be done by this week,then I will try to create the RC next if
> there
> > > is
> > > >>>>> no
> > > >>>>> objection.
> > > >>>>>
> > > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > > >>>>> brahma@apache.org>
> > > >>>>> wrote:
> > > >>>>>
> > > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > > >>>>> > <iw...@oss.nttdata.co.jp>
> > > >>>>> > Looks all are build related issues when you try with bigtop. We
> > can
> > > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > > >>>>> >
> > > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > > >>>>> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >>
> > > >>>>> >> I filed HADOOP-17849 for this.
> > > >>>>> >>
> > > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > > >>>>> background.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > > >>>>> zooekeper-3.4.13,
> > > >>>>> >> > while it would be harmless to add the exclusion even for
> > > >>>>> >> zooekeeper-3.4.13.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >
> > > >>>>> >> > These are relevant to directory structure used by Bigtop
> > > package.
> > > >>>>> >> > If the fix does not break the tarball dist,
> > > >>>>> >> > it would be nice to have these on Hadoop too.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> >> -
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >
> > > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > > >>>>> >> > It is only acceptable for Bigtop not running tests of
> YARN-UI2
> > > on
> > > >>>>> >> packaging.
> > > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > > >>>>> >> >> Thanks, I'll check them out.
> > > >>>>> >> >>
> > > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > > >>>>> aajisaka@apache.org>
> > > >>>>> >> wrote:
> > > >>>>> >> >>
> > > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > > >>>>> >> >>>
> > > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > > >>>>> 3.2.2.
> > > >>>>> >> >>>
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > > >>>>> >> >>>
> > > >>>>> >> >>> In these patches, how about backporting the following
> issues
> > > to
> > > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > > >>>>> >> >>> - HADOOP-14922
> > > >>>>> >> >>> - HADOOP-15939
> > > >>>>> >> >>> - HADOOP-17569
> > > >>>>> >> >>>
> > > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> > issue
> > > >>>>> ID.
> > > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > > >>>>> >> >>> -
> > > >>>>> >> >>>
> > > >>>>> >>
> > > >>>>>
> > >
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > > >>>>> >> >>>
> > > >>>>> >> >>> Thanks and regards,
> > > >>>>> >> >>> Akira
> > > >>>>> >> >>>
> > > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > > >>>>> hexiaoqiao@apache.org>
> > > >>>>> >> >>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > > >>>>> release
> > > >>>>> >> happen.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> I would like to validate the HBase project (both the
> latest
> > > >>>>> release
> > > >>>>> >> and
> > > >>>>> >> >>>> trunk branch).
> > > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch
> with
> > > >>>>> Chao
> > > >>>>> >> >>> already).
> > > >>>>> >> >>>> once RC is out.
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> Thanks and Regards,
> > > >>>>> >> >>>> - He Xiaoqiao
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>
> > > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > > >>>>> >> brahma@apache.org>
> > > >>>>> >> >>>> wrote:
> > > >>>>> >> >>>>
> > > >>>>> >> >>>>> Hi All,
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > > commit
> > > >>>>> to
> > > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> *This time I am thinking of having downstream projects
> and
> > > >>>>> >> companies'
> > > >>>>> >> >>>>> voices,let's know how this can go. *
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> - Planning to check with downstream projects like
> > > >>>>> Spark,HBase
> > > >>>>> >> and
> > > >>>>> >> >>> Hive
> > > >>>>> >> >>>>> if they can help on validation(Or running their UT
> on
> > > this
> > > >>>>> >> branch)
> > > >>>>> >> >>>>> - Collecting info from Companies who are already
> > > deployed
> > > >>>>> and
> > > >>>>> >> using
> > > >>>>> >> >>> the
> > > >>>>> >> >>>>> branch-3.2
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so
> that
> > > >>>>> features
> > > >>>>> >> >>> released
> > > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > > >>>>> anybody from
> > > >>>>> >> >>> these
> > > >>>>> >> >>>>> communities who can help on this.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> > are
> > > >>>>> >> welcome.
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>>> --Brahma Reddy Battula
> > > >>>>> >> >>>>>
> > > >>>>> >> >>>
> > > >>>>> >> >
> > > >>>>> >> >
> > > >>>>>
> > ---------------------------------------------------------------------
> > > >>>>> >> > To unsubscribe, e-mail:
> > > common-dev-unsubscribe@hadoop.apache.org
> > > >>>>> >> > For additional commands, e-mail:
> > > >>>>> common-dev-help@hadoop.apache.org
> > > >>>>> >> >
> > > >>>>> >>
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --
> > > >>>>> >
> > > >>>>> >
> > > >>>>> >
> > > >>>>> > --Brahma Reddy Battula
> > > >>>>> >
> > > >>>>>
> > > >>>>>
> > > >>>>> --
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> --Brahma Reddy Battula
> > > >>>>>
> > > >>>>
> > > >>
> > > >> --
> > > >>
> > > >>
> > > >>
> > > >> --Brahma Reddy Battula
> > > >>
> > > >
> > >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@apache.org>.
Is this still making progress?
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@apache.org>.
Is this still making progress?
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Hi to raise the awareness,
it looks like reverting the FoldedTreeSet HDFS-13671
<https://issues.apache.org/jira/browse/HDFS-13671> breaks TestBlockManager
in branch-3.2. Branch-3.3 is good.
tracking jira: HDFS-16258 <https://issues.apache.org/jira/browse/HDFS-16258>
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Hi to raise the awareness,
it looks like reverting the FoldedTreeSet HDFS-13671
<https://issues.apache.org/jira/browse/HDFS-13671> breaks TestBlockManager
in branch-3.2. Branch-3.3 is good.
tracking jira: HDFS-16258 <https://issues.apache.org/jira/browse/HDFS-16258>
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@apache.org>.
Is this still making progress?
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@cloudera.com.INVALID>.
Hi to raise the awareness,
it looks like reverting the FoldedTreeSet HDFS-13671
<https://issues.apache.org/jira/browse/HDFS-13671> breaks TestBlockManager
in branch-3.2. Branch-3.3 is good.
tracking jira: HDFS-16258 <https://issues.apache.org/jira/browse/HDFS-16258>
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Wei-Chiu Chuang <we...@apache.org>.
Is this still making progress?
On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi Akira,
>
> Thanks for your email!!
>
> I am evaluating the CVE’s which needs to go for this release..
>
> Will update soon!!
>
>
> On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
> > Hi Brahma,
> >
> > What is the release process going on? Is there any blocker for the RC?
> >
> > -Akira
> >
> > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> >
> > > Hi Brahma,
> > >
> > > The feature 'BPServiceActor processes commands from NameNode
> > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> > While
> > > cherry-picking there is only minor conflict, So I checked in directly.
> > BTW,
> > > run some unit tests and build pseudo cluster to verify, it seems to
> work
> > > fine.
> > > FYI.
> > >
> > > Regards,
> > > - He Xiaoqiao
> > >
> > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <
> brahma@apache.org
> > >
> > > wrote:
> > >
> > >> Please go ahead. Let me know any help required on review.
> > >>
> > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>
> > >>> Hi Brahma,
> > >>>
> > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> > >>> resolved the conflict and verified them locally.
> > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> > >>> I would like to hear some more response that if we have enough time
> to
> > >>> wait for it to be ready.
> > >>> Thanks.
> > >>>
> > >>> Best Regards,
> > >>> - He Xiaoqiao
> > >>>
> > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> > wrote:
> > >>>
> > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> > >>>>
> > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> > brahma@apache.org>
> > >>>> wrote:
> > >>>>
> > >>>>> Hi All,
> > >>>>>
> > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> > this
> > >>>>> can
> > >>>>> be done by this week,then I will try to create the RC next if there
> > is
> > >>>>> no
> > >>>>> objection.
> > >>>>>
> > >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> > >>>>> brahma@apache.org>
> > >>>>> wrote:
> > >>>>>
> > >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > >>>>> > <iw...@oss.nttdata.co.jp>
> > >>>>> > Looks all are build related issues when you try with bigtop. We
> can
> > >>>>> > discuss and prioritize this.. Will connect with you guys.
> > >>>>> >
> > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> > >>>>> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >>
> > >>>>> >> I filed HADOOP-17849 for this.
> > >>>>> >>
> > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> > >>>>> background.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >
> > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > >>>>> >> > we do not see the issue usually since branch-3.2 uses
> > >>>>> zooekeper-3.4.13,
> > >>>>> >> > while it would be harmless to add the exclusion even for
> > >>>>> >> zooekeeper-3.4.13.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >
> > >>>>> >> > These are relevant to directory structure used by Bigtop
> > package.
> > >>>>> >> > If the fix does not break the tarball dist,
> > >>>>> >> > it would be nice to have these on Hadoop too.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> >> -
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >
> > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> > on
> > >>>>> >> packaging.
> > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> > >>>>> >> >
> > >>>>> >> >
> > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> > >>>>> >> >> Thanks, I'll check them out.
> > >>>>> >> >>
> > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> > >>>>> aajisaka@apache.org>
> > >>>>> >> wrote:
> > >>>>> >> >>
> > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> > >>>>> >> >>>
> > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> > >>>>> 3.2.2.
> > >>>>> >> >>>
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> > >>>>> >> >>>
> > >>>>> >> >>> In these patches, how about backporting the following issues
> > to
> > >>>>> >> >>> branch-3.2 and branch-3.2.3?
> > >>>>> >> >>> - HADOOP-14922
> > >>>>> >> >>> - HADOOP-15939
> > >>>>> >> >>> - HADOOP-17569
> > >>>>> >> >>>
> > >>>>> >> >>> In addition, there are some patches that don't have JIRA
> issue
> > >>>>> ID.
> > >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> > >>>>> >> >>> -
> > >>>>> >> >>>
> > >>>>> >>
> > >>>>>
> >
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> > >>>>> >> >>>
> > >>>>> >> >>> Thanks and regards,
> > >>>>> >> >>> Akira
> > >>>>> >> >>>
> > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> > >>>>> hexiaoqiao@apache.org>
> > >>>>> >> >>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> > >>>>> release
> > >>>>> >> happen.
> > >>>>> >> >>>>
> > >>>>> >> >>>> I would like to validate the HBase project (both the latest
> > >>>>> release
> > >>>>> >> and
> > >>>>> >> >>>> trunk branch).
> > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> > >>>>> Chao
> > >>>>> >> >>> already).
> > >>>>> >> >>>> once RC is out.
> > >>>>> >> >>>>
> > >>>>> >> >>>> Thanks and Regards,
> > >>>>> >> >>>> - He Xiaoqiao
> > >>>>> >> >>>>
> > >>>>> >> >>>>
> > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> > >>>>> >> brahma@apache.org>
> > >>>>> >> >>>> wrote:
> > >>>>> >> >>>>
> > >>>>> >> >>>>> Hi All,
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> > commit
> > >>>>> to
> > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> > >>>>> >> companies'
> > >>>>> >> >>>>> voices,let's know how this can go. *
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> - Planning to check with downstream projects like
> > >>>>> Spark,HBase
> > >>>>> >> and
> > >>>>> >> >>> Hive
> > >>>>> >> >>>>> if they can help on validation(Or running their UT on
> > this
> > >>>>> >> branch)
> > >>>>> >> >>>>> - Collecting info from Companies who are already
> > deployed
> > >>>>> and
> > >>>>> >> using
> > >>>>> >> >>> the
> > >>>>> >> >>>>> branch-3.2
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> > >>>>> features
> > >>>>> >> >>> released
> > >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> > >>>>> anybody from
> > >>>>> >> >>> these
> > >>>>> >> >>>>> communities who can help on this.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions
> are
> > >>>>> >> welcome.
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>>
> > >>>>> >> >>>>> --Brahma Reddy Battula
> > >>>>> >> >>>>>
> > >>>>> >> >>>
> > >>>>> >> >
> > >>>>> >> >
> > >>>>>
> ---------------------------------------------------------------------
> > >>>>> >> > To unsubscribe, e-mail:
> > common-dev-unsubscribe@hadoop.apache.org
> > >>>>> >> > For additional commands, e-mail:
> > >>>>> common-dev-help@hadoop.apache.org
> > >>>>> >> >
> > >>>>> >>
> > >>>>> >
> > >>>>> >
> > >>>>> > --
> > >>>>> >
> > >>>>> >
> > >>>>> >
> > >>>>> > --Brahma Reddy Battula
> > >>>>> >
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --Brahma Reddy Battula
> > >>>>>
> > >>>>
> > >>
> > >> --
> > >>
> > >>
> > >>
> > >> --Brahma Reddy Battula
> > >>
> > >
> >
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi Akira,
Thanks for your email!!
I am evaluating the CVE’s which needs to go for this release..
Will update soon!!
On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Hi Brahma,
>
> What is the release process going on? Is there any blocker for the RC?
>
> -Akira
>
> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
> > Hi Brahma,
> >
> > The feature 'BPServiceActor processes commands from NameNode
> > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> While
> > cherry-picking there is only minor conflict, So I checked in directly.
> BTW,
> > run some unit tests and build pseudo cluster to verify, it seems to work
> > fine.
> > FYI.
> >
> > Regards,
> > - He Xiaoqiao
> >
> > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <brahma@apache.org
> >
> > wrote:
> >
> >> Please go ahead. Let me know any help required on review.
> >>
> >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>
> >>> Hi Brahma,
> >>>
> >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>> resolved the conflict and verified them locally.
> >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>> I would like to hear some more response that if we have enough time to
> >>> wait for it to be ready.
> >>> Thanks.
> >>>
> >>> Best Regards,
> >>> - He Xiaoqiao
> >>>
> >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>>
> >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> >>>>
> >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> this
> >>>>> can
> >>>>> be done by this week,then I will try to create the RC next if there
> is
> >>>>> no
> >>>>> objection.
> >>>>>
> >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>> brahma@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>> > <iw...@oss.nttdata.co.jp>
> >>>>> > Looks all are build related issues when you try with bigtop. We can
> >>>>> > discuss and prioritize this.. Will connect with you guys.
> >>>>> >
> >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> >>>>> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >>
> >>>>> >> I filed HADOOP-17849 for this.
> >>>>> >>
> >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> >>>>> background.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >
> >>>>> >> > These are relevant to directory structure used by Bigtop
> package.
> >>>>> >> > If the fix does not break the tarball dist,
> >>>>> >> > it would be nice to have these on Hadoop too.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >
> >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> on
> >>>>> >> packaging.
> >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>> >> >> Thanks, I'll check them out.
> >>>>> >> >>
> >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>> aajisaka@apache.org>
> >>>>> >> wrote:
> >>>>> >> >>
> >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>>> >> >>>
> >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>> 3.2.2.
> >>>>> >> >>>
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>> >> >>>
> >>>>> >> >>> In these patches, how about backporting the following issues
> to
> >>>>> >> >>> branch-3.2 and branch-3.2.3?
> >>>>> >> >>> - HADOOP-14922
> >>>>> >> >>> - HADOOP-15939
> >>>>> >> >>> - HADOOP-17569
> >>>>> >> >>>
> >>>>> >> >>> In addition, there are some patches that don't have JIRA issue
> >>>>> ID.
> >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >>>
> >>>>> >> >>> Thanks and regards,
> >>>>> >> >>> Akira
> >>>>> >> >>>
> >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>> hexiaoqiao@apache.org>
> >>>>> >> >>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>> release
> >>>>> >> happen.
> >>>>> >> >>>>
> >>>>> >> >>>> I would like to validate the HBase project (both the latest
> >>>>> release
> >>>>> >> and
> >>>>> >> >>>> trunk branch).
> >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> >>>>> Chao
> >>>>> >> >>> already).
> >>>>> >> >>>> once RC is out.
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks and Regards,
> >>>>> >> >>>> - He Xiaoqiao
> >>>>> >> >>>>
> >>>>> >> >>>>
> >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>> >> brahma@apache.org>
> >>>>> >> >>>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>>> Hi All,
> >>>>> >> >>>>>
> >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> commit
> >>>>> to
> >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>> >> >>>>>
> >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> >>>>> >> companies'
> >>>>> >> >>>>> voices,let's know how this can go. *
> >>>>> >> >>>>>
> >>>>> >> >>>>> - Planning to check with downstream projects like
> >>>>> Spark,HBase
> >>>>> >> and
> >>>>> >> >>> Hive
> >>>>> >> >>>>> if they can help on validation(Or running their UT on
> this
> >>>>> >> branch)
> >>>>> >> >>>>> - Collecting info from Companies who are already
> deployed
> >>>>> and
> >>>>> >> using
> >>>>> >> >>> the
> >>>>> >> >>>>> branch-3.2
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> >>>>> features
> >>>>> >> >>> released
> >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> >>>>> anybody from
> >>>>> >> >>> these
> >>>>> >> >>>>> communities who can help on this.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >>>>> >> welcome.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> --Brahma Reddy Battula
> >>>>> >> >>>>>
> >>>>> >> >>>
> >>>>> >> >
> >>>>> >> >
> >>>>> ---------------------------------------------------------------------
> >>>>> >> > To unsubscribe, e-mail:
> common-dev-unsubscribe@hadoop.apache.org
> >>>>> >> > For additional commands, e-mail:
> >>>>> common-dev-help@hadoop.apache.org
> >>>>> >> >
> >>>>> >>
> >>>>> >
> >>>>> >
> >>>>> > --
> >>>>> >
> >>>>> >
> >>>>> >
> >>>>> > --Brahma Reddy Battula
> >>>>> >
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>>
> >>
> >> --
> >>
> >>
> >>
> >> --Brahma Reddy Battula
> >>
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi Akira,
Thanks for your email!!
I am evaluating the CVE’s which needs to go for this release..
Will update soon!!
On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Hi Brahma,
>
> What is the release process going on? Is there any blocker for the RC?
>
> -Akira
>
> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
> > Hi Brahma,
> >
> > The feature 'BPServiceActor processes commands from NameNode
> > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> While
> > cherry-picking there is only minor conflict, So I checked in directly.
> BTW,
> > run some unit tests and build pseudo cluster to verify, it seems to work
> > fine.
> > FYI.
> >
> > Regards,
> > - He Xiaoqiao
> >
> > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <brahma@apache.org
> >
> > wrote:
> >
> >> Please go ahead. Let me know any help required on review.
> >>
> >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>
> >>> Hi Brahma,
> >>>
> >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>> resolved the conflict and verified them locally.
> >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>> I would like to hear some more response that if we have enough time to
> >>> wait for it to be ready.
> >>> Thanks.
> >>>
> >>> Best Regards,
> >>> - He Xiaoqiao
> >>>
> >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>>
> >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> >>>>
> >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> this
> >>>>> can
> >>>>> be done by this week,then I will try to create the RC next if there
> is
> >>>>> no
> >>>>> objection.
> >>>>>
> >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>> brahma@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>> > <iw...@oss.nttdata.co.jp>
> >>>>> > Looks all are build related issues when you try with bigtop. We can
> >>>>> > discuss and prioritize this.. Will connect with you guys.
> >>>>> >
> >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> >>>>> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >>
> >>>>> >> I filed HADOOP-17849 for this.
> >>>>> >>
> >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> >>>>> background.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >
> >>>>> >> > These are relevant to directory structure used by Bigtop
> package.
> >>>>> >> > If the fix does not break the tarball dist,
> >>>>> >> > it would be nice to have these on Hadoop too.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >
> >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> on
> >>>>> >> packaging.
> >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>> >> >> Thanks, I'll check them out.
> >>>>> >> >>
> >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>> aajisaka@apache.org>
> >>>>> >> wrote:
> >>>>> >> >>
> >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>>> >> >>>
> >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>> 3.2.2.
> >>>>> >> >>>
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>> >> >>>
> >>>>> >> >>> In these patches, how about backporting the following issues
> to
> >>>>> >> >>> branch-3.2 and branch-3.2.3?
> >>>>> >> >>> - HADOOP-14922
> >>>>> >> >>> - HADOOP-15939
> >>>>> >> >>> - HADOOP-17569
> >>>>> >> >>>
> >>>>> >> >>> In addition, there are some patches that don't have JIRA issue
> >>>>> ID.
> >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >>>
> >>>>> >> >>> Thanks and regards,
> >>>>> >> >>> Akira
> >>>>> >> >>>
> >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>> hexiaoqiao@apache.org>
> >>>>> >> >>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>> release
> >>>>> >> happen.
> >>>>> >> >>>>
> >>>>> >> >>>> I would like to validate the HBase project (both the latest
> >>>>> release
> >>>>> >> and
> >>>>> >> >>>> trunk branch).
> >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> >>>>> Chao
> >>>>> >> >>> already).
> >>>>> >> >>>> once RC is out.
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks and Regards,
> >>>>> >> >>>> - He Xiaoqiao
> >>>>> >> >>>>
> >>>>> >> >>>>
> >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>> >> brahma@apache.org>
> >>>>> >> >>>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>>> Hi All,
> >>>>> >> >>>>>
> >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> commit
> >>>>> to
> >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>> >> >>>>>
> >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> >>>>> >> companies'
> >>>>> >> >>>>> voices,let's know how this can go. *
> >>>>> >> >>>>>
> >>>>> >> >>>>> - Planning to check with downstream projects like
> >>>>> Spark,HBase
> >>>>> >> and
> >>>>> >> >>> Hive
> >>>>> >> >>>>> if they can help on validation(Or running their UT on
> this
> >>>>> >> branch)
> >>>>> >> >>>>> - Collecting info from Companies who are already
> deployed
> >>>>> and
> >>>>> >> using
> >>>>> >> >>> the
> >>>>> >> >>>>> branch-3.2
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> >>>>> features
> >>>>> >> >>> released
> >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> >>>>> anybody from
> >>>>> >> >>> these
> >>>>> >> >>>>> communities who can help on this.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >>>>> >> welcome.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> --Brahma Reddy Battula
> >>>>> >> >>>>>
> >>>>> >> >>>
> >>>>> >> >
> >>>>> >> >
> >>>>> ---------------------------------------------------------------------
> >>>>> >> > To unsubscribe, e-mail:
> common-dev-unsubscribe@hadoop.apache.org
> >>>>> >> > For additional commands, e-mail:
> >>>>> common-dev-help@hadoop.apache.org
> >>>>> >> >
> >>>>> >>
> >>>>> >
> >>>>> >
> >>>>> > --
> >>>>> >
> >>>>> >
> >>>>> >
> >>>>> > --Brahma Reddy Battula
> >>>>> >
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>>
> >>
> >> --
> >>
> >>
> >>
> >> --Brahma Reddy Battula
> >>
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi Akira,
Thanks for your email!!
I am evaluating the CVE’s which needs to go for this release..
Will update soon!!
On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Hi Brahma,
>
> What is the release process going on? Is there any blocker for the RC?
>
> -Akira
>
> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
> > Hi Brahma,
> >
> > The feature 'BPServiceActor processes commands from NameNode
> > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> While
> > cherry-picking there is only minor conflict, So I checked in directly.
> BTW,
> > run some unit tests and build pseudo cluster to verify, it seems to work
> > fine.
> > FYI.
> >
> > Regards,
> > - He Xiaoqiao
> >
> > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <brahma@apache.org
> >
> > wrote:
> >
> >> Please go ahead. Let me know any help required on review.
> >>
> >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>
> >>> Hi Brahma,
> >>>
> >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>> resolved the conflict and verified them locally.
> >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>> I would like to hear some more response that if we have enough time to
> >>> wait for it to be ready.
> >>> Thanks.
> >>>
> >>> Best Regards,
> >>> - He Xiaoqiao
> >>>
> >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>>
> >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> >>>>
> >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> this
> >>>>> can
> >>>>> be done by this week,then I will try to create the RC next if there
> is
> >>>>> no
> >>>>> objection.
> >>>>>
> >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>> brahma@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>> > <iw...@oss.nttdata.co.jp>
> >>>>> > Looks all are build related issues when you try with bigtop. We can
> >>>>> > discuss and prioritize this.. Will connect with you guys.
> >>>>> >
> >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> >>>>> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >>
> >>>>> >> I filed HADOOP-17849 for this.
> >>>>> >>
> >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> >>>>> background.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >
> >>>>> >> > These are relevant to directory structure used by Bigtop
> package.
> >>>>> >> > If the fix does not break the tarball dist,
> >>>>> >> > it would be nice to have these on Hadoop too.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >
> >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> on
> >>>>> >> packaging.
> >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>> >> >> Thanks, I'll check them out.
> >>>>> >> >>
> >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>> aajisaka@apache.org>
> >>>>> >> wrote:
> >>>>> >> >>
> >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>>> >> >>>
> >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>> 3.2.2.
> >>>>> >> >>>
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>> >> >>>
> >>>>> >> >>> In these patches, how about backporting the following issues
> to
> >>>>> >> >>> branch-3.2 and branch-3.2.3?
> >>>>> >> >>> - HADOOP-14922
> >>>>> >> >>> - HADOOP-15939
> >>>>> >> >>> - HADOOP-17569
> >>>>> >> >>>
> >>>>> >> >>> In addition, there are some patches that don't have JIRA issue
> >>>>> ID.
> >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >>>
> >>>>> >> >>> Thanks and regards,
> >>>>> >> >>> Akira
> >>>>> >> >>>
> >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>> hexiaoqiao@apache.org>
> >>>>> >> >>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>> release
> >>>>> >> happen.
> >>>>> >> >>>>
> >>>>> >> >>>> I would like to validate the HBase project (both the latest
> >>>>> release
> >>>>> >> and
> >>>>> >> >>>> trunk branch).
> >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> >>>>> Chao
> >>>>> >> >>> already).
> >>>>> >> >>>> once RC is out.
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks and Regards,
> >>>>> >> >>>> - He Xiaoqiao
> >>>>> >> >>>>
> >>>>> >> >>>>
> >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>> >> brahma@apache.org>
> >>>>> >> >>>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>>> Hi All,
> >>>>> >> >>>>>
> >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> commit
> >>>>> to
> >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>> >> >>>>>
> >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> >>>>> >> companies'
> >>>>> >> >>>>> voices,let's know how this can go. *
> >>>>> >> >>>>>
> >>>>> >> >>>>> - Planning to check with downstream projects like
> >>>>> Spark,HBase
> >>>>> >> and
> >>>>> >> >>> Hive
> >>>>> >> >>>>> if they can help on validation(Or running their UT on
> this
> >>>>> >> branch)
> >>>>> >> >>>>> - Collecting info from Companies who are already
> deployed
> >>>>> and
> >>>>> >> using
> >>>>> >> >>> the
> >>>>> >> >>>>> branch-3.2
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> >>>>> features
> >>>>> >> >>> released
> >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> >>>>> anybody from
> >>>>> >> >>> these
> >>>>> >> >>>>> communities who can help on this.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >>>>> >> welcome.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> --Brahma Reddy Battula
> >>>>> >> >>>>>
> >>>>> >> >>>
> >>>>> >> >
> >>>>> >> >
> >>>>> ---------------------------------------------------------------------
> >>>>> >> > To unsubscribe, e-mail:
> common-dev-unsubscribe@hadoop.apache.org
> >>>>> >> > For additional commands, e-mail:
> >>>>> common-dev-help@hadoop.apache.org
> >>>>> >> >
> >>>>> >>
> >>>>> >
> >>>>> >
> >>>>> > --
> >>>>> >
> >>>>> >
> >>>>> >
> >>>>> > --Brahma Reddy Battula
> >>>>> >
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>>
> >>
> >> --
> >>
> >>
> >>
> >> --Brahma Reddy Battula
> >>
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi Akira,
Thanks for your email!!
I am evaluating the CVE’s which needs to go for this release..
Will update soon!!
On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Hi Brahma,
>
> What is the release process going on? Is there any blocker for the RC?
>
> -Akira
>
> On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
> > Hi Brahma,
> >
> > The feature 'BPServiceActor processes commands from NameNode
> > asynchronously' has been ready for both branch-3.2 and branch-3.2.3.
> While
> > cherry-picking there is only minor conflict, So I checked in directly.
> BTW,
> > run some unit tests and build pseudo cluster to verify, it seems to work
> > fine.
> > FYI.
> >
> > Regards,
> > - He Xiaoqiao
> >
> > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <brahma@apache.org
> >
> > wrote:
> >
> >> Please go ahead. Let me know any help required on review.
> >>
> >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>
> >>> Hi Brahma,
> >>>
> >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> >>> resolved the conflict and verified them locally.
> >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> >>> I would like to hear some more response that if we have enough time to
> >>> wait for it to be ready.
> >>> Thanks.
> >>>
> >>> Best Regards,
> >>> - He Xiaoqiao
> >>>
> >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com>
> wrote:
> >>>
> >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
> >>>>
> >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly
> this
> >>>>> can
> >>>>> be done by this week,then I will try to create the RC next if there
> is
> >>>>> no
> >>>>> objection.
> >>>>>
> >>>>> https://issues.apache.org/jira/browse/HDFS-15160
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
> >>>>> brahma@apache.org>
> >>>>> wrote:
> >>>>>
> >>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> >>>>> > <iw...@oss.nttdata.co.jp>
> >>>>> > Looks all are build related issues when you try with bigtop. We can
> >>>>> > discuss and prioritize this.. Will connect with you guys.
> >>>>> >
> >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> >>>>> > iwasakims@oss.nttdata.co.jp> wrote:
> >>>>> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >>
> >>>>> >> I filed HADOOP-17849 for this.
> >>>>> >>
> >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >>>>> >> > Thanks for bringing this up, Akira. Let me explain some
> >>>>> background.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >
> >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >>>>> >> > we do not see the issue usually since branch-3.2 uses
> >>>>> zooekeper-3.4.13,
> >>>>> >> > while it would be harmless to add the exclusion even for
> >>>>> >> zooekeeper-3.4.13.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >
> >>>>> >> > These are relevant to directory structure used by Bigtop
> package.
> >>>>> >> > If the fix does not break the tarball dist,
> >>>>> >> > it would be nice to have these on Hadoop too.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> >> -
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >
> >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2
> on
> >>>>> >> packaging.
> >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >>>>> >> >
> >>>>> >> >
> >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >>>>> >> >> Thanks, I'll check them out.
> >>>>> >> >>
> >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
> >>>>> aajisaka@apache.org>
> >>>>> >> wrote:
> >>>>> >> >>
> >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>>> >> >>>
> >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
> >>>>> 3.2.2.
> >>>>> >> >>>
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>>> >> >>>
> >>>>> >> >>> In these patches, how about backporting the following issues
> to
> >>>>> >> >>> branch-3.2 and branch-3.2.3?
> >>>>> >> >>> - HADOOP-14922
> >>>>> >> >>> - HADOOP-15939
> >>>>> >> >>> - HADOOP-17569
> >>>>> >> >>>
> >>>>> >> >>> In addition, there are some patches that don't have JIRA issue
> >>>>> ID.
> >>>>> >> >>> Maybe we need to create JIRAs and fix those.
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>>>> >> >>> -
> >>>>> >> >>>
> >>>>> >>
> >>>>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>>> >> >>>
> >>>>> >> >>> Thanks and regards,
> >>>>> >> >>> Akira
> >>>>> >> >>>
> >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
> >>>>> hexiaoqiao@apache.org>
> >>>>> >> >>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
> >>>>> release
> >>>>> >> happen.
> >>>>> >> >>>>
> >>>>> >> >>>> I would like to validate the HBase project (both the latest
> >>>>> release
> >>>>> >> and
> >>>>> >> >>>> trunk branch).
> >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
> >>>>> Chao
> >>>>> >> >>> already).
> >>>>> >> >>>> once RC is out.
> >>>>> >> >>>>
> >>>>> >> >>>> Thanks and Regards,
> >>>>> >> >>>> - He Xiaoqiao
> >>>>> >> >>>>
> >>>>> >> >>>>
> >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >>>>> >> brahma@apache.org>
> >>>>> >> >>>> wrote:
> >>>>> >> >>>>
> >>>>> >> >>>>> Hi All,
> >>>>> >> >>>>>
> >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please
> commit
> >>>>> to
> >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>> >> >>>>>
> >>>>> >> >>>>> *This time I am thinking of having downstream projects and
> >>>>> >> companies'
> >>>>> >> >>>>> voices,let's know how this can go. *
> >>>>> >> >>>>>
> >>>>> >> >>>>> - Planning to check with downstream projects like
> >>>>> Spark,HBase
> >>>>> >> and
> >>>>> >> >>> Hive
> >>>>> >> >>>>> if they can help on validation(Or running their UT on
> this
> >>>>> >> branch)
> >>>>> >> >>>>> - Collecting info from Companies who are already
> deployed
> >>>>> and
> >>>>> >> using
> >>>>> >> >>> the
> >>>>> >> >>>>> branch-3.2
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
> >>>>> features
> >>>>> >> >>> released
> >>>>> >> >>>>> on this branch impact can be known) ,please let me know
> >>>>> anybody from
> >>>>> >> >>> these
> >>>>> >> >>>>> communities who can help on this.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >>>>> >> welcome.
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>>
> >>>>> >> >>>>> --Brahma Reddy Battula
> >>>>> >> >>>>>
> >>>>> >> >>>
> >>>>> >> >
> >>>>> >> >
> >>>>> ---------------------------------------------------------------------
> >>>>> >> > To unsubscribe, e-mail:
> common-dev-unsubscribe@hadoop.apache.org
> >>>>> >> > For additional commands, e-mail:
> >>>>> common-dev-help@hadoop.apache.org
> >>>>> >> >
> >>>>> >>
> >>>>> >
> >>>>> >
> >>>>> > --
> >>>>> >
> >>>>> >
> >>>>> >
> >>>>> > --Brahma Reddy Battula
> >>>>> >
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>>
> >>
> >> --
> >>
> >>
> >>
> >> --Brahma Reddy Battula
> >>
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Brahma,
What is the release process going on? Is there any blocker for the RC?
-Akira
On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> The feature 'BPServiceActor processes commands from NameNode
> asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
> cherry-picking there is only minor conflict, So I checked in directly. BTW,
> run some unit tests and build pseudo cluster to verify, it seems to work
> fine.
> FYI.
>
> Regards,
> - He Xiaoqiao
>
> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Please go ahead. Let me know any help required on review.
>>
>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma,
>>>
>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>> resolved the conflict and verified them locally.
>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>> I would like to hear some more response that if we have enough time to
>>> wait for it to be ready.
>>> Thanks.
>>>
>>> Best Regards,
>>> - He Xiaoqiao
>>>
>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>>
>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>>
>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>>> can
>>>>> be done by this week,then I will try to create the RC next if there is
>>>>> no
>>>>> objection.
>>>>>
>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>> brahma@apache.org>
>>>>> wrote:
>>>>>
>>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>> > <iw...@oss.nttdata.co.jp>
>>>>> > Looks all are build related issues when you try with bigtop. We can
>>>>> > discuss and prioritize this.. Will connect with you guys.
>>>>> >
>>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>>> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >>
>>>>> >> I filed HADOOP-17849 for this.
>>>>> >>
>>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>> >> > Thanks for bringing this up, Akira. Let me explain some
>>>>> background.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >
>>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>>> >> > If the fix does not break the tarball dist,
>>>>> >> > it would be nice to have these on Hadoop too.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >
>>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>>> >> packaging.
>>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>>> >> >
>>>>> >> >
>>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>> >> >> Thanks, I'll check them out.
>>>>> >> >>
>>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>> aajisaka@apache.org>
>>>>> >> wrote:
>>>>> >> >>
>>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>>> >> >>>
>>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>> 3.2.2.
>>>>> >> >>>
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>> >> >>>
>>>>> >> >>> In these patches, how about backporting the following issues to
>>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>>> >> >>> - HADOOP-14922
>>>>> >> >>> - HADOOP-15939
>>>>> >> >>> - HADOOP-17569
>>>>> >> >>>
>>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>>> ID.
>>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >>>
>>>>> >> >>> Thanks and regards,
>>>>> >> >>> Akira
>>>>> >> >>>
>>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>> hexiaoqiao@apache.org>
>>>>> >> >>> wrote:
>>>>> >> >>>>
>>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>> release
>>>>> >> happen.
>>>>> >> >>>>
>>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>>> release
>>>>> >> and
>>>>> >> >>>> trunk branch).
>>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
>>>>> Chao
>>>>> >> >>> already).
>>>>> >> >>>> once RC is out.
>>>>> >> >>>>
>>>>> >> >>>> Thanks and Regards,
>>>>> >> >>>> - He Xiaoqiao
>>>>> >> >>>>
>>>>> >> >>>>
>>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>> >> brahma@apache.org>
>>>>> >> >>>> wrote:
>>>>> >> >>>>
>>>>> >> >>>>> Hi All,
>>>>> >> >>>>>
>>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>>> to
>>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>> >> >>>>>
>>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>>> >> companies'
>>>>> >> >>>>> voices,let's know how this can go. *
>>>>> >> >>>>>
>>>>> >> >>>>> - Planning to check with downstream projects like
>>>>> Spark,HBase
>>>>> >> and
>>>>> >> >>> Hive
>>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>>> >> branch)
>>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>>> and
>>>>> >> using
>>>>> >> >>> the
>>>>> >> >>>>> branch-3.2
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>>> features
>>>>> >> >>> released
>>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>>> anybody from
>>>>> >> >>> these
>>>>> >> >>>>> communities who can help on this.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>>> >> welcome.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> --Brahma Reddy Battula
>>>>> >> >>>>>
>>>>> >> >>>
>>>>> >> >
>>>>> >> >
>>>>> ---------------------------------------------------------------------
>>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>>> >> > For additional commands, e-mail:
>>>>> common-dev-help@hadoop.apache.org
>>>>> >> >
>>>>> >>
>>>>> >
>>>>> >
>>>>> > --
>>>>> >
>>>>> >
>>>>> >
>>>>> > --Brahma Reddy Battula
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Brahma,
What is the release process going on? Is there any blocker for the RC?
-Akira
On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> The feature 'BPServiceActor processes commands from NameNode
> asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
> cherry-picking there is only minor conflict, So I checked in directly. BTW,
> run some unit tests and build pseudo cluster to verify, it seems to work
> fine.
> FYI.
>
> Regards,
> - He Xiaoqiao
>
> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Please go ahead. Let me know any help required on review.
>>
>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma,
>>>
>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>> resolved the conflict and verified them locally.
>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>> I would like to hear some more response that if we have enough time to
>>> wait for it to be ready.
>>> Thanks.
>>>
>>> Best Regards,
>>> - He Xiaoqiao
>>>
>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>>
>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>>
>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>>> can
>>>>> be done by this week,then I will try to create the RC next if there is
>>>>> no
>>>>> objection.
>>>>>
>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>> brahma@apache.org>
>>>>> wrote:
>>>>>
>>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>> > <iw...@oss.nttdata.co.jp>
>>>>> > Looks all are build related issues when you try with bigtop. We can
>>>>> > discuss and prioritize this.. Will connect with you guys.
>>>>> >
>>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>>> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >>
>>>>> >> I filed HADOOP-17849 for this.
>>>>> >>
>>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>> >> > Thanks for bringing this up, Akira. Let me explain some
>>>>> background.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >
>>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>>> >> > If the fix does not break the tarball dist,
>>>>> >> > it would be nice to have these on Hadoop too.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >
>>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>>> >> packaging.
>>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>>> >> >
>>>>> >> >
>>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>> >> >> Thanks, I'll check them out.
>>>>> >> >>
>>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>> aajisaka@apache.org>
>>>>> >> wrote:
>>>>> >> >>
>>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>>> >> >>>
>>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>> 3.2.2.
>>>>> >> >>>
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>> >> >>>
>>>>> >> >>> In these patches, how about backporting the following issues to
>>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>>> >> >>> - HADOOP-14922
>>>>> >> >>> - HADOOP-15939
>>>>> >> >>> - HADOOP-17569
>>>>> >> >>>
>>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>>> ID.
>>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >>>
>>>>> >> >>> Thanks and regards,
>>>>> >> >>> Akira
>>>>> >> >>>
>>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>> hexiaoqiao@apache.org>
>>>>> >> >>> wrote:
>>>>> >> >>>>
>>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>> release
>>>>> >> happen.
>>>>> >> >>>>
>>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>>> release
>>>>> >> and
>>>>> >> >>>> trunk branch).
>>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
>>>>> Chao
>>>>> >> >>> already).
>>>>> >> >>>> once RC is out.
>>>>> >> >>>>
>>>>> >> >>>> Thanks and Regards,
>>>>> >> >>>> - He Xiaoqiao
>>>>> >> >>>>
>>>>> >> >>>>
>>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>> >> brahma@apache.org>
>>>>> >> >>>> wrote:
>>>>> >> >>>>
>>>>> >> >>>>> Hi All,
>>>>> >> >>>>>
>>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>>> to
>>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>> >> >>>>>
>>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>>> >> companies'
>>>>> >> >>>>> voices,let's know how this can go. *
>>>>> >> >>>>>
>>>>> >> >>>>> - Planning to check with downstream projects like
>>>>> Spark,HBase
>>>>> >> and
>>>>> >> >>> Hive
>>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>>> >> branch)
>>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>>> and
>>>>> >> using
>>>>> >> >>> the
>>>>> >> >>>>> branch-3.2
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>>> features
>>>>> >> >>> released
>>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>>> anybody from
>>>>> >> >>> these
>>>>> >> >>>>> communities who can help on this.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>>> >> welcome.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> --Brahma Reddy Battula
>>>>> >> >>>>>
>>>>> >> >>>
>>>>> >> >
>>>>> >> >
>>>>> ---------------------------------------------------------------------
>>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>>> >> > For additional commands, e-mail:
>>>>> common-dev-help@hadoop.apache.org
>>>>> >> >
>>>>> >>
>>>>> >
>>>>> >
>>>>> > --
>>>>> >
>>>>> >
>>>>> >
>>>>> > --Brahma Reddy Battula
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Brahma,
What is the release process going on? Is there any blocker for the RC?
-Akira
On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> The feature 'BPServiceActor processes commands from NameNode
> asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
> cherry-picking there is only minor conflict, So I checked in directly. BTW,
> run some unit tests and build pseudo cluster to verify, it seems to work
> fine.
> FYI.
>
> Regards,
> - He Xiaoqiao
>
> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Please go ahead. Let me know any help required on review.
>>
>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma,
>>>
>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>> resolved the conflict and verified them locally.
>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>> I would like to hear some more response that if we have enough time to
>>> wait for it to be ready.
>>> Thanks.
>>>
>>> Best Regards,
>>> - He Xiaoqiao
>>>
>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>>
>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>>
>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>>> can
>>>>> be done by this week,then I will try to create the RC next if there is
>>>>> no
>>>>> objection.
>>>>>
>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>> brahma@apache.org>
>>>>> wrote:
>>>>>
>>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>> > <iw...@oss.nttdata.co.jp>
>>>>> > Looks all are build related issues when you try with bigtop. We can
>>>>> > discuss and prioritize this.. Will connect with you guys.
>>>>> >
>>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>>> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >>
>>>>> >> I filed HADOOP-17849 for this.
>>>>> >>
>>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>> >> > Thanks for bringing this up, Akira. Let me explain some
>>>>> background.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >
>>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>>> >> > If the fix does not break the tarball dist,
>>>>> >> > it would be nice to have these on Hadoop too.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >
>>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>>> >> packaging.
>>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>>> >> >
>>>>> >> >
>>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>> >> >> Thanks, I'll check them out.
>>>>> >> >>
>>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>> aajisaka@apache.org>
>>>>> >> wrote:
>>>>> >> >>
>>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>>> >> >>>
>>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>> 3.2.2.
>>>>> >> >>>
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>> >> >>>
>>>>> >> >>> In these patches, how about backporting the following issues to
>>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>>> >> >>> - HADOOP-14922
>>>>> >> >>> - HADOOP-15939
>>>>> >> >>> - HADOOP-17569
>>>>> >> >>>
>>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>>> ID.
>>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >>>
>>>>> >> >>> Thanks and regards,
>>>>> >> >>> Akira
>>>>> >> >>>
>>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>> hexiaoqiao@apache.org>
>>>>> >> >>> wrote:
>>>>> >> >>>>
>>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>> release
>>>>> >> happen.
>>>>> >> >>>>
>>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>>> release
>>>>> >> and
>>>>> >> >>>> trunk branch).
>>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
>>>>> Chao
>>>>> >> >>> already).
>>>>> >> >>>> once RC is out.
>>>>> >> >>>>
>>>>> >> >>>> Thanks and Regards,
>>>>> >> >>>> - He Xiaoqiao
>>>>> >> >>>>
>>>>> >> >>>>
>>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>> >> brahma@apache.org>
>>>>> >> >>>> wrote:
>>>>> >> >>>>
>>>>> >> >>>>> Hi All,
>>>>> >> >>>>>
>>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>>> to
>>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>> >> >>>>>
>>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>>> >> companies'
>>>>> >> >>>>> voices,let's know how this can go. *
>>>>> >> >>>>>
>>>>> >> >>>>> - Planning to check with downstream projects like
>>>>> Spark,HBase
>>>>> >> and
>>>>> >> >>> Hive
>>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>>> >> branch)
>>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>>> and
>>>>> >> using
>>>>> >> >>> the
>>>>> >> >>>>> branch-3.2
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>>> features
>>>>> >> >>> released
>>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>>> anybody from
>>>>> >> >>> these
>>>>> >> >>>>> communities who can help on this.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>>> >> welcome.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> --Brahma Reddy Battula
>>>>> >> >>>>>
>>>>> >> >>>
>>>>> >> >
>>>>> >> >
>>>>> ---------------------------------------------------------------------
>>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>>> >> > For additional commands, e-mail:
>>>>> common-dev-help@hadoop.apache.org
>>>>> >> >
>>>>> >>
>>>>> >
>>>>> >
>>>>> > --
>>>>> >
>>>>> >
>>>>> >
>>>>> > --Brahma Reddy Battula
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Hi Brahma,
What is the release process going on? Is there any blocker for the RC?
-Akira
On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> The feature 'BPServiceActor processes commands from NameNode
> asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
> cherry-picking there is only minor conflict, So I checked in directly. BTW,
> run some unit tests and build pseudo cluster to verify, it seems to work
> fine.
> FYI.
>
> Regards,
> - He Xiaoqiao
>
> On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Please go ahead. Let me know any help required on review.
>>
>> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma,
>>>
>>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>>> resolved the conflict and verified them locally.
>>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>>> I would like to hear some more response that if we have enough time to
>>> wait for it to be ready.
>>> Thanks.
>>>
>>> Best Regards,
>>> - He Xiaoqiao
>>>
>>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>>
>>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>>
>>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>>> can
>>>>> be done by this week,then I will try to create the RC next if there is
>>>>> no
>>>>> objection.
>>>>>
>>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <
>>>>> brahma@apache.org>
>>>>> wrote:
>>>>>
>>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>>> > <iw...@oss.nttdata.co.jp>
>>>>> > Looks all are build related issues when you try with bigtop. We can
>>>>> > discuss and prioritize this.. Will connect with you guys.
>>>>> >
>>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>>> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >>
>>>>> >> I filed HADOOP-17849 for this.
>>>>> >>
>>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>>> >> > Thanks for bringing this up, Akira. Let me explain some
>>>>> background.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >
>>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>>> zooekeper-3.4.13,
>>>>> >> > while it would be harmless to add the exclusion even for
>>>>> >> zooekeeper-3.4.13.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >
>>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>>> >> > If the fix does not break the tarball dist,
>>>>> >> > it would be nice to have these on Hadoop too.
>>>>> >> >
>>>>> >> >
>>>>> >> >> -
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >
>>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>>> >> packaging.
>>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>>> >> >
>>>>> >> >
>>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>>> >> >> Thanks, I'll check them out.
>>>>> >> >>
>>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>>> aajisaka@apache.org>
>>>>> >> wrote:
>>>>> >> >>
>>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>>> >> >>>
>>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop
>>>>> 3.2.2.
>>>>> >> >>>
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>>> >> >>>
>>>>> >> >>> In these patches, how about backporting the following issues to
>>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>>> >> >>> - HADOOP-14922
>>>>> >> >>> - HADOOP-15939
>>>>> >> >>> - HADOOP-17569
>>>>> >> >>>
>>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>>> ID.
>>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>>> >> >>> -
>>>>> >> >>>
>>>>> >>
>>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>>> >> >>>
>>>>> >> >>> Thanks and regards,
>>>>> >> >>> Akira
>>>>> >> >>>
>>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>>> hexiaoqiao@apache.org>
>>>>> >> >>> wrote:
>>>>> >> >>>>
>>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>>> release
>>>>> >> happen.
>>>>> >> >>>>
>>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>>> release
>>>>> >> and
>>>>> >> >>>> trunk branch).
>>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with
>>>>> Chao
>>>>> >> >>> already).
>>>>> >> >>>> once RC is out.
>>>>> >> >>>>
>>>>> >> >>>> Thanks and Regards,
>>>>> >> >>>> - He Xiaoqiao
>>>>> >> >>>>
>>>>> >> >>>>
>>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>>> >> brahma@apache.org>
>>>>> >> >>>> wrote:
>>>>> >> >>>>
>>>>> >> >>>>> Hi All,
>>>>> >> >>>>>
>>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>>> to
>>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>> >> >>>>>
>>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>>> >> companies'
>>>>> >> >>>>> voices,let's know how this can go. *
>>>>> >> >>>>>
>>>>> >> >>>>> - Planning to check with downstream projects like
>>>>> Spark,HBase
>>>>> >> and
>>>>> >> >>> Hive
>>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>>> >> branch)
>>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>>> and
>>>>> >> using
>>>>> >> >>> the
>>>>> >> >>>>> branch-3.2
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>>> features
>>>>> >> >>> released
>>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>>> anybody from
>>>>> >> >>> these
>>>>> >> >>>>> communities who can help on this.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>>> >> welcome.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> --Brahma Reddy Battula
>>>>> >> >>>>>
>>>>> >> >>>
>>>>> >> >
>>>>> >> >
>>>>> ---------------------------------------------------------------------
>>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>>> >> > For additional commands, e-mail:
>>>>> common-dev-help@hadoop.apache.org
>>>>> >> >
>>>>> >>
>>>>> >
>>>>> >
>>>>> > --
>>>>> >
>>>>> >
>>>>> >
>>>>> > --Brahma Reddy Battula
>>>>> >
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
The feature 'BPServiceActor processes commands from NameNode
asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
cherry-picking there is only minor conflict, So I checked in directly. BTW,
run some unit tests and build pseudo cluster to verify, it seems to work
fine.
FYI.
Regards,
- He Xiaoqiao
On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Please go ahead. Let me know any help required on review.
>
> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma,
>>
>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>> resolved the conflict and verified them locally.
>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>> I would like to hear some more response that if we have enough time to
>> wait for it to be ready.
>> Thanks.
>>
>> Best Regards,
>> - He Xiaoqiao
>>
>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>
>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>> can
>>>> be done by this week,then I will try to create the RC next if there is
>>>> no
>>>> objection.
>>>>
>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>
>>>>
>>>>
>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <brahma@apache.org
>>>> >
>>>> wrote:
>>>>
>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>> > <iw...@oss.nttdata.co.jp>
>>>> > Looks all are build related issues when you try with bigtop. We can
>>>> > discuss and prioritize this.. Will connect with you guys.
>>>> >
>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >>
>>>> >> I filed HADOOP-17849 for this.
>>>> >>
>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >
>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>> >> > If the fix does not break the tarball dist,
>>>> >> > it would be nice to have these on Hadoop too.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >
>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>> >> packaging.
>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>> >> >
>>>> >> >
>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>> >> >> Thanks, I'll check them out.
>>>> >> >>
>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>> aajisaka@apache.org>
>>>> >> wrote:
>>>> >> >>
>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>> >> >>>
>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>> >> >>>
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>> >> >>>
>>>> >> >>> In these patches, how about backporting the following issues to
>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>> >> >>> - HADOOP-14922
>>>> >> >>> - HADOOP-15939
>>>> >> >>> - HADOOP-17569
>>>> >> >>>
>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>> ID.
>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >>>
>>>> >> >>> Thanks and regards,
>>>> >> >>> Akira
>>>> >> >>>
>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>> hexiaoqiao@apache.org>
>>>> >> >>> wrote:
>>>> >> >>>>
>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>> release
>>>> >> happen.
>>>> >> >>>>
>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>> release
>>>> >> and
>>>> >> >>>> trunk branch).
>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>>> >> >>> already).
>>>> >> >>>> once RC is out.
>>>> >> >>>>
>>>> >> >>>> Thanks and Regards,
>>>> >> >>>> - He Xiaoqiao
>>>> >> >>>>
>>>> >> >>>>
>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>> >> brahma@apache.org>
>>>> >> >>>> wrote:
>>>> >> >>>>
>>>> >> >>>>> Hi All,
>>>> >> >>>>>
>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>> to
>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>> >> >>>>>
>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>> >> companies'
>>>> >> >>>>> voices,let's know how this can go. *
>>>> >> >>>>>
>>>> >> >>>>> - Planning to check with downstream projects like
>>>> Spark,HBase
>>>> >> and
>>>> >> >>> Hive
>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>> >> branch)
>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>> and
>>>> >> using
>>>> >> >>> the
>>>> >> >>>>> branch-3.2
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>> features
>>>> >> >>> released
>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>> anybody from
>>>> >> >>> these
>>>> >> >>>>> communities who can help on this.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>> >> welcome.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> --Brahma Reddy Battula
>>>> >> >>>>>
>>>> >> >>>
>>>> >> >
>>>> >> >
>>>> ---------------------------------------------------------------------
>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>> >> >
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> >
>>>> >
>>>> > --Brahma Reddy Battula
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
The feature 'BPServiceActor processes commands from NameNode
asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
cherry-picking there is only minor conflict, So I checked in directly. BTW,
run some unit tests and build pseudo cluster to verify, it seems to work
fine.
FYI.
Regards,
- He Xiaoqiao
On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Please go ahead. Let me know any help required on review.
>
> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma,
>>
>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>> resolved the conflict and verified them locally.
>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>> I would like to hear some more response that if we have enough time to
>> wait for it to be ready.
>> Thanks.
>>
>> Best Regards,
>> - He Xiaoqiao
>>
>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>
>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>> can
>>>> be done by this week,then I will try to create the RC next if there is
>>>> no
>>>> objection.
>>>>
>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>
>>>>
>>>>
>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <brahma@apache.org
>>>> >
>>>> wrote:
>>>>
>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>> > <iw...@oss.nttdata.co.jp>
>>>> > Looks all are build related issues when you try with bigtop. We can
>>>> > discuss and prioritize this.. Will connect with you guys.
>>>> >
>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >>
>>>> >> I filed HADOOP-17849 for this.
>>>> >>
>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >
>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>> >> > If the fix does not break the tarball dist,
>>>> >> > it would be nice to have these on Hadoop too.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >
>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>> >> packaging.
>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>> >> >
>>>> >> >
>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>> >> >> Thanks, I'll check them out.
>>>> >> >>
>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>> aajisaka@apache.org>
>>>> >> wrote:
>>>> >> >>
>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>> >> >>>
>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>> >> >>>
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>> >> >>>
>>>> >> >>> In these patches, how about backporting the following issues to
>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>> >> >>> - HADOOP-14922
>>>> >> >>> - HADOOP-15939
>>>> >> >>> - HADOOP-17569
>>>> >> >>>
>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>> ID.
>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >>>
>>>> >> >>> Thanks and regards,
>>>> >> >>> Akira
>>>> >> >>>
>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>> hexiaoqiao@apache.org>
>>>> >> >>> wrote:
>>>> >> >>>>
>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>> release
>>>> >> happen.
>>>> >> >>>>
>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>> release
>>>> >> and
>>>> >> >>>> trunk branch).
>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>>> >> >>> already).
>>>> >> >>>> once RC is out.
>>>> >> >>>>
>>>> >> >>>> Thanks and Regards,
>>>> >> >>>> - He Xiaoqiao
>>>> >> >>>>
>>>> >> >>>>
>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>> >> brahma@apache.org>
>>>> >> >>>> wrote:
>>>> >> >>>>
>>>> >> >>>>> Hi All,
>>>> >> >>>>>
>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>> to
>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>> >> >>>>>
>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>> >> companies'
>>>> >> >>>>> voices,let's know how this can go. *
>>>> >> >>>>>
>>>> >> >>>>> - Planning to check with downstream projects like
>>>> Spark,HBase
>>>> >> and
>>>> >> >>> Hive
>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>> >> branch)
>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>> and
>>>> >> using
>>>> >> >>> the
>>>> >> >>>>> branch-3.2
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>> features
>>>> >> >>> released
>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>> anybody from
>>>> >> >>> these
>>>> >> >>>>> communities who can help on this.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>> >> welcome.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> --Brahma Reddy Battula
>>>> >> >>>>>
>>>> >> >>>
>>>> >> >
>>>> >> >
>>>> ---------------------------------------------------------------------
>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>> >> >
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> >
>>>> >
>>>> > --Brahma Reddy Battula
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
The feature 'BPServiceActor processes commands from NameNode
asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
cherry-picking there is only minor conflict, So I checked in directly. BTW,
run some unit tests and build pseudo cluster to verify, it seems to work
fine.
FYI.
Regards,
- He Xiaoqiao
On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Please go ahead. Let me know any help required on review.
>
> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma,
>>
>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>> resolved the conflict and verified them locally.
>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>> I would like to hear some more response that if we have enough time to
>> wait for it to be ready.
>> Thanks.
>>
>> Best Regards,
>> - He Xiaoqiao
>>
>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>
>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>> can
>>>> be done by this week,then I will try to create the RC next if there is
>>>> no
>>>> objection.
>>>>
>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>
>>>>
>>>>
>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <brahma@apache.org
>>>> >
>>>> wrote:
>>>>
>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>> > <iw...@oss.nttdata.co.jp>
>>>> > Looks all are build related issues when you try with bigtop. We can
>>>> > discuss and prioritize this.. Will connect with you guys.
>>>> >
>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >>
>>>> >> I filed HADOOP-17849 for this.
>>>> >>
>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >
>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>> >> > If the fix does not break the tarball dist,
>>>> >> > it would be nice to have these on Hadoop too.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >
>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>> >> packaging.
>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>> >> >
>>>> >> >
>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>> >> >> Thanks, I'll check them out.
>>>> >> >>
>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>> aajisaka@apache.org>
>>>> >> wrote:
>>>> >> >>
>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>> >> >>>
>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>> >> >>>
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>> >> >>>
>>>> >> >>> In these patches, how about backporting the following issues to
>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>> >> >>> - HADOOP-14922
>>>> >> >>> - HADOOP-15939
>>>> >> >>> - HADOOP-17569
>>>> >> >>>
>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>> ID.
>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >>>
>>>> >> >>> Thanks and regards,
>>>> >> >>> Akira
>>>> >> >>>
>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>> hexiaoqiao@apache.org>
>>>> >> >>> wrote:
>>>> >> >>>>
>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>> release
>>>> >> happen.
>>>> >> >>>>
>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>> release
>>>> >> and
>>>> >> >>>> trunk branch).
>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>>> >> >>> already).
>>>> >> >>>> once RC is out.
>>>> >> >>>>
>>>> >> >>>> Thanks and Regards,
>>>> >> >>>> - He Xiaoqiao
>>>> >> >>>>
>>>> >> >>>>
>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>> >> brahma@apache.org>
>>>> >> >>>> wrote:
>>>> >> >>>>
>>>> >> >>>>> Hi All,
>>>> >> >>>>>
>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>> to
>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>> >> >>>>>
>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>> >> companies'
>>>> >> >>>>> voices,let's know how this can go. *
>>>> >> >>>>>
>>>> >> >>>>> - Planning to check with downstream projects like
>>>> Spark,HBase
>>>> >> and
>>>> >> >>> Hive
>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>> >> branch)
>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>> and
>>>> >> using
>>>> >> >>> the
>>>> >> >>>>> branch-3.2
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>> features
>>>> >> >>> released
>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>> anybody from
>>>> >> >>> these
>>>> >> >>>>> communities who can help on this.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>> >> welcome.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> --Brahma Reddy Battula
>>>> >> >>>>>
>>>> >> >>>
>>>> >> >
>>>> >> >
>>>> ---------------------------------------------------------------------
>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>> >> >
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> >
>>>> >
>>>> > --Brahma Reddy Battula
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
The feature 'BPServiceActor processes commands from NameNode
asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While
cherry-picking there is only minor conflict, So I checked in directly. BTW,
run some unit tests and build pseudo cluster to verify, it seems to work
fine.
FYI.
Regards,
- He Xiaoqiao
On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Please go ahead. Let me know any help required on review.
>
> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma,
>>
>> I plan to involve HDFS-14997 and related JIRAs if possible. I have
>> resolved the conflict and verified them locally.
>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
>> I would like to hear some more response that if we have enough time to
>> wait for it to be ready.
>> Thanks.
>>
>> Best Regards,
>> - He Xiaoqiao
>>
>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>>
>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>>
>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>>> can
>>>> be done by this week,then I will try to create the RC next if there is
>>>> no
>>>> objection.
>>>>
>>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>>
>>>>
>>>>
>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <brahma@apache.org
>>>> >
>>>> wrote:
>>>>
>>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>>> > <iw...@oss.nttdata.co.jp>
>>>> > Looks all are build related issues when you try with bigtop. We can
>>>> > discuss and prioritize this.. Will connect with you guys.
>>>> >
>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>>> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >>
>>>> >> I filed HADOOP-17849 for this.
>>>> >>
>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >
>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>>> >> > we do not see the issue usually since branch-3.2 uses
>>>> zooekeper-3.4.13,
>>>> >> > while it would be harmless to add the exclusion even for
>>>> >> zooekeeper-3.4.13.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >
>>>> >> > These are relevant to directory structure used by Bigtop package.
>>>> >> > If the fix does not break the tarball dist,
>>>> >> > it would be nice to have these on Hadoop too.
>>>> >> >
>>>> >> >
>>>> >> >> -
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >
>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>>> >> packaging.
>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>>> >> >
>>>> >> >
>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>>> >> >> Thanks, I'll check them out.
>>>> >> >>
>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>>> aajisaka@apache.org>
>>>> >> wrote:
>>>> >> >>
>>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>>> >> >>>
>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>> >> >>>
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>> >> >>>
>>>> >> >>> In these patches, how about backporting the following issues to
>>>> >> >>> branch-3.2 and branch-3.2.3?
>>>> >> >>> - HADOOP-14922
>>>> >> >>> - HADOOP-15939
>>>> >> >>> - HADOOP-17569
>>>> >> >>>
>>>> >> >>> In addition, there are some patches that don't have JIRA issue
>>>> ID.
>>>> >> >>> Maybe we need to create JIRAs and fix those.
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>>> >> >>> -
>>>> >> >>>
>>>> >>
>>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>> >> >>>
>>>> >> >>> Thanks and regards,
>>>> >> >>> Akira
>>>> >> >>>
>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>>> hexiaoqiao@apache.org>
>>>> >> >>> wrote:
>>>> >> >>>>
>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3
>>>> release
>>>> >> happen.
>>>> >> >>>>
>>>> >> >>>> I would like to validate the HBase project (both the latest
>>>> release
>>>> >> and
>>>> >> >>>> trunk branch).
>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>>> >> >>> already).
>>>> >> >>>> once RC is out.
>>>> >> >>>>
>>>> >> >>>> Thanks and Regards,
>>>> >> >>>> - He Xiaoqiao
>>>> >> >>>>
>>>> >> >>>>
>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>>> >> brahma@apache.org>
>>>> >> >>>> wrote:
>>>> >> >>>>
>>>> >> >>>>> Hi All,
>>>> >> >>>>>
>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit
>>>> to
>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>> >> >>>>>
>>>> >> >>>>> *This time I am thinking of having downstream projects and
>>>> >> companies'
>>>> >> >>>>> voices,let's know how this can go. *
>>>> >> >>>>>
>>>> >> >>>>> - Planning to check with downstream projects like
>>>> Spark,HBase
>>>> >> and
>>>> >> >>> Hive
>>>> >> >>>>> if they can help on validation(Or running their UT on this
>>>> >> branch)
>>>> >> >>>>> - Collecting info from Companies who are already deployed
>>>> and
>>>> >> using
>>>> >> >>> the
>>>> >> >>>>> branch-3.2
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>>> features
>>>> >> >>> released
>>>> >> >>>>> on this branch impact can be known) ,please let me know
>>>> anybody from
>>>> >> >>> these
>>>> >> >>>>> communities who can help on this.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>>> >> welcome.
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>>
>>>> >> >>>>> --Brahma Reddy Battula
>>>> >> >>>>>
>>>> >> >>>
>>>> >> >
>>>> >> >
>>>> ---------------------------------------------------------------------
>>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>> >> >
>>>> >>
>>>> >
>>>> >
>>>> > --
>>>> >
>>>> >
>>>> >
>>>> > --Brahma Reddy Battula
>>>> >
>>>>
>>>>
>>>> --
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Please go ahead. Let me know any help required on review.
On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> resolved the conflict and verified them locally.
> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> I would like to hear some more response that if we have enough time to
> wait for it to be ready.
> Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>
>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi All,
>>>
>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>> can
>>> be done by this week,then I will try to create the RC next if there is no
>>> objection.
>>>
>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>
>>>
>>>
>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>> > <iw...@oss.nttdata.co.jp>
>>> > Looks all are build related issues when you try with bigtop. We can
>>> > discuss and prioritize this.. Will connect with you guys.
>>> >
>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >>
>>> >> I filed HADOOP-17849 for this.
>>> >>
>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >
>>> >> > These are relevant to directory structure used by Bigtop package.
>>> >> > If the fix does not break the tarball dist,
>>> >> > it would be nice to have these on Hadoop too.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >
>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>> >> packaging.
>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>> >> >
>>> >> >
>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>> >> >> Thanks, I'll check them out.
>>> >> >>
>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>> aajisaka@apache.org>
>>> >> wrote:
>>> >> >>
>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>> >> >>>
>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>> >> >>>
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>> >> >>>
>>> >> >>> In these patches, how about backporting the following issues to
>>> >> >>> branch-3.2 and branch-3.2.3?
>>> >> >>> - HADOOP-14922
>>> >> >>> - HADOOP-15939
>>> >> >>> - HADOOP-17569
>>> >> >>>
>>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>>> >> >>> Maybe we need to create JIRAs and fix those.
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >>>
>>> >> >>> Thanks and regards,
>>> >> >>> Akira
>>> >> >>>
>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>> hexiaoqiao@apache.org>
>>> >> >>> wrote:
>>> >> >>>>
>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>>> >> happen.
>>> >> >>>>
>>> >> >>>> I would like to validate the HBase project (both the latest
>>> release
>>> >> and
>>> >> >>>> trunk branch).
>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> >> >>> already).
>>> >> >>>> once RC is out.
>>> >> >>>>
>>> >> >>>> Thanks and Regards,
>>> >> >>>> - He Xiaoqiao
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>> >> brahma@apache.org>
>>> >> >>>> wrote:
>>> >> >>>>
>>> >> >>>>> Hi All,
>>> >> >>>>>
>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>> >> >>>>>
>>> >> >>>>> *This time I am thinking of having downstream projects and
>>> >> companies'
>>> >> >>>>> voices,let's know how this can go. *
>>> >> >>>>>
>>> >> >>>>> - Planning to check with downstream projects like
>>> Spark,HBase
>>> >> and
>>> >> >>> Hive
>>> >> >>>>> if they can help on validation(Or running their UT on this
>>> >> branch)
>>> >> >>>>> - Collecting info from Companies who are already deployed
>>> and
>>> >> using
>>> >> >>> the
>>> >> >>>>> branch-3.2
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>> features
>>> >> >>> released
>>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>>> from
>>> >> >>> these
>>> >> >>>>> communities who can help on this.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>> >> welcome.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> --Brahma Reddy Battula
>>> >> >>>>>
>>> >> >>>
>>> >> >
>>> >> >
>>> ---------------------------------------------------------------------
>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>> >> >
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> >
>>> >
>>> > --Brahma Reddy Battula
>>> >
>>>
>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Please go ahead. Let me know any help required on review.
On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> resolved the conflict and verified them locally.
> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> I would like to hear some more response that if we have enough time to
> wait for it to be ready.
> Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>
>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi All,
>>>
>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>> can
>>> be done by this week,then I will try to create the RC next if there is no
>>> objection.
>>>
>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>
>>>
>>>
>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>> > <iw...@oss.nttdata.co.jp>
>>> > Looks all are build related issues when you try with bigtop. We can
>>> > discuss and prioritize this.. Will connect with you guys.
>>> >
>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >>
>>> >> I filed HADOOP-17849 for this.
>>> >>
>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >
>>> >> > These are relevant to directory structure used by Bigtop package.
>>> >> > If the fix does not break the tarball dist,
>>> >> > it would be nice to have these on Hadoop too.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >
>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>> >> packaging.
>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>> >> >
>>> >> >
>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>> >> >> Thanks, I'll check them out.
>>> >> >>
>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>> aajisaka@apache.org>
>>> >> wrote:
>>> >> >>
>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>> >> >>>
>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>> >> >>>
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>> >> >>>
>>> >> >>> In these patches, how about backporting the following issues to
>>> >> >>> branch-3.2 and branch-3.2.3?
>>> >> >>> - HADOOP-14922
>>> >> >>> - HADOOP-15939
>>> >> >>> - HADOOP-17569
>>> >> >>>
>>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>>> >> >>> Maybe we need to create JIRAs and fix those.
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >>>
>>> >> >>> Thanks and regards,
>>> >> >>> Akira
>>> >> >>>
>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>> hexiaoqiao@apache.org>
>>> >> >>> wrote:
>>> >> >>>>
>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>>> >> happen.
>>> >> >>>>
>>> >> >>>> I would like to validate the HBase project (both the latest
>>> release
>>> >> and
>>> >> >>>> trunk branch).
>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> >> >>> already).
>>> >> >>>> once RC is out.
>>> >> >>>>
>>> >> >>>> Thanks and Regards,
>>> >> >>>> - He Xiaoqiao
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>> >> brahma@apache.org>
>>> >> >>>> wrote:
>>> >> >>>>
>>> >> >>>>> Hi All,
>>> >> >>>>>
>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>> >> >>>>>
>>> >> >>>>> *This time I am thinking of having downstream projects and
>>> >> companies'
>>> >> >>>>> voices,let's know how this can go. *
>>> >> >>>>>
>>> >> >>>>> - Planning to check with downstream projects like
>>> Spark,HBase
>>> >> and
>>> >> >>> Hive
>>> >> >>>>> if they can help on validation(Or running their UT on this
>>> >> branch)
>>> >> >>>>> - Collecting info from Companies who are already deployed
>>> and
>>> >> using
>>> >> >>> the
>>> >> >>>>> branch-3.2
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>> features
>>> >> >>> released
>>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>>> from
>>> >> >>> these
>>> >> >>>>> communities who can help on this.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>> >> welcome.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> --Brahma Reddy Battula
>>> >> >>>>>
>>> >> >>>
>>> >> >
>>> >> >
>>> ---------------------------------------------------------------------
>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>> >> >
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> >
>>> >
>>> > --Brahma Reddy Battula
>>> >
>>>
>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Please go ahead. Let me know any help required on review.
On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> resolved the conflict and verified them locally.
> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> I would like to hear some more response that if we have enough time to
> wait for it to be ready.
> Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>
>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi All,
>>>
>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>> can
>>> be done by this week,then I will try to create the RC next if there is no
>>> objection.
>>>
>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>
>>>
>>>
>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>> > <iw...@oss.nttdata.co.jp>
>>> > Looks all are build related issues when you try with bigtop. We can
>>> > discuss and prioritize this.. Will connect with you guys.
>>> >
>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >>
>>> >> I filed HADOOP-17849 for this.
>>> >>
>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >
>>> >> > These are relevant to directory structure used by Bigtop package.
>>> >> > If the fix does not break the tarball dist,
>>> >> > it would be nice to have these on Hadoop too.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >
>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>> >> packaging.
>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>> >> >
>>> >> >
>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>> >> >> Thanks, I'll check them out.
>>> >> >>
>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>> aajisaka@apache.org>
>>> >> wrote:
>>> >> >>
>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>> >> >>>
>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>> >> >>>
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>> >> >>>
>>> >> >>> In these patches, how about backporting the following issues to
>>> >> >>> branch-3.2 and branch-3.2.3?
>>> >> >>> - HADOOP-14922
>>> >> >>> - HADOOP-15939
>>> >> >>> - HADOOP-17569
>>> >> >>>
>>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>>> >> >>> Maybe we need to create JIRAs and fix those.
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >>>
>>> >> >>> Thanks and regards,
>>> >> >>> Akira
>>> >> >>>
>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>> hexiaoqiao@apache.org>
>>> >> >>> wrote:
>>> >> >>>>
>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>>> >> happen.
>>> >> >>>>
>>> >> >>>> I would like to validate the HBase project (both the latest
>>> release
>>> >> and
>>> >> >>>> trunk branch).
>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> >> >>> already).
>>> >> >>>> once RC is out.
>>> >> >>>>
>>> >> >>>> Thanks and Regards,
>>> >> >>>> - He Xiaoqiao
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>> >> brahma@apache.org>
>>> >> >>>> wrote:
>>> >> >>>>
>>> >> >>>>> Hi All,
>>> >> >>>>>
>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>> >> >>>>>
>>> >> >>>>> *This time I am thinking of having downstream projects and
>>> >> companies'
>>> >> >>>>> voices,let's know how this can go. *
>>> >> >>>>>
>>> >> >>>>> - Planning to check with downstream projects like
>>> Spark,HBase
>>> >> and
>>> >> >>> Hive
>>> >> >>>>> if they can help on validation(Or running their UT on this
>>> >> branch)
>>> >> >>>>> - Collecting info from Companies who are already deployed
>>> and
>>> >> using
>>> >> >>> the
>>> >> >>>>> branch-3.2
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>> features
>>> >> >>> released
>>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>>> from
>>> >> >>> these
>>> >> >>>>> communities who can help on this.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>> >> welcome.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> --Brahma Reddy Battula
>>> >> >>>>>
>>> >> >>>
>>> >> >
>>> >> >
>>> ---------------------------------------------------------------------
>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>> >> >
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> >
>>> >
>>> > --Brahma Reddy Battula
>>> >
>>>
>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Please go ahead. Let me know any help required on review.
On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma,
>
> I plan to involve HDFS-14997 and related JIRAs if possible. I have
> resolved the conflict and verified them locally.
> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
> I would like to hear some more response that if we have enough time to
> wait for it to be ready.
> Thanks.
>
> Best Regards,
> - He Xiaoqiao
>
> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
>
>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>>
>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>>> Hi All,
>>>
>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this
>>> can
>>> be done by this week,then I will try to create the RC next if there is no
>>> objection.
>>>
>>> https://issues.apache.org/jira/browse/HDFS-15160
>>>
>>>
>>>
>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>>> > <iw...@oss.nttdata.co.jp>
>>> > Looks all are build related issues when you try with bigtop. We can
>>> > discuss and prioritize this.. Will connect with you guys.
>>> >
>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>>> > iwasakims@oss.nttdata.co.jp> wrote:
>>> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >>
>>> >> I filed HADOOP-17849 for this.
>>> >>
>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >
>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>>> >> > we do not see the issue usually since branch-3.2 uses
>>> zooekeper-3.4.13,
>>> >> > while it would be harmless to add the exclusion even for
>>> >> zooekeeper-3.4.13.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >
>>> >> > These are relevant to directory structure used by Bigtop package.
>>> >> > If the fix does not break the tarball dist,
>>> >> > it would be nice to have these on Hadoop too.
>>> >> >
>>> >> >
>>> >> >> -
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >
>>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>>> >> packaging.
>>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>>> >> >
>>> >> >
>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>>> >> >> Thanks, I'll check them out.
>>> >> >>
>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <
>>> aajisaka@apache.org>
>>> >> wrote:
>>> >> >>
>>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>>> >> >>>
>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>> >> >>>
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>> >> >>>
>>> >> >>> In these patches, how about backporting the following issues to
>>> >> >>> branch-3.2 and branch-3.2.3?
>>> >> >>> - HADOOP-14922
>>> >> >>> - HADOOP-15939
>>> >> >>> - HADOOP-17569
>>> >> >>>
>>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>>> >> >>> Maybe we need to create JIRAs and fix those.
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> >> >>> -
>>> >> >>>
>>> >>
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>> >> >>>
>>> >> >>> Thanks and regards,
>>> >> >>> Akira
>>> >> >>>
>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>>> hexiaoqiao@apache.org>
>>> >> >>> wrote:
>>> >> >>>>
>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>>> >> happen.
>>> >> >>>>
>>> >> >>>> I would like to validate the HBase project (both the latest
>>> release
>>> >> and
>>> >> >>>> trunk branch).
>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> >> >>> already).
>>> >> >>>> once RC is out.
>>> >> >>>>
>>> >> >>>> Thanks and Regards,
>>> >> >>>> - He Xiaoqiao
>>> >> >>>>
>>> >> >>>>
>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>>> >> brahma@apache.org>
>>> >> >>>> wrote:
>>> >> >>>>
>>> >> >>>>> Hi All,
>>> >> >>>>>
>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>> >> >>>>>
>>> >> >>>>> *This time I am thinking of having downstream projects and
>>> >> companies'
>>> >> >>>>> voices,let's know how this can go. *
>>> >> >>>>>
>>> >> >>>>> - Planning to check with downstream projects like
>>> Spark,HBase
>>> >> and
>>> >> >>> Hive
>>> >> >>>>> if they can help on validation(Or running their UT on this
>>> >> branch)
>>> >> >>>>> - Collecting info from Companies who are already deployed
>>> and
>>> >> using
>>> >> >>> the
>>> >> >>>>> branch-3.2
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>>> features
>>> >> >>> released
>>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>>> from
>>> >> >>> these
>>> >> >>>>> communities who can help on this.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>>> >> welcome.
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>>
>>> >> >>>>> --Brahma Reddy Battula
>>> >> >>>>>
>>> >> >>>
>>> >> >
>>> >> >
>>> ---------------------------------------------------------------------
>>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>> >> >
>>> >>
>>> >
>>> >
>>> > --
>>> >
>>> >
>>> >
>>> > --Brahma Reddy Battula
>>> >
>>>
>>>
>>> --
>>>
>>>
>>>
>>> --Brahma Reddy Battula
>>>
>>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
I plan to involve HDFS-14997 and related JIRAs if possible. I have resolved
the conflict and verified them locally.
It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
I would like to hear some more response that if we have enough time to wait
for it to be ready.
Thanks.
Best Regards,
- He Xiaoqiao
On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>
> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Hi All,
>>
>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
>> be done by this week,then I will try to create the RC next if there is no
>> objection.
>>
>> https://issues.apache.org/jira/browse/HDFS-15160
>>
>>
>>
>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>> > <iw...@oss.nttdata.co.jp>
>> > Looks all are build related issues when you try with bigtop. We can
>> > discuss and prioritize this.. Will connect with you guys.
>> >
>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>> > iwasakims@oss.nttdata.co.jp> wrote:
>> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >>
>> >> I filed HADOOP-17849 for this.
>> >>
>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >
>> >> > These are relevant to directory structure used by Bigtop package.
>> >> > If the fix does not break the tarball dist,
>> >> > it would be nice to have these on Hadoop too.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >
>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> >> packaging.
>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >> >
>> >> >
>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> >> Thanks, I'll check them out.
>> >> >>
>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aajisaka@apache.org
>> >
>> >> wrote:
>> >> >>
>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>> >> >>>
>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >> >>>
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >> >>>
>> >> >>> In these patches, how about backporting the following issues to
>> >> >>> branch-3.2 and branch-3.2.3?
>> >> >>> - HADOOP-14922
>> >> >>> - HADOOP-15939
>> >> >>> - HADOOP-17569
>> >> >>>
>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >> >>> Maybe we need to create JIRAs and fix those.
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >>>
>> >> >>> Thanks and regards,
>> >> >>> Akira
>> >> >>>
>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>> hexiaoqiao@apache.org>
>> >> >>> wrote:
>> >> >>>>
>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> >> happen.
>> >> >>>>
>> >> >>>> I would like to validate the HBase project (both the latest
>> release
>> >> and
>> >> >>>> trunk branch).
>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >> >>> already).
>> >> >>>> once RC is out.
>> >> >>>>
>> >> >>>> Thanks and Regards,
>> >> >>>> - He Xiaoqiao
>> >> >>>>
>> >> >>>>
>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> >>>> wrote:
>> >> >>>>
>> >> >>>>> Hi All,
>> >> >>>>>
>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >> >>>>>
>> >> >>>>> *This time I am thinking of having downstream projects and
>> >> companies'
>> >> >>>>> voices,let's know how this can go. *
>> >> >>>>>
>> >> >>>>> - Planning to check with downstream projects like Spark,HBase
>> >> and
>> >> >>> Hive
>> >> >>>>> if they can help on validation(Or running their UT on this
>> >> branch)
>> >> >>>>> - Collecting info from Companies who are already deployed and
>> >> using
>> >> >>> the
>> >> >>>>> branch-3.2
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>> features
>> >> >>> released
>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>> from
>> >> >>> these
>> >> >>>>> communities who can help on this.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>> >> welcome.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> --Brahma Reddy Battula
>> >> >>>>>
>> >> >>>
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >> >
>> >>
>> >
>> >
>> > --
>> >
>> >
>> >
>> > --Brahma Reddy Battula
>> >
>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
I plan to involve HDFS-14997 and related JIRAs if possible. I have resolved
the conflict and verified them locally.
It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
I would like to hear some more response that if we have enough time to wait
for it to be ready.
Thanks.
Best Regards,
- He Xiaoqiao
On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>
> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Hi All,
>>
>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
>> be done by this week,then I will try to create the RC next if there is no
>> objection.
>>
>> https://issues.apache.org/jira/browse/HDFS-15160
>>
>>
>>
>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>> > <iw...@oss.nttdata.co.jp>
>> > Looks all are build related issues when you try with bigtop. We can
>> > discuss and prioritize this.. Will connect with you guys.
>> >
>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>> > iwasakims@oss.nttdata.co.jp> wrote:
>> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >>
>> >> I filed HADOOP-17849 for this.
>> >>
>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >
>> >> > These are relevant to directory structure used by Bigtop package.
>> >> > If the fix does not break the tarball dist,
>> >> > it would be nice to have these on Hadoop too.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >
>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> >> packaging.
>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >> >
>> >> >
>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> >> Thanks, I'll check them out.
>> >> >>
>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aajisaka@apache.org
>> >
>> >> wrote:
>> >> >>
>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>> >> >>>
>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >> >>>
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >> >>>
>> >> >>> In these patches, how about backporting the following issues to
>> >> >>> branch-3.2 and branch-3.2.3?
>> >> >>> - HADOOP-14922
>> >> >>> - HADOOP-15939
>> >> >>> - HADOOP-17569
>> >> >>>
>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >> >>> Maybe we need to create JIRAs and fix those.
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >>>
>> >> >>> Thanks and regards,
>> >> >>> Akira
>> >> >>>
>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>> hexiaoqiao@apache.org>
>> >> >>> wrote:
>> >> >>>>
>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> >> happen.
>> >> >>>>
>> >> >>>> I would like to validate the HBase project (both the latest
>> release
>> >> and
>> >> >>>> trunk branch).
>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >> >>> already).
>> >> >>>> once RC is out.
>> >> >>>>
>> >> >>>> Thanks and Regards,
>> >> >>>> - He Xiaoqiao
>> >> >>>>
>> >> >>>>
>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> >>>> wrote:
>> >> >>>>
>> >> >>>>> Hi All,
>> >> >>>>>
>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >> >>>>>
>> >> >>>>> *This time I am thinking of having downstream projects and
>> >> companies'
>> >> >>>>> voices,let's know how this can go. *
>> >> >>>>>
>> >> >>>>> - Planning to check with downstream projects like Spark,HBase
>> >> and
>> >> >>> Hive
>> >> >>>>> if they can help on validation(Or running their UT on this
>> >> branch)
>> >> >>>>> - Collecting info from Companies who are already deployed and
>> >> using
>> >> >>> the
>> >> >>>>> branch-3.2
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>> features
>> >> >>> released
>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>> from
>> >> >>> these
>> >> >>>>> communities who can help on this.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>> >> welcome.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> --Brahma Reddy Battula
>> >> >>>>>
>> >> >>>
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >> >
>> >>
>> >
>> >
>> > --
>> >
>> >
>> >
>> > --Brahma Reddy Battula
>> >
>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
I plan to involve HDFS-14997 and related JIRAs if possible. I have resolved
the conflict and verified them locally.
It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
I would like to hear some more response that if we have enough time to wait
for it to be ready.
Thanks.
Best Regards,
- He Xiaoqiao
On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>
> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Hi All,
>>
>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
>> be done by this week,then I will try to create the RC next if there is no
>> objection.
>>
>> https://issues.apache.org/jira/browse/HDFS-15160
>>
>>
>>
>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>> > <iw...@oss.nttdata.co.jp>
>> > Looks all are build related issues when you try with bigtop. We can
>> > discuss and prioritize this.. Will connect with you guys.
>> >
>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>> > iwasakims@oss.nttdata.co.jp> wrote:
>> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >>
>> >> I filed HADOOP-17849 for this.
>> >>
>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >
>> >> > These are relevant to directory structure used by Bigtop package.
>> >> > If the fix does not break the tarball dist,
>> >> > it would be nice to have these on Hadoop too.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >
>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> >> packaging.
>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >> >
>> >> >
>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> >> Thanks, I'll check them out.
>> >> >>
>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aajisaka@apache.org
>> >
>> >> wrote:
>> >> >>
>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>> >> >>>
>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >> >>>
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >> >>>
>> >> >>> In these patches, how about backporting the following issues to
>> >> >>> branch-3.2 and branch-3.2.3?
>> >> >>> - HADOOP-14922
>> >> >>> - HADOOP-15939
>> >> >>> - HADOOP-17569
>> >> >>>
>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >> >>> Maybe we need to create JIRAs and fix those.
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >>>
>> >> >>> Thanks and regards,
>> >> >>> Akira
>> >> >>>
>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>> hexiaoqiao@apache.org>
>> >> >>> wrote:
>> >> >>>>
>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> >> happen.
>> >> >>>>
>> >> >>>> I would like to validate the HBase project (both the latest
>> release
>> >> and
>> >> >>>> trunk branch).
>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >> >>> already).
>> >> >>>> once RC is out.
>> >> >>>>
>> >> >>>> Thanks and Regards,
>> >> >>>> - He Xiaoqiao
>> >> >>>>
>> >> >>>>
>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> >>>> wrote:
>> >> >>>>
>> >> >>>>> Hi All,
>> >> >>>>>
>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >> >>>>>
>> >> >>>>> *This time I am thinking of having downstream projects and
>> >> companies'
>> >> >>>>> voices,let's know how this can go. *
>> >> >>>>>
>> >> >>>>> - Planning to check with downstream projects like Spark,HBase
>> >> and
>> >> >>> Hive
>> >> >>>>> if they can help on validation(Or running their UT on this
>> >> branch)
>> >> >>>>> - Collecting info from Companies who are already deployed and
>> >> using
>> >> >>> the
>> >> >>>>> branch-3.2
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>> features
>> >> >>> released
>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>> from
>> >> >>> these
>> >> >>>>> communities who can help on this.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>> >> welcome.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> --Brahma Reddy Battula
>> >> >>>>>
>> >> >>>
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >> >
>> >>
>> >
>> >
>> > --
>> >
>> >
>> >
>> > --Brahma Reddy Battula
>> >
>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma,
I plan to involve HDFS-14997 and related JIRAs if possible. I have resolved
the conflict and verified them locally.
It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113.
I would like to hear some more response that if we have enough time to wait
for it to be ready.
Thanks.
Best Regards,
- He Xiaoqiao
On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq...@gmail.com> wrote:
> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
>
> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
>> Hi All,
>>
>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
>> be done by this week,then I will try to create the RC next if there is no
>> objection.
>>
>> https://issues.apache.org/jira/browse/HDFS-15160
>>
>>
>>
>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
>> wrote:
>>
>> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
>> > <iw...@oss.nttdata.co.jp>
>> > Looks all are build related issues when you try with bigtop. We can
>> > discuss and prioritize this.. Will connect with you guys.
>> >
>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
>> > iwasakims@oss.nttdata.co.jp> wrote:
>> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >>
>> >> I filed HADOOP-17849 for this.
>> >>
>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> >> > Thanks for bringing this up, Akira. Let me explain some background.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >
>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> >> > we do not see the issue usually since branch-3.2 uses
>> zooekeper-3.4.13,
>> >> > while it would be harmless to add the exclusion even for
>> >> zooekeeper-3.4.13.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >
>> >> > These are relevant to directory structure used by Bigtop package.
>> >> > If the fix does not break the tarball dist,
>> >> > it would be nice to have these on Hadoop too.
>> >> >
>> >> >
>> >> >> -
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >
>> >> > This is for aarch64 and ppe64le lacking required phantomjs.
>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> >> packaging.
>> >> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >> >
>> >> >
>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> >> Thanks, I'll check them out.
>> >> >>
>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aajisaka@apache.org
>> >
>> >> wrote:
>> >> >>
>> >> >>> Thanks Brahma for cutting branch-3.2.3.
>> >> >>>
>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >> >>>
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >> >>>
>> >> >>> In these patches, how about backporting the following issues to
>> >> >>> branch-3.2 and branch-3.2.3?
>> >> >>> - HADOOP-14922
>> >> >>> - HADOOP-15939
>> >> >>> - HADOOP-17569
>> >> >>>
>> >> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >> >>> Maybe we need to create JIRAs and fix those.
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >> >>> -
>> >> >>>
>> >>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >> >>>
>> >> >>> Thanks and regards,
>> >> >>> Akira
>> >> >>>
>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <
>> hexiaoqiao@apache.org>
>> >> >>> wrote:
>> >> >>>>
>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> >> happen.
>> >> >>>>
>> >> >>>> I would like to validate the HBase project (both the latest
>> release
>> >> and
>> >> >>>> trunk branch).
>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >> >>> already).
>> >> >>>> once RC is out.
>> >> >>>>
>> >> >>>> Thanks and Regards,
>> >> >>>> - He Xiaoqiao
>> >> >>>>
>> >> >>>>
>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> >> brahma@apache.org>
>> >> >>>> wrote:
>> >> >>>>
>> >> >>>>> Hi All,
>> >> >>>>>
>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >> >>>>>
>> >> >>>>> *This time I am thinking of having downstream projects and
>> >> companies'
>> >> >>>>> voices,let's know how this can go. *
>> >> >>>>>
>> >> >>>>> - Planning to check with downstream projects like Spark,HBase
>> >> and
>> >> >>> Hive
>> >> >>>>> if they can help on validation(Or running their UT on this
>> >> branch)
>> >> >>>>> - Collecting info from Companies who are already deployed and
>> >> using
>> >> >>> the
>> >> >>>>> branch-3.2
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> so that we can make a more stable release on 3.2 (so that
>> features
>> >> >>> released
>> >> >>>>> on this branch impact can be known) ,please let me know anybody
>> from
>> >> >>> these
>> >> >>>>> communities who can help on this.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> Planning to create RC by this month end. Any suggestions are
>> >> welcome.
>> >> >>>>>
>> >> >>>>>
>> >> >>>>>
>> >> >>>>> --Brahma Reddy Battula
>> >> >>>>>
>> >> >>>
>> >> >
>> >> > ---------------------------------------------------------------------
>> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >> >
>> >>
>> >
>> >
>> > --
>> >
>> >
>> >
>> > --Brahma Reddy Battula
>> >
>>
>>
>> --
>>
>>
>>
>> --Brahma Reddy Battula
>>
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
> be done by this week,then I will try to create the RC next if there is no
> objection.
>
> https://issues.apache.org/jira/browse/HDFS-15160
>
>
>
> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > <iw...@oss.nttdata.co.jp>
> > Looks all are build related issues when you try with bigtop. We can
> > discuss and prioritize this.. Will connect with you guys.
> >
> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >>
> >> I filed HADOOP-17849 for this.
> >>
> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >> > Thanks for bringing this up, Akira. Let me explain some background.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >
> >> > These are relevant to directory structure used by Bigtop package.
> >> > If the fix does not break the tarball dist,
> >> > it would be nice to have these on Hadoop too.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >
> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> >> packaging.
> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >> >
> >> >
> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> >> Thanks, I'll check them out.
> >> >>
> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >> >>
> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >> >>>
> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >> >>>
> >> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >> >>>
> >> >>> In these patches, how about backporting the following issues to
> >> >>> branch-3.2 and branch-3.2.3?
> >> >>> - HADOOP-14922
> >> >>> - HADOOP-15939
> >> >>> - HADOOP-17569
> >> >>>
> >> >>> In addition, there are some patches that don't have JIRA issue ID.
> >> >>> Maybe we need to create JIRAs and fix those.
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >>>
> >> >>> Thanks and regards,
> >> >>> Akira
> >> >>>
> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <hexiaoqiao@apache.org
> >
> >> >>> wrote:
> >> >>>>
> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> >> happen.
> >> >>>>
> >> >>>> I would like to validate the HBase project (both the latest release
> >> and
> >> >>>> trunk branch).
> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >> >>> already).
> >> >>>> once RC is out.
> >> >>>>
> >> >>>> Thanks and Regards,
> >> >>>> - He Xiaoqiao
> >> >>>>
> >> >>>>
> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >> brahma@apache.org>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> Hi All,
> >> >>>>>
> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >> >>>>>
> >> >>>>> *This time I am thinking of having downstream projects and
> >> companies'
> >> >>>>> voices,let's know how this can go. *
> >> >>>>>
> >> >>>>> - Planning to check with downstream projects like Spark,HBase
> >> and
> >> >>> Hive
> >> >>>>> if they can help on validation(Or running their UT on this
> >> branch)
> >> >>>>> - Collecting info from Companies who are already deployed and
> >> using
> >> >>> the
> >> >>>>> branch-3.2
> >> >>>>>
> >> >>>>>
> >> >>>>> so that we can make a more stable release on 3.2 (so that features
> >> >>> released
> >> >>>>> on this branch impact can be known) ,please let me know anybody
> from
> >> >>> these
> >> >>>>> communities who can help on this.
> >> >>>>>
> >> >>>>>
> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >> welcome.
> >> >>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>> --Brahma Reddy Battula
> >> >>>>>
> >> >>>
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >>
> >
> >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
> be done by this week,then I will try to create the RC next if there is no
> objection.
>
> https://issues.apache.org/jira/browse/HDFS-15160
>
>
>
> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > <iw...@oss.nttdata.co.jp>
> > Looks all are build related issues when you try with bigtop. We can
> > discuss and prioritize this.. Will connect with you guys.
> >
> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >>
> >> I filed HADOOP-17849 for this.
> >>
> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >> > Thanks for bringing this up, Akira. Let me explain some background.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >
> >> > These are relevant to directory structure used by Bigtop package.
> >> > If the fix does not break the tarball dist,
> >> > it would be nice to have these on Hadoop too.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >
> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> >> packaging.
> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >> >
> >> >
> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> >> Thanks, I'll check them out.
> >> >>
> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >> >>
> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >> >>>
> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >> >>>
> >> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >> >>>
> >> >>> In these patches, how about backporting the following issues to
> >> >>> branch-3.2 and branch-3.2.3?
> >> >>> - HADOOP-14922
> >> >>> - HADOOP-15939
> >> >>> - HADOOP-17569
> >> >>>
> >> >>> In addition, there are some patches that don't have JIRA issue ID.
> >> >>> Maybe we need to create JIRAs and fix those.
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >>>
> >> >>> Thanks and regards,
> >> >>> Akira
> >> >>>
> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <hexiaoqiao@apache.org
> >
> >> >>> wrote:
> >> >>>>
> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> >> happen.
> >> >>>>
> >> >>>> I would like to validate the HBase project (both the latest release
> >> and
> >> >>>> trunk branch).
> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >> >>> already).
> >> >>>> once RC is out.
> >> >>>>
> >> >>>> Thanks and Regards,
> >> >>>> - He Xiaoqiao
> >> >>>>
> >> >>>>
> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >> brahma@apache.org>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> Hi All,
> >> >>>>>
> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >> >>>>>
> >> >>>>> *This time I am thinking of having downstream projects and
> >> companies'
> >> >>>>> voices,let's know how this can go. *
> >> >>>>>
> >> >>>>> - Planning to check with downstream projects like Spark,HBase
> >> and
> >> >>> Hive
> >> >>>>> if they can help on validation(Or running their UT on this
> >> branch)
> >> >>>>> - Collecting info from Companies who are already deployed and
> >> using
> >> >>> the
> >> >>>>> branch-3.2
> >> >>>>>
> >> >>>>>
> >> >>>>> so that we can make a more stable release on 3.2 (so that features
> >> >>> released
> >> >>>>> on this branch impact can be known) ,please let me know anybody
> from
> >> >>> these
> >> >>>>> communities who can help on this.
> >> >>>>>
> >> >>>>>
> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >> welcome.
> >> >>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>> --Brahma Reddy Battula
> >> >>>>>
> >> >>>
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >>
> >
> >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
> be done by this week,then I will try to create the RC next if there is no
> objection.
>
> https://issues.apache.org/jira/browse/HDFS-15160
>
>
>
> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > <iw...@oss.nttdata.co.jp>
> > Looks all are build related issues when you try with bigtop. We can
> > discuss and prioritize this.. Will connect with you guys.
> >
> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >>
> >> I filed HADOOP-17849 for this.
> >>
> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >> > Thanks for bringing this up, Akira. Let me explain some background.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >
> >> > These are relevant to directory structure used by Bigtop package.
> >> > If the fix does not break the tarball dist,
> >> > it would be nice to have these on Hadoop too.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >
> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> >> packaging.
> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >> >
> >> >
> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> >> Thanks, I'll check them out.
> >> >>
> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >> >>
> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >> >>>
> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >> >>>
> >> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >> >>>
> >> >>> In these patches, how about backporting the following issues to
> >> >>> branch-3.2 and branch-3.2.3?
> >> >>> - HADOOP-14922
> >> >>> - HADOOP-15939
> >> >>> - HADOOP-17569
> >> >>>
> >> >>> In addition, there are some patches that don't have JIRA issue ID.
> >> >>> Maybe we need to create JIRAs and fix those.
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >>>
> >> >>> Thanks and regards,
> >> >>> Akira
> >> >>>
> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <hexiaoqiao@apache.org
> >
> >> >>> wrote:
> >> >>>>
> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> >> happen.
> >> >>>>
> >> >>>> I would like to validate the HBase project (both the latest release
> >> and
> >> >>>> trunk branch).
> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >> >>> already).
> >> >>>> once RC is out.
> >> >>>>
> >> >>>> Thanks and Regards,
> >> >>>> - He Xiaoqiao
> >> >>>>
> >> >>>>
> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >> brahma@apache.org>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> Hi All,
> >> >>>>>
> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >> >>>>>
> >> >>>>> *This time I am thinking of having downstream projects and
> >> companies'
> >> >>>>> voices,let's know how this can go. *
> >> >>>>>
> >> >>>>> - Planning to check with downstream projects like Spark,HBase
> >> and
> >> >>> Hive
> >> >>>>> if they can help on validation(Or running their UT on this
> >> branch)
> >> >>>>> - Collecting info from Companies who are already deployed and
> >> using
> >> >>> the
> >> >>>>> branch-3.2
> >> >>>>>
> >> >>>>>
> >> >>>>> so that we can make a more stable release on 3.2 (so that features
> >> >>> released
> >> >>>>> on this branch impact can be known) ,please let me know anybody
> from
> >> >>> these
> >> >>>>> communities who can help on this.
> >> >>>>>
> >> >>>>>
> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >> welcome.
> >> >>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>> --Brahma Reddy Battula
> >> >>>>>
> >> >>>
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >>
> >
> >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <xq...@gmail.com>.
Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI.
On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
> be done by this week,then I will try to create the RC next if there is no
> objection.
>
> https://issues.apache.org/jira/browse/HDFS-15160
>
>
>
> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> > <iw...@oss.nttdata.co.jp>
> > Looks all are build related issues when you try with bigtop. We can
> > discuss and prioritize this.. Will connect with you guys.
> >
> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> > iwasakims@oss.nttdata.co.jp> wrote:
> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >>
> >> I filed HADOOP-17849 for this.
> >>
> >> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> >> > Thanks for bringing this up, Akira. Let me explain some background.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >
> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> >> > we do not see the issue usually since branch-3.2 uses
> zooekeper-3.4.13,
> >> > while it would be harmless to add the exclusion even for
> >> zooekeeper-3.4.13.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >
> >> > These are relevant to directory structure used by Bigtop package.
> >> > If the fix does not break the tarball dist,
> >> > it would be nice to have these on Hadoop too.
> >> >
> >> >
> >> >> -
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >
> >> > This is for aarch64 and ppe64le lacking required phantomjs.
> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> >> packaging.
> >> > Hadoop needs the phantomjs for testing YARN-UI2.
> >> >
> >> >
> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> >> Thanks, I'll check them out.
> >> >>
> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> >> wrote:
> >> >>
> >> >>> Thanks Brahma for cutting branch-3.2.3.
> >> >>>
> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >> >>>
> >> >>>
> >>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >> >>>
> >> >>> In these patches, how about backporting the following issues to
> >> >>> branch-3.2 and branch-3.2.3?
> >> >>> - HADOOP-14922
> >> >>> - HADOOP-15939
> >> >>> - HADOOP-17569
> >> >>>
> >> >>> In addition, there are some patches that don't have JIRA issue ID.
> >> >>> Maybe we need to create JIRAs and fix those.
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >> >>> -
> >> >>>
> >>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >> >>>
> >> >>> Thanks and regards,
> >> >>> Akira
> >> >>>
> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <hexiaoqiao@apache.org
> >
> >> >>> wrote:
> >> >>>>
> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> >> happen.
> >> >>>>
> >> >>>> I would like to validate the HBase project (both the latest release
> >> and
> >> >>>> trunk branch).
> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >> >>> already).
> >> >>>> once RC is out.
> >> >>>>
> >> >>>> Thanks and Regards,
> >> >>>> - He Xiaoqiao
> >> >>>>
> >> >>>>
> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> >> brahma@apache.org>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> Hi All,
> >> >>>>>
> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >> >>>>>
> >> >>>>> *This time I am thinking of having downstream projects and
> >> companies'
> >> >>>>> voices,let's know how this can go. *
> >> >>>>>
> >> >>>>> - Planning to check with downstream projects like Spark,HBase
> >> and
> >> >>> Hive
> >> >>>>> if they can help on validation(Or running their UT on this
> >> branch)
> >> >>>>> - Collecting info from Companies who are already deployed and
> >> using
> >> >>> the
> >> >>>>> branch-3.2
> >> >>>>>
> >> >>>>>
> >> >>>>> so that we can make a more stable release on 3.2 (so that features
> >> >>> released
> >> >>>>> on this branch impact can be known) ,please let me know anybody
> from
> >> >>> these
> >> >>>>> communities who can help on this.
> >> >>>>>
> >> >>>>>
> >> >>>>> Planning to create RC by this month end. Any suggestions are
> >> welcome.
> >> >>>>>
> >> >>>>>
> >> >>>>>
> >> >>>>> --Brahma Reddy Battula
> >> >>>>>
> >> >>>
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >> >
> >>
> >
> >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi All,
Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
be done by this week,then I will try to create the RC next if there is no
objection.
https://issues.apache.org/jira/browse/HDFS-15160
On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> <iw...@oss.nttdata.co.jp>
> Looks all are build related issues when you try with bigtop. We can
> discuss and prioritize this.. Will connect with you guys.
>
> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>>
>> I filed HADOOP-17849 for this.
>>
>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> > Thanks for bringing this up, Akira. Let me explain some background.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >
>> > These are relevant to directory structure used by Bigtop package.
>> > If the fix does not break the tarball dist,
>> > it would be nice to have these on Hadoop too.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >
>> > This is for aarch64 and ppe64le lacking required phantomjs.
>> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> packaging.
>> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >
>> >
>> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> Thanks, I'll check them out.
>> >>
>> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>> >>
>> >>> Thanks Brahma for cutting branch-3.2.3.
>> >>>
>> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >>>
>> >>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >>>
>> >>> In these patches, how about backporting the following issues to
>> >>> branch-3.2 and branch-3.2.3?
>> >>> - HADOOP-14922
>> >>> - HADOOP-15939
>> >>> - HADOOP-17569
>> >>>
>> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >>> Maybe we need to create JIRAs and fix those.
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >>>
>> >>> Thanks and regards,
>> >>> Akira
>> >>>
>> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> >>> wrote:
>> >>>>
>> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> happen.
>> >>>>
>> >>>> I would like to validate the HBase project (both the latest release
>> and
>> >>>> trunk branch).
>> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >>> already).
>> >>>> once RC is out.
>> >>>>
>> >>>> Thanks and Regards,
>> >>>> - He Xiaoqiao
>> >>>>
>> >>>>
>> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> brahma@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>>> Hi All,
>> >>>>>
>> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >>>>>
>> >>>>> *This time I am thinking of having downstream projects and
>> companies'
>> >>>>> voices,let's know how this can go. *
>> >>>>>
>> >>>>> - Planning to check with downstream projects like Spark,HBase
>> and
>> >>> Hive
>> >>>>> if they can help on validation(Or running their UT on this
>> branch)
>> >>>>> - Collecting info from Companies who are already deployed and
>> using
>> >>> the
>> >>>>> branch-3.2
>> >>>>>
>> >>>>>
>> >>>>> so that we can make a more stable release on 3.2 (so that features
>> >>> released
>> >>>>> on this branch impact can be known) ,please let me know anybody from
>> >>> these
>> >>>>> communities who can help on this.
>> >>>>>
>> >>>>>
>> >>>>> Planning to create RC by this month end. Any suggestions are
>> welcome.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> --Brahma Reddy Battula
>> >>>>>
>> >>>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi All,
Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
be done by this week,then I will try to create the RC next if there is no
objection.
https://issues.apache.org/jira/browse/HDFS-15160
On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> <iw...@oss.nttdata.co.jp>
> Looks all are build related issues when you try with bigtop. We can
> discuss and prioritize this.. Will connect with you guys.
>
> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>>
>> I filed HADOOP-17849 for this.
>>
>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> > Thanks for bringing this up, Akira. Let me explain some background.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >
>> > These are relevant to directory structure used by Bigtop package.
>> > If the fix does not break the tarball dist,
>> > it would be nice to have these on Hadoop too.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >
>> > This is for aarch64 and ppe64le lacking required phantomjs.
>> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> packaging.
>> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >
>> >
>> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> Thanks, I'll check them out.
>> >>
>> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>> >>
>> >>> Thanks Brahma for cutting branch-3.2.3.
>> >>>
>> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >>>
>> >>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >>>
>> >>> In these patches, how about backporting the following issues to
>> >>> branch-3.2 and branch-3.2.3?
>> >>> - HADOOP-14922
>> >>> - HADOOP-15939
>> >>> - HADOOP-17569
>> >>>
>> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >>> Maybe we need to create JIRAs and fix those.
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >>>
>> >>> Thanks and regards,
>> >>> Akira
>> >>>
>> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> >>> wrote:
>> >>>>
>> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> happen.
>> >>>>
>> >>>> I would like to validate the HBase project (both the latest release
>> and
>> >>>> trunk branch).
>> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >>> already).
>> >>>> once RC is out.
>> >>>>
>> >>>> Thanks and Regards,
>> >>>> - He Xiaoqiao
>> >>>>
>> >>>>
>> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> brahma@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>>> Hi All,
>> >>>>>
>> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >>>>>
>> >>>>> *This time I am thinking of having downstream projects and
>> companies'
>> >>>>> voices,let's know how this can go. *
>> >>>>>
>> >>>>> - Planning to check with downstream projects like Spark,HBase
>> and
>> >>> Hive
>> >>>>> if they can help on validation(Or running their UT on this
>> branch)
>> >>>>> - Collecting info from Companies who are already deployed and
>> using
>> >>> the
>> >>>>> branch-3.2
>> >>>>>
>> >>>>>
>> >>>>> so that we can make a more stable release on 3.2 (so that features
>> >>> released
>> >>>>> on this branch impact can be known) ,please let me know anybody from
>> >>> these
>> >>>>> communities who can help on this.
>> >>>>>
>> >>>>>
>> >>>>> Planning to create RC by this month end. Any suggestions are
>> welcome.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> --Brahma Reddy Battula
>> >>>>>
>> >>>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi All,
Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
be done by this week,then I will try to create the RC next if there is no
objection.
https://issues.apache.org/jira/browse/HDFS-15160
On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> <iw...@oss.nttdata.co.jp>
> Looks all are build related issues when you try with bigtop. We can
> discuss and prioritize this.. Will connect with you guys.
>
> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>>
>> I filed HADOOP-17849 for this.
>>
>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> > Thanks for bringing this up, Akira. Let me explain some background.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >
>> > These are relevant to directory structure used by Bigtop package.
>> > If the fix does not break the tarball dist,
>> > it would be nice to have these on Hadoop too.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >
>> > This is for aarch64 and ppe64le lacking required phantomjs.
>> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> packaging.
>> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >
>> >
>> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> Thanks, I'll check them out.
>> >>
>> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>> >>
>> >>> Thanks Brahma for cutting branch-3.2.3.
>> >>>
>> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >>>
>> >>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >>>
>> >>> In these patches, how about backporting the following issues to
>> >>> branch-3.2 and branch-3.2.3?
>> >>> - HADOOP-14922
>> >>> - HADOOP-15939
>> >>> - HADOOP-17569
>> >>>
>> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >>> Maybe we need to create JIRAs and fix those.
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >>>
>> >>> Thanks and regards,
>> >>> Akira
>> >>>
>> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> >>> wrote:
>> >>>>
>> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> happen.
>> >>>>
>> >>>> I would like to validate the HBase project (both the latest release
>> and
>> >>>> trunk branch).
>> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >>> already).
>> >>>> once RC is out.
>> >>>>
>> >>>> Thanks and Regards,
>> >>>> - He Xiaoqiao
>> >>>>
>> >>>>
>> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> brahma@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>>> Hi All,
>> >>>>>
>> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >>>>>
>> >>>>> *This time I am thinking of having downstream projects and
>> companies'
>> >>>>> voices,let's know how this can go. *
>> >>>>>
>> >>>>> - Planning to check with downstream projects like Spark,HBase
>> and
>> >>> Hive
>> >>>>> if they can help on validation(Or running their UT on this
>> branch)
>> >>>>> - Collecting info from Companies who are already deployed and
>> using
>> >>> the
>> >>>>> branch-3.2
>> >>>>>
>> >>>>>
>> >>>>> so that we can make a more stable release on 3.2 (so that features
>> >>> released
>> >>>>> on this branch impact can be known) ,please let me know anybody from
>> >>> these
>> >>>>> communities who can help on this.
>> >>>>>
>> >>>>>
>> >>>>> Planning to create RC by this month end. Any suggestions are
>> welcome.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> --Brahma Reddy Battula
>> >>>>>
>> >>>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Hi All,
Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
be done by this week,then I will try to create the RC next if there is no
objection.
https://issues.apache.org/jira/browse/HDFS-15160
On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> @Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
> <iw...@oss.nttdata.co.jp>
> Looks all are build related issues when you try with bigtop. We can
> discuss and prioritize this.. Will connect with you guys.
>
> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> iwasakims@oss.nttdata.co.jp> wrote:
>
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>>
>> I filed HADOOP-17849 for this.
>>
>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> > Thanks for bringing this up, Akira. Let me explain some background.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >
>> > These are relevant to directory structure used by Bigtop package.
>> > If the fix does not break the tarball dist,
>> > it would be nice to have these on Hadoop too.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >
>> > This is for aarch64 and ppe64le lacking required phantomjs.
>> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> packaging.
>> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >
>> >
>> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> Thanks, I'll check them out.
>> >>
>> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
>> wrote:
>> >>
>> >>> Thanks Brahma for cutting branch-3.2.3.
>> >>>
>> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >>>
>> >>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >>>
>> >>> In these patches, how about backporting the following issues to
>> >>> branch-3.2 and branch-3.2.3?
>> >>> - HADOOP-14922
>> >>> - HADOOP-15939
>> >>> - HADOOP-17569
>> >>>
>> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >>> Maybe we need to create JIRAs and fix those.
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >>>
>> >>> Thanks and regards,
>> >>> Akira
>> >>>
>> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> >>> wrote:
>> >>>>
>> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> happen.
>> >>>>
>> >>>> I would like to validate the HBase project (both the latest release
>> and
>> >>>> trunk branch).
>> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> >>> already).
>> >>>> once RC is out.
>> >>>>
>> >>>> Thanks and Regards,
>> >>>> - He Xiaoqiao
>> >>>>
>> >>>>
>> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> brahma@apache.org>
>> >>>> wrote:
>> >>>>
>> >>>>> Hi All,
>> >>>>>
>> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
>> >>>>>
>> >>>>> *This time I am thinking of having downstream projects and
>> companies'
>> >>>>> voices,let's know how this can go. *
>> >>>>>
>> >>>>> - Planning to check with downstream projects like Spark,HBase
>> and
>> >>> Hive
>> >>>>> if they can help on validation(Or running their UT on this
>> branch)
>> >>>>> - Collecting info from Companies who are already deployed and
>> using
>> >>> the
>> >>>>> branch-3.2
>> >>>>>
>> >>>>>
>> >>>>> so that we can make a more stable release on 3.2 (so that features
>> >>> released
>> >>>>> on this branch impact can be known) ,please let me know anybody from
>> >>> these
>> >>>>> communities who can help on this.
>> >>>>>
>> >>>>>
>> >>>>> Planning to create RC by this month end. Any suggestions are
>> welcome.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> --Brahma Reddy Battula
>> >>>>>
>> >>>
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >
>>
>
>
> --
>
>
>
> --Brahma Reddy Battula
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
@Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
<iw...@oss.nttdata.co.jp>
Looks all are build related issues when you try with bigtop. We can discuss
and prioritize this.. Will connect with you guys.
On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
>
> I filed HADOOP-17849 for this.
>
> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > Thanks for bringing this up, Akira. Let me explain some background.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > These are relevant to directory structure used by Bigtop package.
> > If the fix does not break the tarball dist,
> > it would be nice to have these on Hadoop too.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > This is for aarch64 and ppe64le lacking required phantomjs.
> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> packaging.
> > Hadoop needs the phantomjs for testing YARN-UI2.
> >
> >
> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> Thanks, I'll check them out.
> >>
> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >>
> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>
> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >>>
> >>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>
> >>> In these patches, how about backporting the following issues to
> >>> branch-3.2 and branch-3.2.3?
> >>> - HADOOP-14922
> >>> - HADOOP-15939
> >>> - HADOOP-17569
> >>>
> >>> In addition, there are some patches that don't have JIRA issue ID.
> >>> Maybe we need to create JIRAs and fix those.
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>
> >>> Thanks and regards,
> >>> Akira
> >>>
> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> >>> wrote:
> >>>>
> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> happen.
> >>>>
> >>>> I would like to validate the HBase project (both the latest release
> and
> >>>> trunk branch).
> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >>> already).
> >>>> once RC is out.
> >>>>
> >>>> Thanks and Regards,
> >>>> - He Xiaoqiao
> >>>>
> >>>>
> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>
> >>>>> *This time I am thinking of having downstream projects and companies'
> >>>>> voices,let's know how this can go. *
> >>>>>
> >>>>> - Planning to check with downstream projects like Spark,HBase and
> >>> Hive
> >>>>> if they can help on validation(Or running their UT on this
> branch)
> >>>>> - Collecting info from Companies who are already deployed and
> using
> >>> the
> >>>>> branch-3.2
> >>>>>
> >>>>>
> >>>>> so that we can make a more stable release on 3.2 (so that features
> >>> released
> >>>>> on this branch impact can be known) ,please let me know anybody from
> >>> these
> >>>>> communities who can help on this.
> >>>>>
> >>>>>
> >>>>> Planning to create RC by this month end. Any suggestions are welcome.
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
@Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
<iw...@oss.nttdata.co.jp>
Looks all are build related issues when you try with bigtop. We can discuss
and prioritize this.. Will connect with you guys.
On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
>
> I filed HADOOP-17849 for this.
>
> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > Thanks for bringing this up, Akira. Let me explain some background.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > These are relevant to directory structure used by Bigtop package.
> > If the fix does not break the tarball dist,
> > it would be nice to have these on Hadoop too.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > This is for aarch64 and ppe64le lacking required phantomjs.
> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> packaging.
> > Hadoop needs the phantomjs for testing YARN-UI2.
> >
> >
> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> Thanks, I'll check them out.
> >>
> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >>
> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>
> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >>>
> >>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>
> >>> In these patches, how about backporting the following issues to
> >>> branch-3.2 and branch-3.2.3?
> >>> - HADOOP-14922
> >>> - HADOOP-15939
> >>> - HADOOP-17569
> >>>
> >>> In addition, there are some patches that don't have JIRA issue ID.
> >>> Maybe we need to create JIRAs and fix those.
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>
> >>> Thanks and regards,
> >>> Akira
> >>>
> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> >>> wrote:
> >>>>
> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> happen.
> >>>>
> >>>> I would like to validate the HBase project (both the latest release
> and
> >>>> trunk branch).
> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >>> already).
> >>>> once RC is out.
> >>>>
> >>>> Thanks and Regards,
> >>>> - He Xiaoqiao
> >>>>
> >>>>
> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>
> >>>>> *This time I am thinking of having downstream projects and companies'
> >>>>> voices,let's know how this can go. *
> >>>>>
> >>>>> - Planning to check with downstream projects like Spark,HBase and
> >>> Hive
> >>>>> if they can help on validation(Or running their UT on this
> branch)
> >>>>> - Collecting info from Companies who are already deployed and
> using
> >>> the
> >>>>> branch-3.2
> >>>>>
> >>>>>
> >>>>> so that we can make a more stable release on 3.2 (so that features
> >>> released
> >>>>> on this branch impact can be known) ,please let me know anybody from
> >>> these
> >>>>> communities who can help on this.
> >>>>>
> >>>>>
> >>>>> Planning to create RC by this month end. Any suggestions are welcome.
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
@Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
<iw...@oss.nttdata.co.jp>
Looks all are build related issues when you try with bigtop. We can discuss
and prioritize this.. Will connect with you guys.
On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
>
> I filed HADOOP-17849 for this.
>
> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > Thanks for bringing this up, Akira. Let me explain some background.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > These are relevant to directory structure used by Bigtop package.
> > If the fix does not break the tarball dist,
> > it would be nice to have these on Hadoop too.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > This is for aarch64 and ppe64le lacking required phantomjs.
> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> packaging.
> > Hadoop needs the phantomjs for testing YARN-UI2.
> >
> >
> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> Thanks, I'll check them out.
> >>
> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >>
> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>
> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >>>
> >>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>
> >>> In these patches, how about backporting the following issues to
> >>> branch-3.2 and branch-3.2.3?
> >>> - HADOOP-14922
> >>> - HADOOP-15939
> >>> - HADOOP-17569
> >>>
> >>> In addition, there are some patches that don't have JIRA issue ID.
> >>> Maybe we need to create JIRAs and fix those.
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>
> >>> Thanks and regards,
> >>> Akira
> >>>
> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> >>> wrote:
> >>>>
> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> happen.
> >>>>
> >>>> I would like to validate the HBase project (both the latest release
> and
> >>>> trunk branch).
> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >>> already).
> >>>> once RC is out.
> >>>>
> >>>> Thanks and Regards,
> >>>> - He Xiaoqiao
> >>>>
> >>>>
> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>
> >>>>> *This time I am thinking of having downstream projects and companies'
> >>>>> voices,let's know how this can go. *
> >>>>>
> >>>>> - Planning to check with downstream projects like Spark,HBase and
> >>> Hive
> >>>>> if they can help on validation(Or running their UT on this
> branch)
> >>>>> - Collecting info from Companies who are already deployed and
> using
> >>> the
> >>>>> branch-3.2
> >>>>>
> >>>>>
> >>>>> so that we can make a more stable release on 3.2 (so that features
> >>> released
> >>>>> on this branch impact can be known) ,please let me know anybody from
> >>> these
> >>>>> communities who can help on this.
> >>>>>
> >>>>>
> >>>>> Planning to create RC by this month end. Any suggestions are welcome.
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
@Akira Ajisaka <aa...@apache.org> and @Masatake Iwasaki
<iw...@oss.nttdata.co.jp>
Looks all are build related issues when you try with bigtop. We can discuss
and prioritize this.. Will connect with you guys.
On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
>
> I filed HADOOP-17849 for this.
>
> On 2021/08/16 12:02, Masatake Iwasaki wrote:
> > Thanks for bringing this up, Akira. Let me explain some background.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >
> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> > while it would be harmless to add the exclusion even for
> zooekeeper-3.4.13.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >
> > These are relevant to directory structure used by Bigtop package.
> > If the fix does not break the tarball dist,
> > it would be nice to have these on Hadoop too.
> >
> >
> >> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >
> > This is for aarch64 and ppe64le lacking required phantomjs.
> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
> packaging.
> > Hadoop needs the phantomjs for testing YARN-UI2.
> >
> >
> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> >> Thanks, I'll check them out.
> >>
> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org>
> wrote:
> >>
> >>> Thanks Brahma for cutting branch-3.2.3.
> >>>
> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
> >>>
> >>>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
> >>>
> >>> In these patches, how about backporting the following issues to
> >>> branch-3.2 and branch-3.2.3?
> >>> - HADOOP-14922
> >>> - HADOOP-15939
> >>> - HADOOP-17569
> >>>
> >>> In addition, there are some patches that don't have JIRA issue ID.
> >>> Maybe we need to create JIRAs and fix those.
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> >>> -
> >>>
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
> >>>
> >>> Thanks and regards,
> >>> Akira
> >>>
> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> >>> wrote:
> >>>>
> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release
> happen.
> >>>>
> >>>> I would like to validate the HBase project (both the latest release
> and
> >>>> trunk branch).
> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao
> >>> already).
> >>>> once RC is out.
> >>>>
> >>>> Thanks and Regards,
> >>>> - He Xiaoqiao
> >>>>
> >>>>
> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
> brahma@apache.org>
> >>>> wrote:
> >>>>
> >>>>> Hi All,
> >>>>>
> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
> >>>>> branch-3.2.3 if any critical/blocker issues need to go.
> >>>>>
> >>>>> *This time I am thinking of having downstream projects and companies'
> >>>>> voices,let's know how this can go. *
> >>>>>
> >>>>> - Planning to check with downstream projects like Spark,HBase and
> >>> Hive
> >>>>> if they can help on validation(Or running their UT on this
> branch)
> >>>>> - Collecting info from Companies who are already deployed and
> using
> >>> the
> >>>>> branch-3.2
> >>>>>
> >>>>>
> >>>>> so that we can make a more stable release on 3.2 (so that features
> >>> released
> >>>>> on this branch impact can be known) ,please let me know anybody from
> >>> these
> >>>>> communities who can help on this.
> >>>>>
> >>>>>
> >>>>> Planning to create RC by this month end. Any suggestions are welcome.
> >>>>>
> >>>>>
> >>>>>
> >>>>> --Brahma Reddy Battula
> >>>>>
> >>>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
I filed HADOOP-17849 for this.
On 2021/08/16 12:02, Masatake Iwasaki wrote:
> Thanks for bringing this up, Akira. Let me explain some background.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>
> These are relevant to directory structure used by Bigtop package.
> If the fix does not break the tarball dist,
> it would be nice to have these on Hadoop too.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> This is for aarch64 and ppe64le lacking required phantomjs.
> It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
> Hadoop needs the phantomjs for testing YARN-UI2.
>
>
> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> Thanks, I'll check them out.
>>
>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>>
>>> Thanks Brahma for cutting branch-3.2.3.
>>>
>>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>
>>> In these patches, how about backporting the following issues to
>>> branch-3.2 and branch-3.2.3?
>>> - HADOOP-14922
>>> - HADOOP-15939
>>> - HADOOP-17569
>>>
>>> In addition, there are some patches that don't have JIRA issue ID.
>>> Maybe we need to create JIRAs and fix those.
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>
>>> Thanks and regards,
>>> Akira
>>>
>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>>> wrote:
>>>>
>>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>>
>>>> I would like to validate the HBase project (both the latest release and
>>>> trunk branch).
>>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> already).
>>>> once RC is out.
>>>>
>>>> Thanks and Regards,
>>>> - He Xiaoqiao
>>>>
>>>>
>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>
>>>>> *This time I am thinking of having downstream projects and companies'
>>>>> voices,let's know how this can go. *
>>>>>
>>>>> - Planning to check with downstream projects like Spark,HBase and
>>> Hive
>>>>> if they can help on validation(Or running their UT on this branch)
>>>>> - Collecting info from Companies who are already deployed and using
>>> the
>>>>> branch-3.2
>>>>>
>>>>>
>>>>> so that we can make a more stable release on 3.2 (so that features
>>> released
>>>>> on this branch impact can be known) ,please let me know anybody from
>>> these
>>>>> communities who can help on this.
>>>>>
>>>>>
>>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
I filed HADOOP-17849 for this.
On 2021/08/16 12:02, Masatake Iwasaki wrote:
> Thanks for bringing this up, Akira. Let me explain some background.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>
> These are relevant to directory structure used by Bigtop package.
> If the fix does not break the tarball dist,
> it would be nice to have these on Hadoop too.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> This is for aarch64 and ppe64le lacking required phantomjs.
> It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
> Hadoop needs the phantomjs for testing YARN-UI2.
>
>
> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> Thanks, I'll check them out.
>>
>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>>
>>> Thanks Brahma for cutting branch-3.2.3.
>>>
>>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>
>>> In these patches, how about backporting the following issues to
>>> branch-3.2 and branch-3.2.3?
>>> - HADOOP-14922
>>> - HADOOP-15939
>>> - HADOOP-17569
>>>
>>> In addition, there are some patches that don't have JIRA issue ID.
>>> Maybe we need to create JIRAs and fix those.
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>
>>> Thanks and regards,
>>> Akira
>>>
>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>>> wrote:
>>>>
>>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>>
>>>> I would like to validate the HBase project (both the latest release and
>>>> trunk branch).
>>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> already).
>>>> once RC is out.
>>>>
>>>> Thanks and Regards,
>>>> - He Xiaoqiao
>>>>
>>>>
>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>
>>>>> *This time I am thinking of having downstream projects and companies'
>>>>> voices,let's know how this can go. *
>>>>>
>>>>> - Planning to check with downstream projects like Spark,HBase and
>>> Hive
>>>>> if they can help on validation(Or running their UT on this branch)
>>>>> - Collecting info from Companies who are already deployed and using
>>> the
>>>>> branch-3.2
>>>>>
>>>>>
>>>>> so that we can make a more stable release on 3.2 (so that features
>>> released
>>>>> on this branch impact can be known) ,please let me know anybody from
>>> these
>>>>> communities who can help on this.
>>>>>
>>>>>
>>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
I filed HADOOP-17849 for this.
On 2021/08/16 12:02, Masatake Iwasaki wrote:
> Thanks for bringing this up, Akira. Let me explain some background.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>
> These are relevant to directory structure used by Bigtop package.
> If the fix does not break the tarball dist,
> it would be nice to have these on Hadoop too.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> This is for aarch64 and ppe64le lacking required phantomjs.
> It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
> Hadoop needs the phantomjs for testing YARN-UI2.
>
>
> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> Thanks, I'll check them out.
>>
>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>>
>>> Thanks Brahma for cutting branch-3.2.3.
>>>
>>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>
>>> In these patches, how about backporting the following issues to
>>> branch-3.2 and branch-3.2.3?
>>> - HADOOP-14922
>>> - HADOOP-15939
>>> - HADOOP-17569
>>>
>>> In addition, there are some patches that don't have JIRA issue ID.
>>> Maybe we need to create JIRAs and fix those.
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>
>>> Thanks and regards,
>>> Akira
>>>
>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>>> wrote:
>>>>
>>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>>
>>>> I would like to validate the HBase project (both the latest release and
>>>> trunk branch).
>>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> already).
>>>> once RC is out.
>>>>
>>>> Thanks and Regards,
>>>> - He Xiaoqiao
>>>>
>>>>
>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>
>>>>> *This time I am thinking of having downstream projects and companies'
>>>>> voices,let's know how this can go. *
>>>>>
>>>>> - Planning to check with downstream projects like Spark,HBase and
>>> Hive
>>>>> if they can help on validation(Or running their UT on this branch)
>>>>> - Collecting info from Companies who are already deployed and using
>>> the
>>>>> branch-3.2
>>>>>
>>>>>
>>>>> so that we can make a more stable release on 3.2 (so that features
>>> released
>>>>> on this branch impact can be known) ,please let me know anybody from
>>> these
>>>>> communities who can help on this.
>>>>>
>>>>>
>>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
I filed HADOOP-17849 for this.
On 2021/08/16 12:02, Masatake Iwasaki wrote:
> Thanks for bringing this up, Akira. Let me explain some background.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>
> This is for building hadoop-3.2.2 against zookeeper-3.4.14.
> we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
> while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>
> These are relevant to directory structure used by Bigtop package.
> If the fix does not break the tarball dist,
> it would be nice to have these on Hadoop too.
>
>
>> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> This is for aarch64 and ppe64le lacking required phantomjs.
> It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
> Hadoop needs the phantomjs for testing YARN-UI2.
>
>
> On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> Thanks, I'll check them out.
>>
>> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>>
>>> Thanks Brahma for cutting branch-3.2.3.
>>>
>>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>>
>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>>
>>> In these patches, how about backporting the following issues to
>>> branch-3.2 and branch-3.2.3?
>>> - HADOOP-14922
>>> - HADOOP-15939
>>> - HADOOP-17569
>>>
>>> In addition, there are some patches that don't have JIRA issue ID.
>>> Maybe we need to create JIRAs and fix those.
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>>> -
>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>>
>>> Thanks and regards,
>>> Akira
>>>
>>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>>> wrote:
>>>>
>>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>>
>>>> I would like to validate the HBase project (both the latest release and
>>>> trunk branch).
>>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>>> already).
>>>> once RC is out.
>>>>
>>>> Thanks and Regards,
>>>> - He Xiaoqiao
>>>>
>>>>
>>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>>
>>>>> *This time I am thinking of having downstream projects and companies'
>>>>> voices,let's know how this can go. *
>>>>>
>>>>> - Planning to check with downstream projects like Spark,HBase and
>>> Hive
>>>>> if they can help on validation(Or running their UT on this branch)
>>>>> - Collecting info from Companies who are already deployed and using
>>> the
>>>>> branch-3.2
>>>>>
>>>>>
>>>>> so that we can make a more stable release on 3.2 (so that features
>>> released
>>>>> on this branch impact can be known) ,please let me know anybody from
>>> these
>>>>> communities who can help on this.
>>>>>
>>>>>
>>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>>
>>>>>
>>>>>
>>>>> --Brahma Reddy Battula
>>>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for bringing this up, Akira. Let me explain some background.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
This is for building hadoop-3.2.2 against zookeeper-3.4.14.
we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
These are relevant to directory structure used by Bigtop package.
If the fix does not break the tarball dist,
it would be nice to have these on Hadoop too.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
This is for aarch64 and ppe64le lacking required phantomjs.
It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
Hadoop needs the phantomjs for testing YARN-UI2.
On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> Thanks, I'll check them out.
>
> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
>> Thanks Brahma for cutting branch-3.2.3.
>>
>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>
>> In these patches, how about backporting the following issues to
>> branch-3.2 and branch-3.2.3?
>> - HADOOP-14922
>> - HADOOP-15939
>> - HADOOP-17569
>>
>> In addition, there are some patches that don't have JIRA issue ID.
>> Maybe we need to create JIRAs and fix those.
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>
>> Thanks and regards,
>> Akira
>>
>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> wrote:
>>>
>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>
>>> I would like to validate the HBase project (both the latest release and
>>> trunk branch).
>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> already).
>>> once RC is out.
>>>
>>> Thanks and Regards,
>>> - He Xiaoqiao
>>>
>>>
>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>
>>>> *This time I am thinking of having downstream projects and companies'
>>>> voices,let's know how this can go. *
>>>>
>>>> - Planning to check with downstream projects like Spark,HBase and
>> Hive
>>>> if they can help on validation(Or running their UT on this branch)
>>>> - Collecting info from Companies who are already deployed and using
>> the
>>>> branch-3.2
>>>>
>>>>
>>>> so that we can make a more stable release on 3.2 (so that features
>> released
>>>> on this branch impact can be known) ,please let me know anybody from
>> these
>>>> communities who can help on this.
>>>>
>>>>
>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for bringing this up, Akira. Let me explain some background.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
This is for building hadoop-3.2.2 against zookeeper-3.4.14.
we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
These are relevant to directory structure used by Bigtop package.
If the fix does not break the tarball dist,
it would be nice to have these on Hadoop too.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
This is for aarch64 and ppe64le lacking required phantomjs.
It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
Hadoop needs the phantomjs for testing YARN-UI2.
On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> Thanks, I'll check them out.
>
> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
>> Thanks Brahma for cutting branch-3.2.3.
>>
>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>
>> In these patches, how about backporting the following issues to
>> branch-3.2 and branch-3.2.3?
>> - HADOOP-14922
>> - HADOOP-15939
>> - HADOOP-17569
>>
>> In addition, there are some patches that don't have JIRA issue ID.
>> Maybe we need to create JIRAs and fix those.
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>
>> Thanks and regards,
>> Akira
>>
>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> wrote:
>>>
>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>
>>> I would like to validate the HBase project (both the latest release and
>>> trunk branch).
>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> already).
>>> once RC is out.
>>>
>>> Thanks and Regards,
>>> - He Xiaoqiao
>>>
>>>
>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>
>>>> *This time I am thinking of having downstream projects and companies'
>>>> voices,let's know how this can go. *
>>>>
>>>> - Planning to check with downstream projects like Spark,HBase and
>> Hive
>>>> if they can help on validation(Or running their UT on this branch)
>>>> - Collecting info from Companies who are already deployed and using
>> the
>>>> branch-3.2
>>>>
>>>>
>>>> so that we can make a more stable release on 3.2 (so that features
>> released
>>>> on this branch impact can be known) ,please let me know anybody from
>> these
>>>> communities who can help on this.
>>>>
>>>>
>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for bringing this up, Akira. Let me explain some background.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
This is for building hadoop-3.2.2 against zookeeper-3.4.14.
we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
These are relevant to directory structure used by Bigtop package.
If the fix does not break the tarball dist,
it would be nice to have these on Hadoop too.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
This is for aarch64 and ppe64le lacking required phantomjs.
It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
Hadoop needs the phantomjs for testing YARN-UI2.
On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> Thanks, I'll check them out.
>
> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
>> Thanks Brahma for cutting branch-3.2.3.
>>
>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>
>> In these patches, how about backporting the following issues to
>> branch-3.2 and branch-3.2.3?
>> - HADOOP-14922
>> - HADOOP-15939
>> - HADOOP-17569
>>
>> In addition, there are some patches that don't have JIRA issue ID.
>> Maybe we need to create JIRAs and fix those.
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>
>> Thanks and regards,
>> Akira
>>
>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> wrote:
>>>
>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>
>>> I would like to validate the HBase project (both the latest release and
>>> trunk branch).
>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> already).
>>> once RC is out.
>>>
>>> Thanks and Regards,
>>> - He Xiaoqiao
>>>
>>>
>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>
>>>> *This time I am thinking of having downstream projects and companies'
>>>> voices,let's know how this can go. *
>>>>
>>>> - Planning to check with downstream projects like Spark,HBase and
>> Hive
>>>> if they can help on validation(Or running their UT on this branch)
>>>> - Collecting info from Companies who are already deployed and using
>> the
>>>> branch-3.2
>>>>
>>>>
>>>> so that we can make a more stable release on 3.2 (so that features
>> released
>>>> on this branch impact can be known) ,please let me know anybody from
>> these
>>>> communities who can help on this.
>>>>
>>>>
>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Thanks for bringing this up, Akira. Let me explain some background.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
This is for building hadoop-3.2.2 against zookeeper-3.4.14.
we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
while it would be harmless to add the exclusion even for zooekeeper-3.4.13.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
These are relevant to directory structure used by Bigtop package.
If the fix does not break the tarball dist,
it would be nice to have these on Hadoop too.
> - https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
This is for aarch64 and ppe64le lacking required phantomjs.
It is only acceptable for Bigtop not running tests of YARN-UI2 on packaging.
Hadoop needs the phantomjs for testing YARN-UI2.
On 2021/08/16 2:59, Brahma Reddy Battula wrote:
> Thanks, I'll check them out.
>
> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
>
>> Thanks Brahma for cutting branch-3.2.3.
>>
>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>>
>> In these patches, how about backporting the following issues to
>> branch-3.2 and branch-3.2.3?
>> - HADOOP-14922
>> - HADOOP-15939
>> - HADOOP-17569
>>
>> In addition, there are some patches that don't have JIRA issue ID.
>> Maybe we need to create JIRAs and fix those.
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>>
>> Thanks and regards,
>> Akira
>>
>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
>> wrote:
>>>
>>> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>>>
>>> I would like to validate the HBase project (both the latest release and
>>> trunk branch).
>>> Chao Sun will validate the Spark Project (Got in touch with Chao
>> already).
>>> once RC is out.
>>>
>>> Thanks and Regards,
>>> - He Xiaoqiao
>>>
>>>
>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I cut branch-3.2.3 and it is ready for release. Please commit to
>>>> branch-3.2.3 if any critical/blocker issues need to go.
>>>>
>>>> *This time I am thinking of having downstream projects and companies'
>>>> voices,let's know how this can go. *
>>>>
>>>> - Planning to check with downstream projects like Spark,HBase and
>> Hive
>>>> if they can help on validation(Or running their UT on this branch)
>>>> - Collecting info from Companies who are already deployed and using
>> the
>>>> branch-3.2
>>>>
>>>>
>>>> so that we can make a more stable release on 3.2 (so that features
>> released
>>>> on this branch impact can be known) ,please let me know anybody from
>> these
>>>> communities who can help on this.
>>>>
>>>>
>>>> Planning to create RC by this month end. Any suggestions are welcome.
>>>>
>>>>
>>>>
>>>> --Brahma Reddy Battula
>>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks, I'll check them out.
On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Thanks Brahma for cutting branch-3.2.3.
>
> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>
> In these patches, how about backporting the following issues to
> branch-3.2 and branch-3.2.3?
> - HADOOP-14922
> - HADOOP-15939
> - HADOOP-17569
>
> In addition, there are some patches that don't have JIRA issue ID.
> Maybe we need to create JIRAs and fix those.
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> Thanks and regards,
> Akira
>
> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
> >
> > I would like to validate the HBase project (both the latest release and
> > trunk branch).
> > Chao Sun will validate the Spark Project (Got in touch with Chao
> already).
> > once RC is out.
> >
> > Thanks and Regards,
> > - He Xiaoqiao
> >
> >
> > On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > > Hi All,
> > >
> > > I cut branch-3.2.3 and it is ready for release. Please commit to
> > > branch-3.2.3 if any critical/blocker issues need to go.
> > >
> > > *This time I am thinking of having downstream projects and companies'
> > > voices,let's know how this can go. *
> > >
> > > - Planning to check with downstream projects like Spark,HBase and
> Hive
> > > if they can help on validation(Or running their UT on this branch)
> > > - Collecting info from Companies who are already deployed and using
> the
> > > branch-3.2
> > >
> > >
> > > so that we can make a more stable release on 3.2 (so that features
> released
> > > on this branch impact can be known) ,please let me know anybody from
> these
> > > communities who can help on this.
> > >
> > >
> > > Planning to create RC by this month end. Any suggestions are welcome.
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks, I'll check them out.
On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Thanks Brahma for cutting branch-3.2.3.
>
> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>
> In these patches, how about backporting the following issues to
> branch-3.2 and branch-3.2.3?
> - HADOOP-14922
> - HADOOP-15939
> - HADOOP-17569
>
> In addition, there are some patches that don't have JIRA issue ID.
> Maybe we need to create JIRAs and fix those.
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> Thanks and regards,
> Akira
>
> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
> >
> > I would like to validate the HBase project (both the latest release and
> > trunk branch).
> > Chao Sun will validate the Spark Project (Got in touch with Chao
> already).
> > once RC is out.
> >
> > Thanks and Regards,
> > - He Xiaoqiao
> >
> >
> > On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > > Hi All,
> > >
> > > I cut branch-3.2.3 and it is ready for release. Please commit to
> > > branch-3.2.3 if any critical/blocker issues need to go.
> > >
> > > *This time I am thinking of having downstream projects and companies'
> > > voices,let's know how this can go. *
> > >
> > > - Planning to check with downstream projects like Spark,HBase and
> Hive
> > > if they can help on validation(Or running their UT on this branch)
> > > - Collecting info from Companies who are already deployed and using
> the
> > > branch-3.2
> > >
> > >
> > > so that we can make a more stable release on 3.2 (so that features
> released
> > > on this branch impact can be known) ,please let me know anybody from
> these
> > > communities who can help on this.
> > >
> > >
> > > Planning to create RC by this month end. Any suggestions are welcome.
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks, I'll check them out.
On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Thanks Brahma for cutting branch-3.2.3.
>
> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>
> In these patches, how about backporting the following issues to
> branch-3.2 and branch-3.2.3?
> - HADOOP-14922
> - HADOOP-15939
> - HADOOP-17569
>
> In addition, there are some patches that don't have JIRA issue ID.
> Maybe we need to create JIRAs and fix those.
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> Thanks and regards,
> Akira
>
> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
> >
> > I would like to validate the HBase project (both the latest release and
> > trunk branch).
> > Chao Sun will validate the Spark Project (Got in touch with Chao
> already).
> > once RC is out.
> >
> > Thanks and Regards,
> > - He Xiaoqiao
> >
> >
> > On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > > Hi All,
> > >
> > > I cut branch-3.2.3 and it is ready for release. Please commit to
> > > branch-3.2.3 if any critical/blocker issues need to go.
> > >
> > > *This time I am thinking of having downstream projects and companies'
> > > voices,let's know how this can go. *
> > >
> > > - Planning to check with downstream projects like Spark,HBase and
> Hive
> > > if they can help on validation(Or running their UT on this branch)
> > > - Collecting info from Companies who are already deployed and using
> the
> > > branch-3.2
> > >
> > >
> > > so that we can make a more stable release on 3.2 (so that features
> released
> > > on this branch impact can be known) ,please let me know anybody from
> these
> > > communities who can help on this.
> > >
> > >
> > > Planning to create RC by this month end. Any suggestions are welcome.
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks, I'll check them out.
On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka <aa...@apache.org> wrote:
> Thanks Brahma for cutting branch-3.2.3.
>
> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>
> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>
> In these patches, how about backporting the following issues to
> branch-3.2 and branch-3.2.3?
> - HADOOP-14922
> - HADOOP-15939
> - HADOOP-17569
>
> In addition, there are some patches that don't have JIRA issue ID.
> Maybe we need to create JIRAs and fix those.
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
> -
> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>
> Thanks and regards,
> Akira
>
> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org>
> wrote:
> >
> > Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
> >
> > I would like to validate the HBase project (both the latest release and
> > trunk branch).
> > Chao Sun will validate the Spark Project (Got in touch with Chao
> already).
> > once RC is out.
> >
> > Thanks and Regards,
> > - He Xiaoqiao
> >
> >
> > On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> > wrote:
> >
> > > Hi All,
> > >
> > > I cut branch-3.2.3 and it is ready for release. Please commit to
> > > branch-3.2.3 if any critical/blocker issues need to go.
> > >
> > > *This time I am thinking of having downstream projects and companies'
> > > voices,let's know how this can go. *
> > >
> > > - Planning to check with downstream projects like Spark,HBase and
> Hive
> > > if they can help on validation(Or running their UT on this branch)
> > > - Collecting info from Companies who are already deployed and using
> the
> > > branch-3.2
> > >
> > >
> > > so that we can make a more stable release on 3.2 (so that features
> released
> > > on this branch impact can be known) ,please let me know anybody from
> these
> > > communities who can help on this.
> > >
> > >
> > > Planning to create RC by this month end. Any suggestions are welcome.
> > >
> > >
> > >
> > > --Brahma Reddy Battula
> > >
>
--
--Brahma Reddy Battula
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Thanks Brahma for cutting branch-3.2.3.
In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
In these patches, how about backporting the following issues to
branch-3.2 and branch-3.2.3?
- HADOOP-14922
- HADOOP-15939
- HADOOP-17569
In addition, there are some patches that don't have JIRA issue ID.
Maybe we need to create JIRAs and fix those.
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
Thanks and regards,
Akira
On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org> wrote:
>
> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>
> I would like to validate the HBase project (both the latest release and
> trunk branch).
> Chao Sun will validate the Spark Project (Got in touch with Chao already).
> once RC is out.
>
> Thanks and Regards,
> - He Xiaoqiao
>
>
> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi All,
> >
> > I cut branch-3.2.3 and it is ready for release. Please commit to
> > branch-3.2.3 if any critical/blocker issues need to go.
> >
> > *This time I am thinking of having downstream projects and companies'
> > voices,let's know how this can go. *
> >
> > - Planning to check with downstream projects like Spark,HBase and Hive
> > if they can help on validation(Or running their UT on this branch)
> > - Collecting info from Companies who are already deployed and using the
> > branch-3.2
> >
> >
> > so that we can make a more stable release on 3.2 (so that features released
> > on this branch impact can be known) ,please let me know anybody from these
> > communities who can help on this.
> >
> >
> > Planning to create RC by this month end. Any suggestions are welcome.
> >
> >
> >
> > --Brahma Reddy Battula
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Thanks Brahma for cutting branch-3.2.3.
In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
In these patches, how about backporting the following issues to
branch-3.2 and branch-3.2.3?
- HADOOP-14922
- HADOOP-15939
- HADOOP-17569
In addition, there are some patches that don't have JIRA issue ID.
Maybe we need to create JIRAs and fix those.
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
Thanks and regards,
Akira
On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org> wrote:
>
> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>
> I would like to validate the HBase project (both the latest release and
> trunk branch).
> Chao Sun will validate the Spark Project (Got in touch with Chao already).
> once RC is out.
>
> Thanks and Regards,
> - He Xiaoqiao
>
>
> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi All,
> >
> > I cut branch-3.2.3 and it is ready for release. Please commit to
> > branch-3.2.3 if any critical/blocker issues need to go.
> >
> > *This time I am thinking of having downstream projects and companies'
> > voices,let's know how this can go. *
> >
> > - Planning to check with downstream projects like Spark,HBase and Hive
> > if they can help on validation(Or running their UT on this branch)
> > - Collecting info from Companies who are already deployed and using the
> > branch-3.2
> >
> >
> > so that we can make a more stable release on 3.2 (so that features released
> > on this branch impact can be known) ,please let me know anybody from these
> > communities who can help on this.
> >
> >
> > Planning to create RC by this month end. Any suggestions are welcome.
> >
> >
> >
> > --Brahma Reddy Battula
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Thanks Brahma for cutting branch-3.2.3.
In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
In these patches, how about backporting the following issues to
branch-3.2 and branch-3.2.3?
- HADOOP-14922
- HADOOP-15939
- HADOOP-17569
In addition, there are some patches that don't have JIRA issue ID.
Maybe we need to create JIRAs and fix those.
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
Thanks and regards,
Akira
On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org> wrote:
>
> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>
> I would like to validate the HBase project (both the latest release and
> trunk branch).
> Chao Sun will validate the Spark Project (Got in touch with Chao already).
> once RC is out.
>
> Thanks and Regards,
> - He Xiaoqiao
>
>
> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi All,
> >
> > I cut branch-3.2.3 and it is ready for release. Please commit to
> > branch-3.2.3 if any critical/blocker issues need to go.
> >
> > *This time I am thinking of having downstream projects and companies'
> > voices,let's know how this can go. *
> >
> > - Planning to check with downstream projects like Spark,HBase and Hive
> > if they can help on validation(Or running their UT on this branch)
> > - Collecting info from Companies who are already deployed and using the
> > branch-3.2
> >
> >
> > so that we can make a more stable release on 3.2 (so that features released
> > on this branch impact can be known) ,please let me know anybody from these
> > communities who can help on this.
> >
> >
> > Planning to create RC by this month end. Any suggestions are welcome.
> >
> >
> >
> > --Brahma Reddy Battula
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Akira Ajisaka <aa...@apache.org>.
Thanks Brahma for cutting branch-3.2.3.
In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
In these patches, how about backporting the following issues to
branch-3.2 and branch-3.2.3?
- HADOOP-14922
- HADOOP-15939
- HADOOP-17569
In addition, there are some patches that don't have JIRA issue ID.
Maybe we need to create JIRAs and fix those.
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
- https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
Thanks and regards,
Akira
On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He <he...@apache.org> wrote:
>
> Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
>
> I would like to validate the HBase project (both the latest release and
> trunk branch).
> Chao Sun will validate the Spark Project (Got in touch with Chao already).
> once RC is out.
>
> Thanks and Regards,
> - He Xiaoqiao
>
>
> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi All,
> >
> > I cut branch-3.2.3 and it is ready for release. Please commit to
> > branch-3.2.3 if any critical/blocker issues need to go.
> >
> > *This time I am thinking of having downstream projects and companies'
> > voices,let's know how this can go. *
> >
> > - Planning to check with downstream projects like Spark,HBase and Hive
> > if they can help on validation(Or running their UT on this branch)
> > - Collecting info from Companies who are already deployed and using the
> > branch-3.2
> >
> >
> > so that we can make a more stable release on 3.2 (so that features released
> > on this branch impact can be known) ,please let me know anybody from these
> > communities who can help on this.
> >
> >
> > Planning to create RC by this month end. Any suggestions are welcome.
> >
> >
> >
> > --Brahma Reddy Battula
> >
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
I would like to validate the HBase project (both the latest release and
trunk branch).
Chao Sun will validate the Spark Project (Got in touch with Chao already).
once RC is out.
Thanks and Regards,
- He Xiaoqiao
On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> I cut branch-3.2.3 and it is ready for release. Please commit to
> branch-3.2.3 if any critical/blocker issues need to go.
>
> *This time I am thinking of having downstream projects and companies'
> voices,let's know how this can go. *
>
> - Planning to check with downstream projects like Spark,HBase and Hive
> if they can help on validation(Or running their UT on this branch)
> - Collecting info from Companies who are already deployed and using the
> branch-3.2
>
>
> so that we can make a more stable release on 3.2 (so that features released
> on this branch impact can be known) ,please let me know anybody from these
> communities who can help on this.
>
>
> Planning to create RC by this month end. Any suggestions are welcome.
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
I would like to validate the HBase project (both the latest release and
trunk branch).
Chao Sun will validate the Spark Project (Got in touch with Chao already).
once RC is out.
Thanks and Regards,
- He Xiaoqiao
On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> I cut branch-3.2.3 and it is ready for release. Please commit to
> branch-3.2.3 if any critical/blocker issues need to go.
>
> *This time I am thinking of having downstream projects and companies'
> voices,let's know how this can go. *
>
> - Planning to check with downstream projects like Spark,HBase and Hive
> if they can help on validation(Or running their UT on this branch)
> - Collecting info from Companies who are already deployed and using the
> branch-3.2
>
>
> so that we can make a more stable release on 3.2 (so that features released
> on this branch impact can be known) ,please let me know anybody from these
> communities who can help on this.
>
>
> Planning to create RC by this month end. Any suggestions are welcome.
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
I would like to validate the HBase project (both the latest release and
trunk branch).
Chao Sun will validate the Spark Project (Got in touch with Chao already).
once RC is out.
Thanks and Regards,
- He Xiaoqiao
On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> I cut branch-3.2.3 and it is ready for release. Please commit to
> branch-3.2.3 if any critical/blocker issues need to go.
>
> *This time I am thinking of having downstream projects and companies'
> voices,let's know how this can go. *
>
> - Planning to check with downstream projects like Spark,HBase and Hive
> if they can help on validation(Or running their UT on this branch)
> - Collecting info from Companies who are already deployed and using the
> branch-3.2
>
>
> so that we can make a more stable release on 3.2 (so that features released
> on this branch impact can be known) ,please let me know anybody from these
> communities who can help on this.
>
>
> Planning to create RC by this month end. Any suggestions are welcome.
>
>
>
> --Brahma Reddy Battula
>
Re: Hadoop-3.2.3 Release Update
Posted by Xiaoqiao He <he...@apache.org>.
Thanks Brahma for initiating this and making hadoop-3.2.3 release happen.
I would like to validate the HBase project (both the latest release and
trunk branch).
Chao Sun will validate the Spark Project (Got in touch with Chao already).
once RC is out.
Thanks and Regards,
- He Xiaoqiao
On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <br...@apache.org>
wrote:
> Hi All,
>
> I cut branch-3.2.3 and it is ready for release. Please commit to
> branch-3.2.3 if any critical/blocker issues need to go.
>
> *This time I am thinking of having downstream projects and companies'
> voices,let's know how this can go. *
>
> - Planning to check with downstream projects like Spark,HBase and Hive
> if they can help on validation(Or running their UT on this branch)
> - Collecting info from Companies who are already deployed and using the
> branch-3.2
>
>
> so that we can make a more stable release on 3.2 (so that features released
> on this branch impact can be known) ,please let me know anybody from these
> communities who can help on this.
>
>
> Planning to create RC by this month end. Any suggestions are welcome.
>
>
>
> --Brahma Reddy Battula
>