You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Brahma Reddy Battula <br...@apache.org> on 2021/08/08 13:54:40 UTC
Re: [External Sender] Re: [DISCUSS] Hadoop 3.2.3 release
**Important update** Hadoop-3.2.3 Release progress.
I cut branch-3.2.3 and it is ready for release. Please commit to
branch-3.2.3 if any critical/blocker issues need to go.
As previously communicated,Planning to create RC by this month end. Any
suggestions are welcome.
On Thu, Aug 5, 2021 at 10:15 PM Jason Wen <zh...@workday.com> wrote:
> Hi Steve,
>
> Which aws-java-sdk-bundle version did you test and encounter the following
> test failures?
>
> Thanks,
> Jason
>
> On 8/4/21, 7:51 AM, "Steve Loughran" <st...@cloudera.com.INVALID> wrote:
>
> it didn't take, so don't worry about it. Test failures
>
> java.lang.IllegalArgumentException: Input is expected to be encoded in
> multiple of 4 bytes but found: 75
> at com.amazonaws.util.Base64Codec.decode(Base64Codec.java:198)
> at com.amazonaws.util.Base64.decode(Base64.java:116)
> at
>
> com.amazonaws.services.s3.AmazonS3Client.populateSSE_C(AmazonS3Client.java:4620)
> at
>
> com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1806)
> at
>
> org.apache.hadoop.fs.s3a.S3AFileSystem.putObjectDirect(S3AFileSystem.java:1603)
> at
>
> org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$createEmptyObject$13(S3AFileSystem.java:2828)
> at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109)
> at org.apache.hadoop.fs.s3a.Invoker.lambda$retry$3(Invoker.java:265)
> at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:322)
> at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:261)
> at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:236)
> at
>
> org.apache.hadoop.fs.s3a.S3AFileSystem.createEmptyObject(S3AFileSystem.java:2826)
> at
>
> org.apache.hadoop.fs.s3a.S3AFileSystem.createFakeDirectory(S3AFileSystem.java:2801)
> at
>
> org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:2146)
> at
> org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:2079)
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2304)
> at
>
> org.apache.hadoop.fs.contract.AbstractFSContractTestBase.mkdirs(AbstractFSContractTestBase.java:338)
> at
>
> org.apache.hadoop.fs.contract.AbstractFSContractTestBase.setup(AbstractFSContractTestBase.java:193)
>
> On Tue, 3 Aug 2021 at 19:41, Brahma Reddy Battula <br...@apache.org>
> wrote:
>
> > Hi Steve,
> >
> > Is there any jira for this ??
> >
> >
> >
> > On Tue, 3 Aug 2021 at 4:05 PM, Steve Loughran
> <stevel@cloudera.com.invalid
> > >
> > wrote:
> >
> > > I'm testing how well a backport of the latest AWS SDK goes; if all
> is
> > > docile there then I'll merge that. Due diligence more than anything
> > > else....one of the shaded netty JARs (never used by our code) has
> a CVE
> > in
> > > older versions
> > >
> > > On Mon, 2 Aug 2021 at 08:07, Akira Ajisaka <aa...@apache.org>
> wrote:
> > >
> > > > Hi Steven,
> > > >
> > > > Marked YARN-8990 and YARN-8992 as release-blocker. In addition, I
> > > > opened a PR to backport YARN-8990:
> > > >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_pull_3254&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=tLml0Gisl-xPsd4B67BNBZtPsz1T0qBPppHYRzLLl_0&e=
> > > >
> > > > Thanks,
> > > > Akira
> > > >
> > > > On Thu, Jul 29, 2021 at 10:36 AM Steven Rand <
> stevenjrand@gmail.com>
> > > > wrote:
> > > > >
> > > > > I think it would be helpful if we could include YARN-8990 and
> > YARN-8992
> > > > in the 3.2.3 release. Both are important fixes which were
> included in
> > > > 3.2.0, but never made their way to branch-3.2, so were omitted
> from
> > both
> > > > 3.2.1 and 3.2.2.
> > > > >
> > > > > Best,
> > > > > Steve
> > > > >
> > > > > On Wed, Jul 28, 2021 at 5:14 AM Xiaoqiao He <
> xq.he2009@gmail.com>
> > > wrote:
> > > > >>
> > > > >> cc @dev mail-list.
> > > > >>
> > > > >> On Wed, Jul 28, 2021 at 5:11 PM Xiaoqiao He <
> xq.he2009@gmail.com>
> > > > wrote:
> > > > >>
> > > > >> > Hi Brahma,
> > > > >> >
> > > > >> > I just created version 3.2.4, and changed all unresolved
> issues
> > > > (target
> > > > >> > version/s: 3.2.3) to 3.2.4 after checking both of them are
> not
> > > blocker
> > > > >> > issues. Dashboard[1] is clean now.
> > > > >> >
> > > > >> > Regards,
> > > > >> > - He Xiaoqiao
> > > > >> >
> > > > >> > [1]
> > > > >> >
> > > >
> > >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12336167&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=VeVkQq1tQiHaXN3SEUQXC8L3HMLuaePTXxb2iqlSvKo&e=
> > > > >> >
> > > > >> > On Sun, Jul 25, 2021 at 7:45 PM Brahma Reddy Battula <
> > > > brahma@apache.org>
> > > > >> > wrote:
> > > > >> >
> > > > >> >> Hi Xiaoqiao,
> > > > >> >>
> > > > >> >> Thanks for creating the Dashboard, we need to change the
> filters
> > > and
> > > > >> >> target versions in the jira.
> > > > >> >>
> > > > >> >> On Sun, Jul 25, 2021 at 2:05 PM Xiaoqiao He <
> xq.he2009@gmail.com
> > >
> > > > wrote:
> > > > >> >>
> > > > >> >>> Thanks Brahma for volunteering and driving this release
> plan. I
> > > just
> > > > >> >>> created a dashboard for 3.2.3 release[1].
> > > > >> >>> I would like to support for this release line if need. (cc
> > Brahma)
> > > > >> >>>
> > > > >> >>> Thanks. Regards,
> > > > >> >>> - He Xiaoqiao
> > > > >> >>>
> > > > >> >>> [1]
> > > > >> >>>
> > > > >> >>>
> > > >
> > >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12336167&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=VeVkQq1tQiHaXN3SEUQXC8L3HMLuaePTXxb2iqlSvKo&e=
> > > > >> >>>
> > > > >> >>>
> > > > >> >>> On Sat, Jul 24, 2021 at 1:16 AM Akira Ajisaka <
> > > aajisaka@apache.org>
> > > > >> >>> wrote:
> > > > >> >>>
> > > > >> >>> > Hi Brahma,
> > > > >> >>> >
> > > > >> >>> > Thank you for volunteering!
> > > > >> >>> >
> > > > >> >>> > -Akira
> > > > >> >>> >
> > > > >> >>> > On Fri, Jul 23, 2021 at 5:57 PM Brahma Reddy Battula <
> > > > >> >>> brahma@apache.org>
> > > > >> >>> > wrote:
> > > > >> >>> > >
> > > > >> >>> > > Hi Akira,
> > > > >> >>> > >
> > > > >> >>> > > Thanks for bringing this..
> > > > >> >>> > >
> > > > >> >>> > > I want to drive this if nobody already plan to do
> this..
> > > > >> >>> > >
> > > > >> >>> > >
> > > > >> >>> > > On Thu, 22 Jul 2021 at 8:48 AM, Akira Ajisaka <
> > > > aajisaka@apache.org>
> > > > >> >>> > wrote:
> > > > >> >>> > >
> > > > >> >>> > > > Hi all,
> > > > >> >>> > > >
> > > > >> >>> > > > Hadoop 3.2.2 was released half a year ago, and now,
> we
> > have
> > > > >> >>> > > > accumulated more than 230 commits [1]. Therefore I
> want to
> > > > start
> > > > >> >>> the
> > > > >> >>> > > > release work for 3.2.3.
> > > > >> >>> > > >
> > > > >> >>> > > > There is one blocker for 3.2.3 [2].
> > > > >> >>> > > > -
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HDFS-2D12920&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=cLCuDw5WX1rSf1Mi96H60HNBRIC6HHZHvZc__Dt1cVU&e=
> > > > >> >>> > > >
> > > > >> >>> > > > Is there anyone who would volunteer to be the 3.2.3
> > release
> > > > >> >>> manager?
> > > > >> >>> > > > Are there any other blockers? If any, please file an
> > issue,
> > > > raise
> > > > >> >>> the
> > > > >> >>> > > > blocker, and add the target version.
> > > > >> >>> > > >
> > > > >> >>> > > > [1]
> > > > >> >>> > > >
> > > > >> >>> >
> > > > >> >>>
> > > >
> > >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_issues_-3Fjql-3Dproject-2520in-2520-28HADOOP-252C-2520HDFS-252C-2520YARN-252C-2520MAPREDUCE-29-2520AND-2520fixVersion-2520-253D-25203.2.3&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=ZxoohH5FSfHaUmkC0tO3oet0m9eaWXalALcon1KrljA&e=
> > > > >> >>> > > > [2]
> > > > >> >>> > > >
> > > > >> >>> >
> > > > >> >>>
> > > >
> > >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_issues_-3Fjql-3Dproject-2520in-2520-28HADOOP-252C-2520HDFS-252C-2520YARN-252C-2520MAPREDUCE-29-2520AND-2520priority-2520in-2520-28Blocker-252C-2520Critical-29-2520AND-2520resolution-2520-253D-2520Unresolved-2520AND-2520cf-255B12310320-255D-2520-253D-25203.2.3&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=Q10Fi_NA0ieWt53zYJucf_VqrrJ7vS1_uP642EJTWKI&e=
> > > > >> >>> > > >
> > > > >> >>> > > > Regards,
> > > > >> >>> > > > Akira
> > > > >> >>> > > >
> > > > >> >>> > > >
> > > > >> >>>
> > > >
> ---------------------------------------------------------------------
> > > > >> >>> > > > To unsubscribe, e-mail:
> > > > >> >>> mapreduce-dev-unsubscribe@hadoop.apache.org
> > > > >> >>> > > > For additional commands, e-mail:
> > > > >> >>> mapreduce-dev-help@hadoop.apache.org
> > > > >> >>> > > >
> > > > >> >>> > > > --
> > > > >> >>> > >
> > > > >> >>> > >
> > > > >> >>> > >
> > > > >> >>> > > --Brahma Reddy Battula
> > > > >> >>> >
> > > > >> >>> >
> > > >
> ---------------------------------------------------------------------
> > > > >> >>> > To unsubscribe, e-mail:
> > > common-dev-unsubscribe@hadoop.apache.org
> > > > >> >>> > For additional commands, e-mail:
> > > > common-dev-help@hadoop.apache.org
> > > > >> >>> >
> > > > >> >>> >
> > > > >> >>>
> > > > >> >>
> > > > >> >>
> > > > >> >> --
> > > > >> >>
> > > > >> >>
> > > > >> >>
> > > > >> >> --Brahma Reddy Battula
> > > > >> >>
> > > > >> >
> > > >
> > > >
> ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail:
> mapreduce-dev-unsubscribe@hadoop.apache.org
> > > > For additional commands, e-mail:
> mapreduce-dev-help@hadoop.apache.org
> > > >
> > > >
> > >
> > --
> >
> >
> >
> > --Brahma Reddy Battula
> >
>
>
--
--Brahma Reddy Battula