[jira] [Commented] (BIGTOP-3606) Bump Hadoop to 3.2.3

["Masatake Iwasaki (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506283#comment-17506283 ] 

Masatake Iwasaki commented on BIGTOP-3606:
------------------------------------------

[Vote for Hadoop 3.2.3 RC0|https://lists.apache.org/thread/nwcnmntn8zp4mzb7fmsk1r15txodp7xx] is ongoing. I created [PoC patch|https://github.com/iwasakims/bigtop/tree/BIGTOP-3606-poc] using the RC0. I added following changes.

* using locally installed protoc artifact for aarch64 and ppc64le instead of reverting HADOOP-16598.
* removed patches already contained in Hadoop 3.2.3 such as HADOOP-15939, HADOOP-17569, HAODOP-14922 and YARN-9783.
* patch2-exclude-spotbugs-annotations.diff is not longer needed after HADOOP-17849.
* patch4-revert-HADOOP-17119-and-HADOOP-16676.diff is no longer needed since HBase 2.4 is using shaded jetty.

hadoop-pkg, hbase-pkg, hive-pkg and spark-pkg worked on Rocky Linux 8 with the patch applied. smoke-tests passed.

{noformat}
$ ./docker-hadoop.sh \
   --create 3 \
   --image bigtop/puppet:trunk-rockylinux-8 \
   --memory 8g \
   --repo file:///bigtop-home/output \
   --disable-gpg-check \
   --stack hdfs,yarn,mapreduce,hbase,hive,spark \
   --smoke-tests hdfs,yarn,mapreduce,hbase,hive,spark
{noformat}

> Bump Hadoop to 3.2.3
> --------------------
>
>                 Key: BIGTOP-3606
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3606
>             Project: Bigtop
>          Issue Type: Sub-task
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)