You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@bigtop.apache.org by se...@apache.org on 2020/11/27 12:51:26 UTC
[bigtop] branch master updated: Bigtop 1.5.0 release
This is an automated email from the ASF dual-hosted git repository.
sekikn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/bigtop.git
The following commit(s) were added to refs/heads/master by this push:
new 41fc731 Bigtop 1.5.0 release
41fc731 is described below
commit 41fc73144c1573449ed9b97fab7b25432f42c97d
Author: Kengo Seki <se...@apache.org>
AuthorDate: Fri Nov 27 21:50:46 2020 +0900
Bigtop 1.5.0 release
---
CHANGES.txt | 165 +++++++++++++++++++-
src/site/xdoc/release-notes.xml | 328 ++++++++++++++++++++++++++++++++++++++++
2 files changed, 492 insertions(+), 1 deletion(-)
diff --git a/CHANGES.txt b/CHANGES.txt
index e342bad..5c87895 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -17,7 +17,170 @@ Bigtop Changelog
* Release 1.6.0 (unreleased)
-* Release 1.5.0 (2020-11-06)
+* Release 1.5.0 (2020-11-27)
+
+Release Notes - Bigtop - Version 1.5.0
+
+** Sub-task
+ * [BIGTOP-3165] - Bump Spark to 2.4.5
+ * [BIGTOP-3188] - Bump Zeppelin to 0.8.1
+ * [BIGTOP-3215] - Failed to build bigtop/puppet image for OpenSuSE
+ * [BIGTOP-3220] - Add support for Elasticsearch deb build
+ * [BIGTOP-3221] - Add support for Elasticsearch rpm build
+ * [BIGTOP-3222] - Add puppet deployment for Elasticsearch
+ * [BIGTOP-3223] - Add smoke tests for Elasticsearch
+ * [BIGTOP-3276] - Update supported distros in the toolchain manifests for v1.5.0
+ * [BIGTOP-3279] - Bump Zookeeper to 3.4.13
+ * [BIGTOP-3281] - Bump Tez to 0.9.2
+ * [BIGTOP-3282] - Bump Hive to 2.3.6
+ * [BIGTOP-3285] - Bump Kafka to 2.4.0
+ * [BIGTOP-3286] - Bump Ignite to 2.7.6
+ * [BIGTOP-3287] - Bump Hadoop to 2.10.0
+ * [BIGTOP-3288] - Update supported distros in the Docker build scripts for v1.5.0
+ * [BIGTOP-3289] - Bump Tomcat to 8.5.50
+ * [BIGTOP-3297] - Bump HBase to 1.5.0
+ * [BIGTOP-3298] - Bump Phoenix to 4.15.0-HBase-1.5
+ * [BIGTOP-3305] - Bump Flume to 1.9.0
+ * [BIGTOP-3306] - Bump Giraph to 1.2.0
+ * [BIGTOP-3313] - Bump solor to 6.6.6
+ * [BIGTOP-3315] - Bump Alluxio to 1.8.2
+ * [BIGTOP-3343] - Add Debian 10 and Ubuntu 18.04 support to the Docker provisioner
+ * [BIGTOP-3356] - Add CentOS 8 support to the Docker provisioner
+ * [BIGTOP-3363] - Drop Apex, Hama and Tajo in the 1.5.0 release
+ * [BIGTOP-3375] - Bump Livy to 0.7.0 and build it with Python3
+
+** Bug
+ * [BIGTOP-2742] - broken zeppelin init script
+ * [BIGTOP-3029] - "--parser" is invalidated in puppet v4.x. Affects Debian-9 builds
+ * [BIGTOP-3208] - Exception in master branch (and branch-1.4): kafka-server failed to launch due to missing zookeeper AsyncCallback.MultiCallback
+ * [BIGTOP-3216] - Flink smoke test failed on Debian-9
+ * [BIGTOP-3261] - Fix broken BPS Dockerfile
+ * [BIGTOP-3265] - Fix TEZ build error
+ * [BIGTOP-3266] - Rat check failed for one file with unapproved/unknown licenses
+ * [BIGTOP-3290] - Fix build failure of Oozie
+ * [BIGTOP-3291] - Fix build failure of Sqoop
+ * [BIGTOP-3292] - Fix service configuration of sqoop2-server
+ * [BIGTOP-3295] - Fix build failure of hadoop-2.10.0 on CentOS 8
+ * [BIGTOP-3296] - Creating apt repository fails on Ubuntu 18.04
+ * [BIGTOP-3299] - Fix Zookeeper build to make other build success
+ * [BIGTOP-3302] - init scripts using su do not work on recent systemd
+ * [BIGTOP-3303] - Fix build failure of hbase-1.5.0 on Ubuntu
+ * [BIGTOP-3304] - Fix build failure of Flume against hive-2.3.6
+ * [BIGTOP-3308] - Openssl fails to load in hadoop checknative -a on Debian 9
+ * [BIGTOP-3309] - Missing build target for Debian 10 in BigTop 1.5
+ * [BIGTOP-3310] - URL of maven and ant package list page is changed
+ * [BIGTOP-3311] - Fix Alluxio build failure with upgraded hadoop version
+ * [BIGTOP-3312] - Fix Ambari build failure due to maven repo requires https now
+ * [BIGTOP-3314] - Fix flink build failure with upgraded hadoop version
+ * [BIGTOP-3316] - Fix HBase build failure on Arm platform
+ * [BIGTOP-3317] - Oozie sharedlib create command fails when uploading to HDFS
+ * [BIGTOP-3327] - Fix Zeppelin build issue after upgrading Spark-2.4.5
+ * [BIGTOP-3330] - oozie and oozie-client deb packages try to install the same jars in the same dir
+ * [BIGTOP-3331] - Provisioner Deployment failed on Fedora
+ * [BIGTOP-3332] - Add new provisioner yaml configuration for Fedora 31
+ * [BIGTOP-3333] - Fix Hive build after upgrading Spark to 2.4.5
+ * [BIGTOP-3334] - Fix Oozie build after upgrading Spark to 2.4.5
+ * [BIGTOP-3335] - Fix Mahout build after upgrading Spark to 2.4.5
+ * [BIGTOP-3336] - Fix Livy build on CentOS and Fedora
+ * [BIGTOP-3338] - Fix `./gradlew repo` to work with GPDB and QFS on Ubuntu 18.04
+ * [BIGTOP-3339] - Fix Ambari build failure due to using old Bower
+ * [BIGTOP-3341] - Support for Openssl 1.1.1
+ * [BIGTOP-3347] - Fix failures of Hive ProxyFileSystem against Hadoop 2.10.0
+ * [BIGTOP-3348] - Fix Hive test failures caused by NoSuchMethodError of ApplicationId.fromString
+ * [BIGTOP-3351] - Fix sqoop build error on Ubuntu 18.04
+ * [BIGTOP-3352] - Fix qfs build error on Ubuntu 18.04
+ * [BIGTOP-3355] - [Puppet] Make GPG check for repos a configuration and default to true
+ * [BIGTOP-3359] - Fix failure of installing Hadoop due to conflicting .build-id entry on CentOS 8
+ * [BIGTOP-3361] - No libcrypt.so.1 in Fedora-31
+ * [BIGTOP-3364] - Zeppelin build failed in Ubuntu16.04/18.04 and CentOS7
+ * [BIGTOP-3372] - Building Spark fails on Debian 9 and Ubuntu 16.04
+ * [BIGTOP-3376] - Make Mpack as a standalone component in Bigtop
+ * [BIGTOP-3377] - Fix deployment failures on Fedora 31
+ * [BIGTOP-3378] - Fix Livy deployment failure on Debian and Ubuntu
+ * [BIGTOP-3379] - Fix Spark build failure on CentOS 8
+ * [BIGTOP-3380] - Bump Tomcat to 8.5.57
+ * [BIGTOP-3386] - Building GPDB fails on CentOS 8
+ * [BIGTOP-3387] - Building QFS fails on CentOS 8
+ * [BIGTOP-3390] - Building Alluxio fails on Fedora 31
+ * [BIGTOP-3392] - All packaging jobs are failing on Fedora 31 for aarch64 and ppc64le
+ * [BIGTOP-3394] - Building Logstash is failing on CentOS 8, Debian 10 and Ubuntu 18.04
+ * [BIGTOP-3395] - Building Kafka is failing on Fedora 31 for ARM64
+ * [BIGTOP-3396] - Building Ambari is failing on Fedora 31 for ARM64
+ * [BIGTOP-3397] - Building Spark is failing on CentOS 7 for ARM64 and PPC64
+ * [BIGTOP-3398] - Fix GPDB puppet manifest to work
+ * [BIGTOP-3399] - Fix bigtop-groovy build failure
+ * [BIGTOP-3401] - Failed to build Centos-8 docker images for Arm64
+ * [BIGTOP-3406] - Fix Oozie smoke test to work
+ * [BIGTOP-3407] - Ensure the procps package is installed in Debian 10
+ * [BIGTOP-3408] - docker-hadoop.sh generates broken site.yaml from config.yaml containing multiple components
+ * [BIGTOP-3410] - Fix bigtop-tomcat build failure due to downloading problem
+ * [BIGTOP-3413] - QFS doesn't work with Hadoop's TeraGen
+ * [BIGTOP-3414] - Fix the default value of GPDB configuration for smoke test
+ * [BIGTOP-3416] - Fix YCSB to work with CentOS 8 and Fedora 31
+ * [BIGTOP-3418] - Fix Ambari deployment on CentOS 8, Fedora 31 and Debian 10
+ * [BIGTOP-3422] - Fix ambari-server setup failure due to PostgreSQL initdb error
+ * [BIGTOP-3425] - Deploying Ambari fails on Fedora 31
+ * [BIGTOP-3426] - Flink smoke test fails with fedora-31 and debian-10 on arm64
+ * [BIGTOP-3427] - Deploying GPDB fails due to the paramiko installation on some distros
+ * [BIGTOP-3429] - QFS smoke test fails on Ubuntu 16.04
+ * [BIGTOP-3430] - QFS smoke test fails on Fedora 31/arm64
+ * [BIGTOP-3437] - Building Logstash fails due to amazing_print version mismatch
+ * [BIGTOP-3439] - Oozie's smoke test fails on CentOS and Fedora
+ * [BIGTOP-3440] - Building flume fails on all distros
+ * [BIGTOP-3443] - Building Spark fails on Ubuntu 16.04
+ * [BIGTOP-3444] - Bump Hadoop to 2.10.1
+ * [BIGTOP-3446] - Fix toolchain task failure due to undefined variable in renv.pp
+ * [BIGTOP-3448] - Building Alluxio fails on all distros
+ * [BIGTOP-3449] - Failed to build Haddop-2.10.1 on Arm64
+ * [BIGTOP-3451] - Fix smoke test for SparkR
+ * [BIGTOP-3455] - Hive 2.2.x bug with DBTokenStore
+
+** New Feature
+ * [BIGTOP-2961] - Add Apache Livy (incubating) to Bigtop stack
+ * [BIGTOP-3219] - Add Elasticsearch as component
+ * [BIGTOP-3293] - Add hadoop-kms package
+ * [BIGTOP-3319] - Add Logstash as Bigtop component
+ * [BIGTOP-3320] - Add Kibana as Bigtop component
+ * [BIGTOP-3325] - Spark LICENSE files should be exempted by RAT check
+ * [BIGTOP-3411] - Disable unnecessary scm check in Buildnumber-maven-plugin for Mpack
+
+** Improvement
+ * [BIGTOP-3092] - kafka charm: support juju storage
+ * [BIGTOP-3168] - Kafka smoke tests implementation
+ * [BIGTOP-3214] - Install python libraries for Livy
+ * [BIGTOP-3217] - Add smoke tests for Apache Livy
+ * [BIGTOP-3234] - TEZ smoke tests implementation
+ * [BIGTOP-3236] - Zeppelin smoke tests implementation
+ * [BIGTOP-3237] - Add smoke tests for YCSB
+ * [BIGTOP-3259] - Update the default stack version for docker-provisioner to 1.4.0
+ * [BIGTOP-3300] - Add puppet manifests for hadoop-kms
+ * [BIGTOP-3301] - Add smoke-tests for hadoop-kms
+ * [BIGTOP-3337] - Remove Node.js from the toolchain
+ * [BIGTOP-3353] - hive.hwi.war.file configuration is no longer needed
+ * [BIGTOP-3358] - get_roles() function should fail if a component is not in roles_map
+ * [BIGTOP-3362] - Unable to install spark-python package on CentOS8 due to lack of python package
+ * [BIGTOP-3369] - RHEL8 does not have PowerTools repo but CodeReady Builder
+ * [BIGTOP-3371] - Unable to build Apache Ambari on RHEL8
+ * [BIGTOP-3374] - Add dependencies on the utilities provided by Bigtop to bigtop.bom
+ * [BIGTOP-3389] - Extend timeout for installing protobuf and R packages
+ * [BIGTOP-3391] - Support GPDB on Perl 5.30+ environment
+ * [BIGTOP-3405] - Make gpg_check in docker-hadoop.sh configurable
+ * [BIGTOP-3415] - Extend timeout for Spark smoke test
+ * [BIGTOP-3431] - Update github Readme.md to be more newbie friendly
+ * [BIGTOP-3441] - Suppress YCSB smoke test output
+
+** Wish
+ * [BIGTOP-3268] - Add ability to change limits for nagios checks in charm
+
+** Task
+ * [BIGTOP-3015] - hadoop-spark bundle correction
+ * [BIGTOP-3123] - Define Bigtop 1.5.0 release BOM
+ * [BIGTOP-3318] - Use secure repo in bigtop-tests
+ * [BIGTOP-3322] - Lintian Warnings in Hadoop
+ * [BIGTOP-3340] - Add Masatake Iwasaki to team list
+ * [BIGTOP-3409] - Move bigtop website off from CMS: staging
+ * [BIGTOP-3419] - Automate Deployment to asf-site
+
* Release 1.4.0 (2019-03-24)
diff --git a/src/site/xdoc/release-notes.xml b/src/site/xdoc/release-notes.xml
index 6bc0c74..e75c7cd 100644
--- a/src/site/xdoc/release-notes.xml
+++ b/src/site/xdoc/release-notes.xml
@@ -17,6 +17,334 @@
<section name="Bigtop Project Release Notes">
<!-- Paste release notes from https://issues.apache.org/jira/browse/BIGTOP here. -->
+ <h3>Release Notes - Bigtop - Version 1.5.0</h3>
+
+<h2> Sub-task
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3165'>BIGTOP-3165</a>] - Bump Spark to 2.4.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3188'>BIGTOP-3188</a>] - Bump Zeppelin to 0.8.1
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3215'>BIGTOP-3215</a>] - Failed to build bigtop/puppet image for OpenSuSE
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3220'>BIGTOP-3220</a>] - Add support for Elasticsearch deb build
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3221'>BIGTOP-3221</a>] - Add support for Elasticsearch rpm build
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3222'>BIGTOP-3222</a>] - Add puppet deployment for Elasticsearch
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3223'>BIGTOP-3223</a>] - Add smoke tests for Elasticsearch
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3276'>BIGTOP-3276</a>] - Update supported distros in the toolchain manifests for v1.5.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3279'>BIGTOP-3279</a>] - Bump Zookeeper to 3.4.13
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3281'>BIGTOP-3281</a>] - Bump Tez to 0.9.2
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3282'>BIGTOP-3282</a>] - Bump Hive to 2.3.6
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3285'>BIGTOP-3285</a>] - Bump Kafka to 2.4.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3286'>BIGTOP-3286</a>] - Bump Ignite to 2.7.6
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3287'>BIGTOP-3287</a>] - Bump Hadoop to 2.10.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3288'>BIGTOP-3288</a>] - Update supported distros in the Docker build scripts for v1.5.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3289'>BIGTOP-3289</a>] - Bump Tomcat to 8.5.50
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3297'>BIGTOP-3297</a>] - Bump HBase to 1.5.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3298'>BIGTOP-3298</a>] - Bump Phoenix to 4.15.0-HBase-1.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3305'>BIGTOP-3305</a>] - Bump Flume to 1.9.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3306'>BIGTOP-3306</a>] - Bump Giraph to 1.2.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3313'>BIGTOP-3313</a>] - Bump solor to 6.6.6
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3315'>BIGTOP-3315</a>] - Bump Alluxio to 1.8.2
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3343'>BIGTOP-3343</a>] - Add Debian 10 and Ubuntu 18.04 support to the Docker provisioner
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3356'>BIGTOP-3356</a>] - Add CentOS 8 support to the Docker provisioner
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3363'>BIGTOP-3363</a>] - Drop Apex, Hama and Tajo in the 1.5.0 release
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3375'>BIGTOP-3375</a>] - Bump Livy to 0.7.0 and build it with Python3
+</li>
+</ul>
+
+<h2> Bug
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2742'>BIGTOP-2742</a>] - broken zeppelin init script
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3029'>BIGTOP-3029</a>] - "--parser" is invalidated in puppet v4.x. Affects Debian-9 builds
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3208'>BIGTOP-3208</a>] - Exception in master branch (and branch-1.4): kafka-server failed to launch due to missing zookeeper AsyncCallback.MultiCallback
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3216'>BIGTOP-3216</a>] - Flink smoke test failed on Debian-9
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3261'>BIGTOP-3261</a>] - Fix broken BPS Dockerfile
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3265'>BIGTOP-3265</a>] - Fix TEZ build error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3266'>BIGTOP-3266</a>] - Rat check failed for one file with unapproved/unknown licenses
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3290'>BIGTOP-3290</a>] - Fix build failure of Oozie
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3291'>BIGTOP-3291</a>] - Fix build failure of Sqoop
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3292'>BIGTOP-3292</a>] - Fix service configuration of sqoop2-server
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3295'>BIGTOP-3295</a>] - Fix build failure of hadoop-2.10.0 on CentOS 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3296'>BIGTOP-3296</a>] - Creating apt repository fails on Ubuntu 18.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3299'>BIGTOP-3299</a>] - Fix Zookeeper build to make other build success
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3302'>BIGTOP-3302</a>] - init scripts using su do not work on recent systemd
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3303'>BIGTOP-3303</a>] - Fix build failure of hbase-1.5.0 on Ubuntu
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3304'>BIGTOP-3304</a>] - Fix build failure of Flume against hive-2.3.6
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3308'>BIGTOP-3308</a>] - Openssl fails to load in hadoop checknative -a on Debian 9
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3309'>BIGTOP-3309</a>] - Missing build target for Debian 10 in BigTop 1.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3310'>BIGTOP-3310</a>] - URL of maven and ant package list page is changed
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3311'>BIGTOP-3311</a>] - Fix Alluxio build failure with upgraded hadoop version
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3312'>BIGTOP-3312</a>] - Fix Ambari build failure due to maven repo requires https now
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3314'>BIGTOP-3314</a>] - Fix flink build failure with upgraded hadoop version
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3316'>BIGTOP-3316</a>] - Fix HBase build failure on Arm platform
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3317'>BIGTOP-3317</a>] - Oozie sharedlib create command fails when uploading to HDFS
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3327'>BIGTOP-3327</a>] - Fix Zeppelin build issue after upgrading Spark-2.4.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3330'>BIGTOP-3330</a>] - oozie and oozie-client deb packages try to install the same jars in the same dir
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3331'>BIGTOP-3331</a>] - Provisioner Deployment failed on Fedora
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3332'>BIGTOP-3332</a>] - Add new provisioner yaml configuration for Fedora 31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3333'>BIGTOP-3333</a>] - Fix Hive build after upgrading Spark to 2.4.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3334'>BIGTOP-3334</a>] - Fix Oozie build after upgrading Spark to 2.4.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3335'>BIGTOP-3335</a>] - Fix Mahout build after upgrading Spark to 2.4.5
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3336'>BIGTOP-3336</a>] - Fix Livy build on CentOS and Fedora
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3338'>BIGTOP-3338</a>] - Fix `./gradlew repo` to work with GPDB and QFS on Ubuntu 18.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3339'>BIGTOP-3339</a>] - Fix Ambari build failure due to using old Bower
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3341'>BIGTOP-3341</a>] - Support for Openssl 1.1.1
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3347'>BIGTOP-3347</a>] - Fix failures of Hive ProxyFileSystem against Hadoop 2.10.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3348'>BIGTOP-3348</a>] - Fix Hive test failures caused by NoSuchMethodError of ApplicationId.fromString
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3351'>BIGTOP-3351</a>] - Fix sqoop build error on Ubuntu 18.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3352'>BIGTOP-3352</a>] - Fix qfs build error on Ubuntu 18.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3355'>BIGTOP-3355</a>] - [Puppet] Make GPG check for repos a configuration and default to true
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3359'>BIGTOP-3359</a>] - Fix failure of installing Hadoop due to conflicting .build-id entry on CentOS 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3361'>BIGTOP-3361</a>] - No libcrypt.so.1 in Fedora-31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3364'>BIGTOP-3364</a>] - Zeppelin build failed in Ubuntu16.04/18.04 and CentOS7
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3372'>BIGTOP-3372</a>] - Building Spark fails on Debian 9 and Ubuntu 16.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3376'>BIGTOP-3376</a>] - Make Mpack as a standalone component in Bigtop
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3377'>BIGTOP-3377</a>] - Fix deployment failures on Fedora 31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3378'>BIGTOP-3378</a>] - Fix Livy deployment failure on Debian and Ubuntu
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3379'>BIGTOP-3379</a>] - Fix Spark build failure on CentOS 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3380'>BIGTOP-3380</a>] - Bump Tomcat to 8.5.57
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3386'>BIGTOP-3386</a>] - Building GPDB fails on CentOS 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3387'>BIGTOP-3387</a>] - Building QFS fails on CentOS 8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3390'>BIGTOP-3390</a>] - Building Alluxio fails on Fedora 31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3392'>BIGTOP-3392</a>] - All packaging jobs are failing on Fedora 31 for aarch64 and ppc64le
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3394'>BIGTOP-3394</a>] - Building Logstash is failing on CentOS 8, Debian 10 and Ubuntu 18.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3395'>BIGTOP-3395</a>] - Building Kafka is failing on Fedora 31 for ARM64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3396'>BIGTOP-3396</a>] - Building Ambari is failing on Fedora 31 for ARM64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3397'>BIGTOP-3397</a>] - Building Spark is failing on CentOS 7 for ARM64 and PPC64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3398'>BIGTOP-3398</a>] - Fix GPDB puppet manifest to work
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3399'>BIGTOP-3399</a>] - Fix bigtop-groovy build failure
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3401'>BIGTOP-3401</a>] - Failed to build Centos-8 docker images for Arm64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3406'>BIGTOP-3406</a>] - Fix Oozie smoke test to work
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3407'>BIGTOP-3407</a>] - Ensure the procps package is installed in Debian 10
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3408'>BIGTOP-3408</a>] - docker-hadoop.sh generates broken site.yaml from config.yaml containing multiple components
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3410'>BIGTOP-3410</a>] - Fix bigtop-tomcat build failure due to downloading problem
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3413'>BIGTOP-3413</a>] - QFS doesn't work with Hadoop's TeraGen
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3414'>BIGTOP-3414</a>] - Fix the default value of GPDB configuration for smoke test
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3416'>BIGTOP-3416</a>] - Fix YCSB to work with CentOS 8 and Fedora 31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3418'>BIGTOP-3418</a>] - Fix Ambari deployment on CentOS 8, Fedora 31 and Debian 10
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3422'>BIGTOP-3422</a>] - Fix ambari-server setup failure due to PostgreSQL initdb error
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3425'>BIGTOP-3425</a>] - Deploying Ambari fails on Fedora 31
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3426'>BIGTOP-3426</a>] - Flink smoke test fails with fedora-31 and debian-10 on arm64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3427'>BIGTOP-3427</a>] - Deploying GPDB fails due to the paramiko installation on some distros
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3429'>BIGTOP-3429</a>] - QFS smoke test fails on Ubuntu 16.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3430'>BIGTOP-3430</a>] - QFS smoke test fails on Fedora 31/arm64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3437'>BIGTOP-3437</a>] - Building Logstash fails due to amazing_print version mismatch
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3439'>BIGTOP-3439</a>] - Oozie's smoke test fails on CentOS and Fedora
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3440'>BIGTOP-3440</a>] - Building flume fails on all distros
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3443'>BIGTOP-3443</a>] - Building Spark fails on Ubuntu 16.04
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3444'>BIGTOP-3444</a>] - Bump Hadoop to 2.10.1
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3446'>BIGTOP-3446</a>] - Fix toolchain task failure due to undefined variable in renv.pp
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3448'>BIGTOP-3448</a>] - Building Alluxio fails on all distros
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3449'>BIGTOP-3449</a>] - Failed to build Haddop-2.10.1 on Arm64
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3451'>BIGTOP-3451</a>] - Fix smoke test for SparkR
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3455'>BIGTOP-3455</a>] - Hive 2.2.x bug with DBTokenStore
+</li>
+</ul>
+
+<h2> New Feature
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2961'>BIGTOP-2961</a>] - Add Apache Livy (incubating) to Bigtop stack
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3219'>BIGTOP-3219</a>] - Add Elasticsearch as component
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3293'>BIGTOP-3293</a>] - Add hadoop-kms package
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3319'>BIGTOP-3319</a>] - Add Logstash as Bigtop component
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3320'>BIGTOP-3320</a>] - Add Kibana as Bigtop component
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3325'>BIGTOP-3325</a>] - Spark LICENSE files should be exempted by RAT check
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3411'>BIGTOP-3411</a>] - Disable unnecessary scm check in Buildnumber-maven-plugin for Mpack
+</li>
+</ul>
+
+<h2> Improvement
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3092'>BIGTOP-3092</a>] - kafka charm: support juju storage
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3168'>BIGTOP-3168</a>] - Kafka smoke tests implementation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3214'>BIGTOP-3214</a>] - Install python libraries for Livy
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3217'>BIGTOP-3217</a>] - Add smoke tests for Apache Livy
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3234'>BIGTOP-3234</a>] - TEZ smoke tests implementation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3236'>BIGTOP-3236</a>] - Zeppelin smoke tests implementation
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3237'>BIGTOP-3237</a>] - Add smoke tests for YCSB
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3259'>BIGTOP-3259</a>] - Update the default stack version for docker-provisioner to 1.4.0
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3300'>BIGTOP-3300</a>] - Add puppet manifests for hadoop-kms
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3301'>BIGTOP-3301</a>] - Add smoke-tests for hadoop-kms
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3337'>BIGTOP-3337</a>] - Remove Node.js from the toolchain
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3353'>BIGTOP-3353</a>] - hive.hwi.war.file configuration is no longer needed
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3358'>BIGTOP-3358</a>] - get_roles() function should fail if a component is not in roles_map
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3362'>BIGTOP-3362</a>] - Unable to install spark-python package on CentOS8 due to lack of python package
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3369'>BIGTOP-3369</a>] - RHEL8 does not have PowerTools repo but CodeReady Builder
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3371'>BIGTOP-3371</a>] - Unable to build Apache Ambari on RHEL8
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3374'>BIGTOP-3374</a>] - Add dependencies on the utilities provided by Bigtop to bigtop.bom
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3389'>BIGTOP-3389</a>] - Extend timeout for installing protobuf and R packages
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3391'>BIGTOP-3391</a>] - Support GPDB on Perl 5.30+ environment
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3405'>BIGTOP-3405</a>] - Make gpg_check in docker-hadoop.sh configurable
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3415'>BIGTOP-3415</a>] - Extend timeout for Spark smoke test
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3431'>BIGTOP-3431</a>] - Update github Readme.md to be more newbie friendly
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3441'>BIGTOP-3441</a>] - Suppress YCSB smoke test output
+</li>
+</ul>
+
+<h2> Wish
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3268'>BIGTOP-3268</a>] - Add ability to change limits for nagios checks in charm
+</li>
+</ul>
+
+<h2> Task
+</h2>
+<ul>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3015'>BIGTOP-3015</a>] - hadoop-spark bundle correction
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3123'>BIGTOP-3123</a>] - Define Bigtop 1.5.0 release BOM
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3318'>BIGTOP-3318</a>] - Use secure repo in bigtop-tests
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3322'>BIGTOP-3322</a>] - Lintian Warnings in Hadoop
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3340'>BIGTOP-3340</a>] - Add Masatake Iwasaki to team list
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3409'>BIGTOP-3409</a>] - Move bigtop website off from CMS: staging
+</li>
+<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-3419'>BIGTOP-3419</a>] - Automate Deployment to asf-site
+</li>
+</ul>
+
<h3>Release Notes - Bigtop - Version 1.4.0</h3>
<h2> Sub-task