You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by su...@apache.org on 2022/03/04 14:30:24 UTC

[cloudstack-documentation] branch 4.16 updated: 4.16.1.0 release notes/docs updates (#264)

This is an automated email from the ASF dual-hosted git repository.

sureshanaparti pushed a commit to branch 4.16
in repository https://gitbox.apache.org/repos/asf/cloudstack-documentation.git


The following commit(s) were added to refs/heads/4.16 by this push:
     new 844f992  4.16.1.0 release notes/docs updates (#264)
844f992 is described below

commit 844f992db15dc1053f3f2828ae6f5f7512457303
Author: Suresh Kumar Anaparti <su...@gmail.com>
AuthorDate: Fri Mar 4 20:00:20 2022 +0530

    4.16.1.0 release notes/docs updates (#264)
    
    * 4.16.1.0 release notes/docs updates
---
 source/_global.rst                        |  22 +-
 source/conf.py                            |   2 +-
 source/releasenotes/about.rst             |  18 +
 source/releasenotes/changes.rst           | 534 +++++++++++++++++++++++++++++-
 source/upgrading/index.rst                |   1 +
 source/upgrading/upgrade/upgrade-4.16.rst | 304 +++++++++++++++++
 6 files changed, 868 insertions(+), 13 deletions(-)

diff --git a/source/_global.rst b/source/_global.rst
index 82397e9..3a8ad3d 100644
--- a/source/_global.rst
+++ b/source/_global.rst
@@ -25,19 +25,19 @@
 
 .. Latest version systemvm template name
 
-.. |sysvm64-version|     replace:: 4.16.0
-.. |sysvm64-name-xen|    replace:: systemvm-xenserver-4.16.0
-.. |sysvm64-name-kvm|    replace:: systemvm-kvm-4.16.0
-.. |sysvm64-name-vmware| replace:: systemvm-vmware-4.16.0
-.. |sysvm64-name-hyperv| replace:: systemvm-hyperv-4.16.0
-.. |sysvm64-name-ovm|    replace:: systemvm-ovm-4.16.0
+.. |sysvm64-version|     replace:: 4.16.1
+.. |sysvm64-name-xen|    replace:: systemvm-xenserver-4.16.1
+.. |sysvm64-name-kvm|    replace:: systemvm-kvm-4.16.1
+.. |sysvm64-name-vmware| replace:: systemvm-vmware-4.16.1
+.. |sysvm64-name-hyperv| replace:: systemvm-hyperv-4.16.1
+.. |sysvm64-name-ovm|    replace:: systemvm-ovm-4.16.1
 
 .. Latest version systemvm template URL
-.. |sysvm64-url-xen|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.0-xen.vhd.bz2
-.. |sysvm64-url-kvm|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.0-kvm.qcow2.bz2
-.. |sysvm64-url-vmware| replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.0-vmware.ova
-.. |sysvm64-url-hyperv| replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.0-hyperv.vhd.zip
-.. |sysvm64-url-ovm|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.0-ovm.raw.bz2
+.. |sysvm64-url-xen|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.1-xen.vhd.bz2
+.. |sysvm64-url-kvm|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.1-kvm.qcow2.bz2
+.. |sysvm64-url-vmware| replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.1-vmware.ova
+.. |sysvm64-url-hyperv| replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.1-hyperv.vhd.zip
+.. |sysvm64-url-ovm|    replace:: http://download.cloudstack.org/systemvm/4.16/systemvmtemplate-4.16.1-ovm.raw.bz2
 
 .. Version specific: 4.5 systemvm template URL
 .. |acs45-sysvm64-url-xen|    replace:: https://download.cloudstack.org/systemvm/4.5/systemvm64template-4.5-xen.vhd.bz2
diff --git a/source/conf.py b/source/conf.py
index 55fb01d..726911a 100644
--- a/source/conf.py
+++ b/source/conf.py
@@ -26,7 +26,7 @@ author = 'Apache CloudStack Project'
 # The short X.Y version
 version = '4.16'
 # The full version, including alpha/beta/rc tags
-release = '4.16.0.0'
+release = '4.16.1.0'
 
 rst_epilog = """
 .. include:: /_global.rst 
diff --git a/source/releasenotes/about.rst b/source/releasenotes/about.rst
index 1889d6f..824ba5c 100644
--- a/source/releasenotes/about.rst
+++ b/source/releasenotes/about.rst
@@ -17,6 +17,24 @@
 What's New in |release|
 =======================
 
+Apache CloudStack |release| is a 4.16 LTS minor release with over 150 fixes and
+improvements since the 4.16.0.0 release. Highlights include:
+
+• System VM Template improvements
+• CKS enhancements
+• Support for VMware 7.0u2, 7.0u3
+• Several Hypervisor (VMware, KVM, XenServer) fixes and improvements 
+• Several UI fixes and improvements
+• First Install and Onboarding Message improvements
+• Log4j v1.x migration to reload4j v1.2.18.0
+• Several security fixes addressing multiple CVEs and improvements
+
+The full list of fixes and improvements can be found in the project release notes at
+https://docs.cloudstack.apache.org/en/4.16.1.0/releasenotes/changes.html
+
+What's New in 4.16.0.0
+=======================
+
 Apache CloudStack 4.16.0.0 is a 4.16 LTS release with over 22 major new
 features, and over 244 enhancements and fixes since 4.15. Highlights include:
 
diff --git a/source/releasenotes/changes.rst b/source/releasenotes/changes.rst
index f2ada48..730b240 100644
--- a/source/releasenotes/changes.rst
+++ b/source/releasenotes/changes.rst
@@ -13,8 +13,540 @@
    specific language governing permissions and limitations
    under the License.
 
+Changes in |release| since 4.16.0.0
+====================================
 
-Changes in |release| since 4.15
+Apache CloudStack uses GitHub https://github.com/apache/cloudstack/milestone/22?closed=1
+ to track its issues.
+
+.. cssclass:: table-striped table-bordered table-hover
+
+
++-------------------------+----------+------------------------------------------------------------+
+| Version                 | Github   | Description                                                |
++=========================+==========+============================================================+
+| 4.16.1.0                | `#6042`_ | [vmware, ssvm] Scale down of ssvm                          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6029`_ | [KVM] Disconnect the volumes with the proper storage       |
+|                         |          | adaptor.                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6027`_ | prevent <ctrl>-<enter> handler from <space> from toggling  |
+|                         |          | checkboxes                                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6034`_ | ui: add VXLAN network identifiers (VNIs) in                |
+|                         |          | message.guest.traffic.in.advanced.zone                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6035`_ | api: update description of internal LB APIs                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6020`_ | UI: Reword the setting panel warning                       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6003`_ | ui: minor change with help text on dashboard               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#6000`_ | server: reapply checkVmProfileAndHost to check guest os    |
+|                         |          | preference                                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5863`_ | CKS Enhancements and SystemVM template upgrade             |
+|                         |          | improvements                                               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5972`_ | set pod after migration                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5911`_ | Improve the guest OS hypervisor mappings addition on       |
+|                         |          | upgrade.                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5910`_ | [VMware] Update SCSI controllers for VMs                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5959`_ | Quota test fixes                                           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5978`_ | ui: Allow domain admin to configure subdomain limits       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5879`_ | Role escalation prevention                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5544`_ | Fix of revert RBD snapshots                                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5850`_ | api, server: fix add-remove vpn user without vpn owner     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5956`_ | Add disk space in systemVM template registration script    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5968`_ | [issue-5943] xerces 2.12.2                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5953`_ | [issue-5952] upgrade to jetty 9.4.44.v20210927             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5966`_ | replace Random with SecureRandom                           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5958`_ | API: Fix listSSHKeyPairs API when listing all resources    |
+|                         |          | (listall=true & projectid=-1)                              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5875`_ | cleanup: Network Throttling for Additional Networks code   |
+|                         |          | in DirectVifDriver.java                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5904`_ | UI - Add Network: shows "Offering for Isolated networks    |
+|                         |          | with no Source Nat service" on Network Offering for normal |
+|                         |          | users                                                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5962`_ | test: sleep 30s after restarting mgt server in             |
+|                         |          | test_kubernetes_supported_versions.py                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5963`_ | Add ID search capability to sshkeypairs                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5949`_ | [issue-5948] upgrade bouncycastle due to cve               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5954`_ | Skip systemVM template registration for Simulator          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5851`_ | packaging: display First Install and Onboarding Message    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5878`_ | maven: migrate short-term to reload4j v1.2.18              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5857`_ | server,config: respect storage.max.volume.size and make it |
+|                         |          | dynamic                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5942`_ | [issue-5939] upgrade commons-compress to 1.21              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5517`_ | Fix #3448 quota calculation for monthly tariffs            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5933`_ | ui: fix select networks for template nic                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5947`_ | [issue-5946] upgrade to xstream 1.4.19                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5944`_ | [issue-5943] upgrade to xerces 2.12.2                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5859`_ | add logging to deployment planners                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5931`_ | ui: fix ssh keypair navigation                             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5912`_ | Added hot plugging of vifs in case of VMware isolated      |
+|                         |          | networks                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5870`_ | VMware7 support: Add schema changes for update2 and        |
+|                         |          | update3                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5866`_ | Filter usage for project                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5506`_ | kvm: Use lscpu to get cpu max speed                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5929`_ | ui: fix related key for section                            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5920`_ | server: allow normal users to create isolated network      |
+|                         |          | without source nat                                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5400`_ | vm-import: fix unmanaged instance listing                  |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5473`_ | api,server: add params for updatehypervisorcapabilities    |
+|                         |          | API                                                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5852`_ | server: find suitable disk offering for volume upload      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5892`_ | [XenServer/XCP-ng] Sync the 'platform' setting according   |
+|                         |          | to the 'cpu.corespersocket' setting                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5908`_ | Update proper destroy status when SSVM is destroyed.       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5896`_ | Make sure other than user VMs can have multiple NICs in a  |
+|                         |          | network                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5873`_ | Do not restart VPC tiers with cleanup                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5887`_ | ui: fix filtering readonly details while VM update         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5886`_ | [XenServer/XCP-ng] Pass the image store NFS version on     |
+|                         |          | storage commands                                           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5785`_ | Add idempotent primary keys on tables missing them         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5900`_ | Allow direct download templates from IPv6 host address.    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5620`_ | Adding placeholders for custom NSP vues                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5893`_ | UI - Added option to allow users to select volumes when    |
+|                         |          | doing destroy the list of VMs                              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5884`_ | UI: Fixes asynchronous when destroying wrong item VM       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5881`_ | packaging: use modern systemctl enable/disable             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5861`_ | [VMware][Deploy-as-is] OVF properties not importing when   |
+|                         |          | template is uploaded from local                            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5825`_ | [Vmware][Deploy-as-is] Refactor the OVF parsing            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5434`_ | ui: add custom form for update template                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5872`_ | Removed redundant parsing of VMSnapshot usage record.      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5889`_ | ui: show password with success notification                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5865`_ | fill volume attached field                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5880`_ | [UI] Fix domain resources field not being updated with     |
+|                         |          | backend data                                               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5844`_ | server: fix regular user can create isolated network       |
+|                         |          | without sourcenat                                          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5871`_ | Delete ldap config from UI                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5869`_ | UI - Fixes Pod, Cluster selected is incorrect on addHost   |
+|                         |          | dialog                                                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5846`_ | Prevent upgrade failures if there are existing annotations |
+|                         |          | permissions                                                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5487`_ | ui: fix create user domain, account selection              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5584`_ | UI - Add a setting to config.json that allows users to set |
+|                         |          | theme                                                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5856`_ | ui: fix deploy vm in basic zone                            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5855`_ | UI: Fixes switching between domains with SAML user         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5858`_ | ui: show account configure limits tab for domain-admin     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5663`_ | UI - Cancel all requests api, async jobs when user logs    |
+|                         |          | out                                                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5653`_ | UI - Deploy VM with params from the template, iso, network |
+|                         |          | pages                                                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5828`_ | server: fix update vm with unconstrained offering          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5853`_ | ui: fix getDiagnosticsData files field                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5810`_ | ipv6: disable IPv6-only shared network with VR             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5849`_ | ui: fix paging in enable static NAT form                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5790`_ | Add toggle button on the UI for list including elements in |
+|                         |          | projects.                                                  |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5847`_ | ui: update vm haenable only for supported vms              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5839`_ | server: fix enable/disable static nat if userdata is not   |
+|                         |          | supported                                                  |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5841`_ | Storage pool absent                                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5784`_ | network: fix vm can be deployed on L2 network of other     |
+|                         |          | accounts                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5658`_ | remove VmWorkJob after adding a nic to a vm                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5843`_ | UI - Fix Locked "Override Root Disk Size" switch           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5726`_ | UI: Add s3 provider option to create secondary storage     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5748`_ | Prevent null values on Vmware appliances details that are  |
+|                         |          | missing a default value                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5801`_ | Set RAW format to RBD DATADISK                             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5840`_ | ui: fix create network/vpc offering form                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5833`_ | api: fix typo Destroy volume can be recovered              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5822`_ | server: fix vm can be recovered by other accounts          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5829`_ | UI - Hide shrink disk option on XCP-NG/Xenserver           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5750`_ | use physical size instead of virtual size for migration.   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5827`_ | server: do not return inaccessible entity details to       |
+|                         |          | normal users                                               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5812`_ | UI: Fix new UI missing 4 parameters when adding a          |
+|                         |          | BareMetal host                                             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#4230`_ | Enable resetting config values to default value            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5816`_ | LDAP truststore per domain                                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5819`_ | UI - Refactoring $notification according to the old        |
+|                         |          | version                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5647`_ | assume a property is one when it isn't a number            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5528`_ | test: fix component test test_configdrive.py               |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5714`_ | UI: Automatically refill tariff label information after    |
+|                         |          | editing.                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5809`_ | ui: fix add network offering for vpc                       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5549`_ | UI - Add clear all notification button                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5628`_ | UI: Add footer text option for login screen                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5684`_ | (ccc2021 hackathon ) kvm: add hosts using cloudstack ssh   |
+|                         |          | private key                                                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5755`_ | kvm: support qemu-system-x86>=5.2                          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5752`_ | [VMware] Fix service offerings listing on appliances       |
+|                         |          | deployment options                                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5789`_ | Randomize managed volume copy host                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5796`_ | Fix UI issue 5777 Root disk size is not shown as 'Disk     |
+|                         |          | Size' on VM deployment.                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5798`_ | ui: show tags only for supported resources                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5802`_ | kvm: don't always force scsi controller for aarch64 VMs    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5814`_ | ui: Fix configure Sticky policy form                       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5690`_ | UI - Fixes cannot add new port forwarding rules after auto |
+|                         |          | select VM next time                                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5757`_ | network: update ip in lb/pf/dnat tables when update vm nic |
+|                         |          | ip                                                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5804`_ | UI: show SSH keys step in VM deployment only if user can   |
+|                         |          | 'listSSHKeyPairs'                                          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5753`_ | server: Fix NPE while deleting a domain                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5723`_ | server: Fix NPE while adding network to VPC                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5806`_ | UI: Remove unused gravatar fetch                           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5800`_ | Provision to sort ISOs from UI, and Updated Templates/ISOs |
+|                         |          | API response to return in the order of sortkey.            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5562`_ | cleanup of unused code and cleanup of cleanup procedure    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5791`_ | Allow force reboot VM from user account, to start VM on    |
+|                         |          | the same host.                                             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5782`_ | api: Fix search cluster by name                            |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5762`_ | Enhance log message in FirstFitPlanner                     |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5710`_ | UI: Fixes error when delete domain                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5758`_ | Fix NPE on migrateVirtualMachineWithVolume                 |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5779`_ | UI: fix create Isolated/L2 network form                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5763`_ | Increase the length for parameters that expect a list of   |
+|                         |          | domain IDs.                                                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5767`_ | travis: install python3-setuptools                         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5745`_ | conditional broadcastUri                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5738`_ | internal ref replaced by uuid                              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5708`_ | vmware: fix cpu reservation during vm scale                |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5734`_ | UI - Fixes the next button not working when adding more    |
+|                         |          | physical networks                                          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5735`_ | [VMware] Improve volume file search on the datastore while |
+|                         |          | computing the VM snapshot chain size.                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5729`_ | server: fix non-root users are able to list system         |
+|                         |          | networks                                                   |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5744`_ | UI bug fix: 'Invalid ip address' when change vm ip address |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5746`_ | check security group in basic zones during deploy          |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5737`_ | UI: Enable cancel host maintenance when resource state is  |
+|                         |          | 'ErrorInPrepareForMaintenance'                             |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5701`_ | server: update capacity_state of host cpu core after       |
+|                         |          | disable/enable a host                                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5740`_ | Fix wrong logger class in *Cmd.java                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5720`_ | Removed redundant call for VM snapshot chain size, in      |
+|                         |          | VMware.                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5736`_ | Fix NPE on scale VM operation after the corresponding      |
+|                         |          | template is del…                                           |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5675`_ | server bug fix: remove network details when network is     |
+|                         |          | removed                                                    |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5704`_ | engine/schema: fix findActiveAccountById in                |
+|                         |          | AccountDaoImpl.java                                        |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5692`_ | KVM : Fixes UEFI XML Definition Error                      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5200`_ | UI: Autoscroll to Error Field                              |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5648`_ | IPv6: fix deploy vm issue in ipv6-only networks without VR |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5670`_ | server: set network rate for additional public IPs         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5672`_ | ui-primary-storage: hide provider if Linstor protocol      |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5682`_ | UI : Fix SSL certificate submit button not working         |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5693`_ | UI: Fixes incorrect auto-select in Add network to VM       |
++-------------------------+----------+------------------------------------------------------------+
+| 4.16.1.0                | `#5671`_ | CsDhcp.py: fix runtests.sh error                           |
++-------------------------+----------+------------------------------------------------------------+
+
+154 Issues listed
+
+.. _`#6042`: https://github.com/apache/cloudstack/pull/6042 
+.. _`#6029`: https://github.com/apache/cloudstack/pull/6029 
+.. _`#6027`: https://github.com/apache/cloudstack/pull/6027 
+.. _`#6034`: https://github.com/apache/cloudstack/pull/6034 
+.. _`#6035`: https://github.com/apache/cloudstack/pull/6035 
+.. _`#6020`: https://github.com/apache/cloudstack/pull/6020 
+.. _`#6003`: https://github.com/apache/cloudstack/pull/6003 
+.. _`#6000`: https://github.com/apache/cloudstack/pull/6000 
+.. _`#5863`: https://github.com/apache/cloudstack/pull/5863 
+.. _`#5972`: https://github.com/apache/cloudstack/pull/5972 
+.. _`#5911`: https://github.com/apache/cloudstack/pull/5911 
+.. _`#5910`: https://github.com/apache/cloudstack/pull/5910 
+.. _`#5959`: https://github.com/apache/cloudstack/pull/5959 
+.. _`#5978`: https://github.com/apache/cloudstack/pull/5978 
+.. _`#5879`: https://github.com/apache/cloudstack/pull/5879 
+.. _`#5544`: https://github.com/apache/cloudstack/pull/5544 
+.. _`#5850`: https://github.com/apache/cloudstack/pull/5850 
+.. _`#5956`: https://github.com/apache/cloudstack/pull/5956 
+.. _`#5968`: https://github.com/apache/cloudstack/pull/5968 
+.. _`#5953`: https://github.com/apache/cloudstack/pull/5953 
+.. _`#5966`: https://github.com/apache/cloudstack/pull/5966 
+.. _`#5958`: https://github.com/apache/cloudstack/pull/5958 
+.. _`#5875`: https://github.com/apache/cloudstack/pull/5875 
+.. _`#5904`: https://github.com/apache/cloudstack/pull/5904 
+.. _`#5962`: https://github.com/apache/cloudstack/pull/5962 
+.. _`#5963`: https://github.com/apache/cloudstack/pull/5963 
+.. _`#5949`: https://github.com/apache/cloudstack/pull/5949 
+.. _`#5954`: https://github.com/apache/cloudstack/pull/5954 
+.. _`#5851`: https://github.com/apache/cloudstack/pull/5851 
+.. _`#5878`: https://github.com/apache/cloudstack/pull/5878 
+.. _`#5857`: https://github.com/apache/cloudstack/pull/5857 
+.. _`#5942`: https://github.com/apache/cloudstack/pull/5942 
+.. _`#5517`: https://github.com/apache/cloudstack/pull/5517 
+.. _`#5933`: https://github.com/apache/cloudstack/pull/5933 
+.. _`#5947`: https://github.com/apache/cloudstack/pull/5947 
+.. _`#5944`: https://github.com/apache/cloudstack/pull/5944 
+.. _`#5859`: https://github.com/apache/cloudstack/pull/5859 
+.. _`#5931`: https://github.com/apache/cloudstack/pull/5931 
+.. _`#5912`: https://github.com/apache/cloudstack/pull/5912 
+.. _`#5870`: https://github.com/apache/cloudstack/pull/5870 
+.. _`#5866`: https://github.com/apache/cloudstack/pull/5866 
+.. _`#5506`: https://github.com/apache/cloudstack/pull/5506 
+.. _`#5929`: https://github.com/apache/cloudstack/pull/5929 
+.. _`#5920`: https://github.com/apache/cloudstack/pull/5920 
+.. _`#5400`: https://github.com/apache/cloudstack/pull/5400 
+.. _`#5473`: https://github.com/apache/cloudstack/pull/5473 
+.. _`#5852`: https://github.com/apache/cloudstack/pull/5852 
+.. _`#5892`: https://github.com/apache/cloudstack/pull/5892 
+.. _`#5908`: https://github.com/apache/cloudstack/pull/5908 
+.. _`#5896`: https://github.com/apache/cloudstack/pull/5896 
+.. _`#5873`: https://github.com/apache/cloudstack/pull/5873 
+.. _`#5887`: https://github.com/apache/cloudstack/pull/5887 
+.. _`#5886`: https://github.com/apache/cloudstack/pull/5886 
+.. _`#5785`: https://github.com/apache/cloudstack/pull/5785 
+.. _`#5900`: https://github.com/apache/cloudstack/pull/5900 
+.. _`#5620`: https://github.com/apache/cloudstack/pull/5620 
+.. _`#5893`: https://github.com/apache/cloudstack/pull/5893 
+.. _`#5884`: https://github.com/apache/cloudstack/pull/5884 
+.. _`#5881`: https://github.com/apache/cloudstack/pull/5881 
+.. _`#5861`: https://github.com/apache/cloudstack/pull/5861 
+.. _`#5825`: https://github.com/apache/cloudstack/pull/5825 
+.. _`#5434`: https://github.com/apache/cloudstack/pull/5434 
+.. _`#5872`: https://github.com/apache/cloudstack/pull/5872 
+.. _`#5889`: https://github.com/apache/cloudstack/pull/5889 
+.. _`#5865`: https://github.com/apache/cloudstack/pull/5865 
+.. _`#5880`: https://github.com/apache/cloudstack/pull/5880 
+.. _`#5844`: https://github.com/apache/cloudstack/pull/5844 
+.. _`#5871`: https://github.com/apache/cloudstack/pull/5871 
+.. _`#5869`: https://github.com/apache/cloudstack/pull/5869 
+.. _`#5846`: https://github.com/apache/cloudstack/pull/5846 
+.. _`#5487`: https://github.com/apache/cloudstack/pull/5487 
+.. _`#5584`: https://github.com/apache/cloudstack/pull/5584 
+.. _`#5856`: https://github.com/apache/cloudstack/pull/5856 
+.. _`#5855`: https://github.com/apache/cloudstack/pull/5855 
+.. _`#5858`: https://github.com/apache/cloudstack/pull/5858 
+.. _`#5663`: https://github.com/apache/cloudstack/pull/5663 
+.. _`#5653`: https://github.com/apache/cloudstack/pull/5653 
+.. _`#5828`: https://github.com/apache/cloudstack/pull/5828 
+.. _`#5853`: https://github.com/apache/cloudstack/pull/5853 
+.. _`#5810`: https://github.com/apache/cloudstack/pull/5810 
+.. _`#5849`: https://github.com/apache/cloudstack/pull/5849 
+.. _`#5790`: https://github.com/apache/cloudstack/pull/5790 
+.. _`#5847`: https://github.com/apache/cloudstack/pull/5847 
+.. _`#5839`: https://github.com/apache/cloudstack/pull/5839 
+.. _`#5841`: https://github.com/apache/cloudstack/pull/5841 
+.. _`#5784`: https://github.com/apache/cloudstack/pull/5784 
+.. _`#5658`: https://github.com/apache/cloudstack/pull/5658 
+.. _`#5843`: https://github.com/apache/cloudstack/pull/5843 
+.. _`#5726`: https://github.com/apache/cloudstack/pull/5726 
+.. _`#5748`: https://github.com/apache/cloudstack/pull/5748 
+.. _`#5801`: https://github.com/apache/cloudstack/pull/5801 
+.. _`#5840`: https://github.com/apache/cloudstack/pull/5840 
+.. _`#5833`: https://github.com/apache/cloudstack/pull/5833 
+.. _`#5822`: https://github.com/apache/cloudstack/pull/5822 
+.. _`#5829`: https://github.com/apache/cloudstack/pull/5829 
+.. _`#5750`: https://github.com/apache/cloudstack/pull/5750 
+.. _`#5827`: https://github.com/apache/cloudstack/pull/5827 
+.. _`#5812`: https://github.com/apache/cloudstack/pull/5812 
+.. _`#4230`: https://github.com/apache/cloudstack/pull/4230 
+.. _`#5816`: https://github.com/apache/cloudstack/pull/5816 
+.. _`#5819`: https://github.com/apache/cloudstack/pull/5819 
+.. _`#5647`: https://github.com/apache/cloudstack/pull/5647 
+.. _`#5528`: https://github.com/apache/cloudstack/pull/5528 
+.. _`#5714`: https://github.com/apache/cloudstack/pull/5714 
+.. _`#5809`: https://github.com/apache/cloudstack/pull/5809 
+.. _`#5549`: https://github.com/apache/cloudstack/pull/5549 
+.. _`#5628`: https://github.com/apache/cloudstack/pull/5628 
+.. _`#5684`: https://github.com/apache/cloudstack/pull/5684 
+.. _`#5755`: https://github.com/apache/cloudstack/pull/5755 
+.. _`#5752`: https://github.com/apache/cloudstack/pull/5752 
+.. _`#5789`: https://github.com/apache/cloudstack/pull/5789 
+.. _`#5796`: https://github.com/apache/cloudstack/pull/5796 
+.. _`#5798`: https://github.com/apache/cloudstack/pull/5798 
+.. _`#5802`: https://github.com/apache/cloudstack/pull/5802 
+.. _`#5814`: https://github.com/apache/cloudstack/pull/5814 
+.. _`#5690`: https://github.com/apache/cloudstack/pull/5690 
+.. _`#5757`: https://github.com/apache/cloudstack/pull/5757 
+.. _`#5804`: https://github.com/apache/cloudstack/pull/5804 
+.. _`#5753`: https://github.com/apache/cloudstack/pull/5753 
+.. _`#5723`: https://github.com/apache/cloudstack/pull/5723 
+.. _`#5806`: https://github.com/apache/cloudstack/pull/5806 
+.. _`#5800`: https://github.com/apache/cloudstack/pull/5800 
+.. _`#5562`: https://github.com/apache/cloudstack/pull/5562 
+.. _`#5791`: https://github.com/apache/cloudstack/pull/5791 
+.. _`#5782`: https://github.com/apache/cloudstack/pull/5782 
+.. _`#5762`: https://github.com/apache/cloudstack/pull/5762 
+.. _`#5710`: https://github.com/apache/cloudstack/pull/5710 
+.. _`#5758`: https://github.com/apache/cloudstack/pull/5758 
+.. _`#5779`: https://github.com/apache/cloudstack/pull/5779 
+.. _`#5763`: https://github.com/apache/cloudstack/pull/5763 
+.. _`#5767`: https://github.com/apache/cloudstack/pull/5767 
+.. _`#5745`: https://github.com/apache/cloudstack/pull/5745 
+.. _`#5738`: https://github.com/apache/cloudstack/pull/5738 
+.. _`#5708`: https://github.com/apache/cloudstack/pull/5708 
+.. _`#5734`: https://github.com/apache/cloudstack/pull/5734 
+.. _`#5735`: https://github.com/apache/cloudstack/pull/5735 
+.. _`#5729`: https://github.com/apache/cloudstack/pull/5729 
+.. _`#5744`: https://github.com/apache/cloudstack/pull/5744 
+.. _`#5746`: https://github.com/apache/cloudstack/pull/5746 
+.. _`#5737`: https://github.com/apache/cloudstack/pull/5737 
+.. _`#5701`: https://github.com/apache/cloudstack/pull/5701 
+.. _`#5740`: https://github.com/apache/cloudstack/pull/5740 
+.. _`#5720`: https://github.com/apache/cloudstack/pull/5720 
+.. _`#5736`: https://github.com/apache/cloudstack/pull/5736 
+.. _`#5675`: https://github.com/apache/cloudstack/pull/5675 
+.. _`#5704`: https://github.com/apache/cloudstack/pull/5704 
+.. _`#5692`: https://github.com/apache/cloudstack/pull/5692 
+.. _`#5200`: https://github.com/apache/cloudstack/pull/5200 
+.. _`#5648`: https://github.com/apache/cloudstack/pull/5648 
+.. _`#5670`: https://github.com/apache/cloudstack/pull/5670 
+.. _`#5672`: https://github.com/apache/cloudstack/pull/5672 
+.. _`#5682`: https://github.com/apache/cloudstack/pull/5682 
+.. _`#5693`: https://github.com/apache/cloudstack/pull/5693 
+.. _`#5671`: https://github.com/apache/cloudstack/pull/5671 
+
+
+Changes in 4.16.0.0 since 4.15
 ===============================
 
 Apache CloudStack uses GitHub https://github.com/apache/cloudstack/milestone/16?closed=1
diff --git a/source/upgrading/index.rst b/source/upgrading/index.rst
index 9c4160c..d7972bf 100644
--- a/source/upgrading/index.rst
+++ b/source/upgrading/index.rst
@@ -44,6 +44,7 @@ Contents:
  
    upgrade/mysql
    upgrade/valid_source
+   upgrade/upgrade-4.16
    upgrade/upgrade-4.15
    upgrade/upgrade-4.14
    upgrade/upgrade-4.13
diff --git a/source/upgrading/upgrade/upgrade-4.16.rst b/source/upgrading/upgrade/upgrade-4.16.rst
new file mode 100644
index 0000000..764f769
--- /dev/null
+++ b/source/upgrading/upgrade/upgrade-4.16.rst
@@ -0,0 +1,304 @@
+.. Licensed to the Apache Software Foundation (ASF) under one
+    or more contributor license agreements.  See the NOTICE file
+    distributed with this work for additional information#
+    regarding copyright ownership.  The ASF licenses this file
+    to you under the Apache License, Version 2.0 (the
+    "License"); you may not use this file except in compliance
+    with the License.  You may obtain a copy of the License at
+    http://www.apache.org/licenses/LICENSE-2.0
+    Unless required by applicable law or agreed to in writing,
+    software distributed under the License is distributed on an
+    "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+    KIND, either express or implied.  See the License for the
+    specific language governing permissions and limitations
+    under the License.
+
+.. |version_to_upgrade| replace:: 4.16.0
+
+Upgrade Instruction from |version_to_upgrade|
+=============================================
+
+
+This section will show you how to upgrade from CloudStack |version_to_upgrade| to latest
+CloudStack |release|.
+
+Any steps that are hypervisor-specific will be called out with a note.
+
+We recommend reading through this section once or twice before beginning
+your upgrade procedure, and working through it on a test system before
+working on a production system.
+
+.. note::
+    The following upgrade instructions should be performed regardless of
+    hypervisor type.
+
+Overview of Upgrade Steps:
+----------------------------
+
+#. Check any customisations and integrations
+#. Stop all running management servers
+#. Backup CloudStack database (MySQL)
+#. Upgrade 1st CloudStack management server
+#. Update hypervisors specific dependencies
+#. Restart 1st management server
+#. Check that your upgraded environment works as expected
+#. Upgrade and restart the remaining management servers
+#. Destroy old systemvms
+
+
+.. include:: _customisation_warnings.rst
+
+.. include:: _sysvm_templates.rst
+
+
+Packages repository
+-------------------
+
+Most users of CloudStack manage the installation and upgrades of
+CloudStack with one of Linux's predominant package systems, RPM or
+APT. This guide assumes you'll be using RPM and Yum (for Red Hat
+Enterprise Linux or CentOS), or APT and Debian packages (for Ubuntu).
+
+Create RPM or Debian packages (as appropriate) and a repository from
+the |release| source, or check the Apache CloudStack downloads page at
+http://cloudstack.apache.org/downloads.html
+for package repositories supplied by community members. You will need
+them for :ref:`ubuntu414` or :ref:`kvm414` hosts upgrade.
+
+Instructions for creating packages from the CloudStack source are in the
+`CloudStack Installation Guide`_.
+
+Database Preparation
+--------------------
+
+Backup current database
+
+#. Stop your management server or servers. Run this on all management
+   server hosts:
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-management stop
+
+#. If you are running a usage server or usage servers, stop those as well:
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-usage stop
+
+#. Make a backup of your MySQL database. If you run into any issues or
+   need to roll back the upgrade, this will assist in debugging or
+   restoring your existing environment. You'll be prompted for your
+   password.
+
+   .. parsed-literal::
+
+      $ mysqldump -u root -p -R cloud > cloud-backup_$(date +%Y-%m-%d-%H%M%S)
+      $ mysqldump -u root -p cloud_usage > cloud_usage-backup_$(date +%Y-%m-%d-%H%M%S)
+
+
+.. _ubuntu414:
+.. _apt-repo414:
+
+Management Server
+-----------------
+
+Ubuntu
+######
+
+If you are using Ubuntu, follow this procedure to upgrade your packages. If
+not, skip to step :ref:`rhel414`.
+
+.. note::
+   **Community Packages:** This section assumes you're using the community
+   supplied packages for CloudStack. If you've created your own packages and
+   APT repository, substitute your own URL for the ones used in these examples.
+
+The first order of business will be to change the sources list for
+each system with CloudStack packages. This means all management
+servers, and any hosts that have the KVM agent (no changes should
+be necessary for hosts that are running VMware or Xen.)
+
+Edit your ``/etc/apt/sources.list.d/cloudstack.list`` file on
+any systems that have CloudStack packages installed to points to version |version|
+
+This file should have one line, which contains:
+
+.. parsed-literal::
+
+   deb http://download.cloudstack.org/ubuntu bionic |version|
+
+Setup the public key for the above repository:
+
+.. parsed-literal::
+
+   wget -qO - http://download.cloudstack.org/release.asc | sudo apt-key add -
+
+#. Now update your apt package list:
+
+   .. parsed-literal::
+
+      $ sudo apt-get update
+
+#. Now that you have the repository configured, it's time to upgrade
+   the ``cloudstack-management`` package.
+
+   .. parsed-literal::
+
+      $ sudo apt-get upgrade cloudstack-management
+
+#. If you use CloudStack usage server
+
+   .. parsed-literal::
+
+      $ sudo apt-get upgrade cloudstack-usage
+
+
+.. _rhel414:
+.. _rpm-repo414:
+
+CentOS/RHEL
+##############
+
+If you are using CentOS or RHEL, follow this procedure to upgrade your
+packages. If not, skip to hypervisors section :ref:`upg_hyp_414`.
+
+.. note::
+   **Community Packages:** This section assumes you're using the community
+   supplied packages for CloudStack. If you've created your own packages and
+   yum repository, substitute your own URL for the ones used in these examples.
+
+The first order of business will be to change the yum repository
+for each system with CloudStack packages. This means all
+management servers, and any hosts that have the KVM agent (no changes
+should be necessary for hosts that are running VMware or Xen.)
+
+Change your ``/etc/yum.repos.d/cloudstack.repo`` file on
+any systems that have CloudStack packages installed to points to version |version|.
+
+This file should have content similar to the following:
+
+.. parsed-literal::
+
+   [apache-cloudstack]
+   name=Apache CloudStack
+   baseurl=http://download.cloudstack.org/centos/$releasever/|version|/
+   enabled=1
+   gpgcheck=0
+
+Setup the GPG public key if you wish to enable ``gpgcheck=1``:
+
+.. parsed-literal::
+
+   rpm --import http://download.cloudstack.org/RPM-GPG-KEY
+
+#. Now that you have the repository configured, it's time to upgrade the
+   ``cloudstack-management``.
+
+   .. parsed-literal::
+
+      $ sudo yum upgrade cloudstack-management
+
+#. If you use CloudStack usage server
+
+   .. parsed-literal::
+
+      $ sudo yum upgrade cloudstack-usage
+
+.. _upg_hyp_414:
+
+Upgrade Hypervisors
+-------------------
+
+Hypervisor: XenServer
+#####################
+
+
+No additional steps are required for XenServer Hypervisor for this upgrade.
+
+
+Hypervisor: VMware
+###################
+
+.. warning::
+   For VMware hypervisor, CloudStack management server packages must be
+   built using "noredist". Refer to :ref:`building-noredist`.
+
+
+No additional steps are requried for the VMware Hypervisor for this upgrade.
+
+
+.. _kvm414:
+
+Hypervisor: KVM
+#################
+
+KVM on Ubuntu
+""""""""""""""
+
+(KVM only) Additional steps are required for each KVM host. These
+steps will not affect running guests in the cloud. These steps are
+required only for clouds using KVM as hosts and only on the KVM
+hosts.
+
+#. Configure the :ref:`APT repo <apt-repo414>` as detailed above.
+
+#. Stop the running agent.
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-agent stop
+
+#. Update the agent software.
+
+   .. parsed-literal::
+
+      $ sudo apt-get upgrade cloudstack-agent
+
+#. Start the agent.
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-agent start
+
+
+KVM on CentOS/RHEL
+"""""""""""""""""""
+
+For KVM hosts, upgrade the ``cloudstack-agent`` package
+
+#. Configure the :ref:`rpm-repo414` as detailed above.
+
+   .. parsed-literal::
+
+      $ sudo yum install -y epel-release
+      $ sudo yum install -y python36-libvirt
+      $ sudo yum upgrade cloudstack-agent
+
+#. Restart the agent:
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-agent stop
+      $ sudo service cloudstack-agent start
+
+
+Restart management services
+---------------------------
+
+#. Now it's time to start the management server
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-management start
+
+#. If you use it, start the usage server
+
+   .. parsed-literal::
+
+      $ sudo service cloudstack-usage start
+
+System-VMs and Virtual-Routers
+------------------------------
+
+.. include:: _sysvm_restart.rst