You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2022/04/05 11:22:17 UTC

[GitHub] [cloudstack] wido opened a new issue, #6205: Ceph storage pools report raw capacity: Allow capacity disable threshold per pool

wido opened a new issue, #6205:
URL: https://github.com/apache/cloudstack/issues/6205

   ##### ISSUE TYPE
    * Feature Idea
   
   ##### COMPONENT NAME
   ~~~
   Primary Storage
   ~~~
   
   ##### CLOUDSTACK VERSION
   ~~~
   main
   ~~~
   
   ##### CONFIGURATION
   - CloudStack with KVM
   - Ceph (RBD) Primary Storage
   
   
   ##### OS / ENVIRONMENT
   N/A
   
   
   ##### SUMMARY
   CloudStack heavily relies on the storage pool support of Libvirt for reporting capacity and allocation.
   
   Libvirt will report the raw capacity of a Ceph cluster, for example:
   
   <pre>
   root@hv-138-b15-27:~# virsh pool-info 27f662fa-6c7d-35fe-84d7-69b044600ffe
   Name:           27f662fa-6c7d-35fe-84d7-69b044600ffe
   UUID:           27f662fa-6c7d-35fe-84d7-69b044600ffe
   State:          running
   Persistent:     no
   Autostart:      no
   Capacity:       1015.04 TiB
   Allocation:     668.20 MiB
   Available:      547.42 TiB
   
   root@hv-138-b15-27:~#
   </pre>
   
   In this case the Ceph cluster is almost 1PB in RAW capacity and t his is being reported by Libvirt.
   
   However, when 1TB of data is stored, due to the 3x replication configured inside Ceph we will use 3TB of RAW storage.
   
   CloudStack makes a calculation based on the Volumes ALLOCATED on the Ceph cluster, so let's assume we have a couple of volumes on this pool:
   
   - 10x 1TB
   - 20x 2TB
   - 100x 500GB
   
   In total we have allocated (10x1TB)+(20x2TB)+(100x500GB) 100TB of storage.
   
   However, because we replicate 3x, we will use 300TB of RAW capacity.
   
   CloudStack now thinks that **10%** is in use, but in reality we use _30%_ of the cluster.
   
   The disablethreshold of a storage pool can only be defined cluster-wide or zone-wide, but if you have a situation where you mix Ceph and NFS this does not work.
   
   For example you want to set:
   
   - Ceph: 30%
   - NFS: 85%
   
   
   
   
   ##### IDEAS
   I suggest two possible changes:
   
   **storage.overprovisioning.factor**
   This value is currently only allowed to be set >1. If we allow a value of 0.3 we can _underprovision_ the pool.
   
   **pool.storage.allocated.capacity.disablethreshold**
   We should allow this setting to be configured per storage pool.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [cloudstack] rohityadavcloud commented on issue #6205: Ceph storage pools report raw capacity: Allow capacity disable threshold per pool

Posted by GitBox <gi...@apache.org>.
rohityadavcloud commented on issue #6205:
URL: https://github.com/apache/cloudstack/issues/6205#issuecomment-1171948792

   Fixed in https://github.com/apache/cloudstack/pull/6218


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [cloudstack] rohityadavcloud closed issue #6205: Ceph storage pools report raw capacity: Allow capacity disable threshold per pool

Posted by GitBox <gi...@apache.org>.
rohityadavcloud closed issue #6205: Ceph storage pools report raw capacity: Allow capacity disable threshold per pool
URL: https://github.com/apache/cloudstack/issues/6205


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org