Questions about Cloud Stack scale

[Leo <vo...@gmail.com>]

Hello Cloud Stack experts!

We are considering using Cloud Stack to setup a private cloud. I was
wondering if there are any scale and performance numbers that are
published. I would like to know the following:

- How large a single cloud stack cluster can be in terms of number of bare
metal machines? Anyone know of the largest installation?
- What is the VM placement rate? i.e. How many VMs create requests can be
submitted and how fast does the scheduler process these requests?
- Any pros or limitations compared to other cloud softwares like
OpenStack or Kubernetes others?

Thanks,
Leo

Re: Questions about Cloud Stack scale

[Leo <vo...@gmail.com>]

Thanks everyone for the inputs. Much appreciated.

Regards,
Leo

On Fri, 14 Apr 2023 at 08:57, Nux <nu...@li.nux.ro> wrote:

> And if you don't need advanced features, go with Security Groups zones,
> they're the most scalable and simple (but you lose built-in features
> like LB, VPN etc).
>
> On 2023-04-14 16:03, Ricardo Pertuz wrote:
> > For large deployments consider using VXLAN Segmentation with BGP
> >
> > From: Nux <nu...@li.nux.ro>
> > Date: Friday, 14 April 2023, 4:34 AM
> > To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> > Cc: Leo <vo...@gmail.com>
> > Subject: Re: Questions about Cloud Stack scale
> > Depends. If you use XenServer/XCP or VMWare you will be limited to 64
> > hypervisors per cluster by the platforms.
> > With KVM there is no limit, but you will want to stop somewhere as all
> > that broadcast chatter will become noisy, among other complications.
> >
> > Largest deployments anecdotally seem to be in tens/hundreds of
> > thousands
> > of hypervisors.
> >
> > Biggest pro compared to most other solutions - 1-2 skilled sysadmins
> > can
> > make it work and keep it working.
> >
> > On 2023-04-14 07:15, Leo wrote:
> >> Hello Cloud Stack experts!
> >>
> >> We are considering using Cloud Stack to setup a private cloud. I was
> >> wondering if there are any scale and performance numbers that are
> >> published. I would like to know the following:
> >>
> >> - How large a single cloud stack cluster can be in terms of number of
> >> bare
> >> metal machines? Anyone know of the largest installation?
> >> - What is the VM placement rate? i.e. How many VMs create requests can
> >> be
> >> submitted and how fast does the scheduler process these requests?
> >> - Any pros or limitations compared to other cloud softwares like
> >> OpenStack or Kubernetes others?
> >>
> >> Thanks,
> >> Leo
>

Re: Questions about Cloud Stack scale

[Nux <nu...@li.nux.ro>]

And if you don't need advanced features, go with Security Groups zones, 
they're the most scalable and simple (but you lose built-in features 
like LB, VPN etc).

On 2023-04-14 16:03, Ricardo Pertuz wrote:
> For large deployments consider using VXLAN Segmentation with BGP
> 
> From: Nux <nu...@li.nux.ro>
> Date: Friday, 14 April 2023, 4:34 AM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> Cc: Leo <vo...@gmail.com>
> Subject: Re: Questions about Cloud Stack scale
> Depends. If you use XenServer/XCP or VMWare you will be limited to 64
> hypervisors per cluster by the platforms.
> With KVM there is no limit, but you will want to stop somewhere as all
> that broadcast chatter will become noisy, among other complications.
> 
> Largest deployments anecdotally seem to be in tens/hundreds of 
> thousands
> of hypervisors.
> 
> Biggest pro compared to most other solutions - 1-2 skilled sysadmins 
> can
> make it work and keep it working.
> 
> On 2023-04-14 07:15, Leo wrote:
>> Hello Cloud Stack experts!
>> 
>> We are considering using Cloud Stack to setup a private cloud. I was
>> wondering if there are any scale and performance numbers that are
>> published. I would like to know the following:
>> 
>> - How large a single cloud stack cluster can be in terms of number of
>> bare
>> metal machines? Anyone know of the largest installation?
>> - What is the VM placement rate? i.e. How many VMs create requests can
>> be
>> submitted and how fast does the scheduler process these requests?
>> - Any pros or limitations compared to other cloud softwares like
>> OpenStack or Kubernetes others?
>> 
>> Thanks,
>> Leo

Re: Questions about Cloud Stack scale

[Ricardo Pertuz <ri...@kuasar.co>]

For large deployments consider using VXLAN Segmentation with BGP

From: Nux <nu...@li.nux.ro>
Date: Friday, 14 April 2023, 4:34 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Cc: Leo <vo...@gmail.com>
Subject: Re: Questions about Cloud Stack scale
Depends. If you use XenServer/XCP or VMWare you will be limited to 64
hypervisors per cluster by the platforms.
With KVM there is no limit, but you will want to stop somewhere as all
that broadcast chatter will become noisy, among other complications.

Largest deployments anecdotally seem to be in tens/hundreds of thousands
of hypervisors.

Biggest pro compared to most other solutions - 1-2 skilled sysadmins can
make it work and keep it working.

On 2023-04-14 07:15, Leo wrote:
> Hello Cloud Stack experts!
>
> We are considering using Cloud Stack to setup a private cloud. I was
> wondering if there are any scale and performance numbers that are
> published. I would like to know the following:
>
> - How large a single cloud stack cluster can be in terms of number of
> bare
> metal machines? Anyone know of the largest installation?
> - What is the VM placement rate? i.e. How many VMs create requests can
> be
> submitted and how fast does the scheduler process these requests?
> - Any pros or limitations compared to other cloud softwares like
> OpenStack or Kubernetes others?
>
> Thanks,
> Leo

Re: Questions about Cloud Stack scale

[Nux <nu...@li.nux.ro>]

Depends. If you use XenServer/XCP or VMWare you will be limited to 64 
hypervisors per cluster by the platforms.
With KVM there is no limit, but you will want to stop somewhere as all 
that broadcast chatter will become noisy, among other complications.

Largest deployments anecdotally seem to be in tens/hundreds of thousands 
of hypervisors.

Biggest pro compared to most other solutions - 1-2 skilled sysadmins can 
make it work and keep it working.

On 2023-04-14 07:15, Leo wrote:
> Hello Cloud Stack experts!
> 
> We are considering using Cloud Stack to setup a private cloud. I was
> wondering if there are any scale and performance numbers that are
> published. I would like to know the following:
> 
> - How large a single cloud stack cluster can be in terms of number of 
> bare
> metal machines? Anyone know of the largest installation?
> - What is the VM placement rate? i.e. How many VMs create requests can 
> be
> submitted and how fast does the scheduler process these requests?
> - Any pros or limitations compared to other cloud softwares like
> OpenStack or Kubernetes others?
> 
> Thanks,
> Leo

Re: Questions about Cloud Stack scale

[Wei ZHOU <us...@gmail.com>]

As far as I know, China Mobile uses OpenStack, not CloudStack.

(Is this answer generated by ChatGPT ? :-D)


On Fri, 14 Apr 2023 at 09:00, Hongtu Zang <za...@gmail.com> wrote:

> 1.  CloudStack can handle clusters of hundreds or thousands of bare metal
> machines. The largest known installation of CloudStack is reportedly by
> China Mobile, which has a cloud platform consisting of over 100,000
> physical servers running CloudStack.
> 3.  CloudStack is primarily focused on providing IaaS capabilities, while
> OpenStack offers a broader range of cloud services, including IaaS, PaaS,
> and SaaS. Kubernetes is primarily focused on managing containers and
> providing container orchestration capabilities. Compared to OpenStack,
> CloudStack is considered to be more lightweight and easier to deploy and
> manage, while OpenStack is more flexible and customizable. Compared to
> Kubernetes, CloudStack provides a more comprehensive set of IaaS features
> and is better suited for managing virtual machines, while Kubernetes is
> better suited for managing containers.
>
> Leo <vo...@gmail.com> 于2023年4月14日周五 14:15写道：
>
> > Hello Cloud Stack experts!
> >
> > We are considering using Cloud Stack to setup a private cloud. I was
> > wondering if there are any scale and performance numbers that are
> > published. I would like to know the following:
> >
> > - How large a single cloud stack cluster can be in terms of number of
> bare
> > metal machines? Anyone know of the largest installation?
> > - What is the VM placement rate? i.e. How many VMs create requests can be
> > submitted and how fast does the scheduler process these requests?
> > - Any pros or limitations compared to other cloud softwares like
> > OpenStack or Kubernetes others?
> >
> > Thanks,
> > Leo
> >
>

Re: Questions about Cloud Stack scale

[Jithin Raju <ji...@shapeblue.com>]

Hi Leo,

Regarding the VM placement rate, if you are planning to run a lot of parallel jobs you could increase the number of management servers and even tune the settings to handle more jobs.

-Jithin

From: Hongtu Zang <za...@gmail.com>
Date: Friday, 14 April 2023 at 12:30 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Questions about Cloud Stack scale
1.  CloudStack can handle clusters of hundreds or thousands of bare metal
machines. The largest known installation of CloudStack is reportedly by
China Mobile, which has a cloud platform consisting of over 100,000
physical servers running CloudStack.
3.  CloudStack is primarily focused on providing IaaS capabilities, while
OpenStack offers a broader range of cloud services, including IaaS, PaaS,
and SaaS. Kubernetes is primarily focused on managing containers and
providing container orchestration capabilities. Compared to OpenStack,
CloudStack is considered to be more lightweight and easier to deploy and
manage, while OpenStack is more flexible and customizable. Compared to
Kubernetes, CloudStack provides a more comprehensive set of IaaS features
and is better suited for managing virtual machines, while Kubernetes is
better suited for managing containers.

Leo <vo...@gmail.com> 于2023年4月14日周五 14:15写道：

> Hello Cloud Stack experts!
>
> We are considering using Cloud Stack to setup a private cloud. I was
> wondering if there are any scale and performance numbers that are
> published. I would like to know the following:
>
> - How large a single cloud stack cluster can be in terms of number of bare
> metal machines? Anyone know of the largest installation?
> - What is the VM placement rate? i.e. How many VMs create requests can be
> submitted and how fast does the scheduler process these requests?
> - Any pros or limitations compared to other cloud softwares like
> OpenStack or Kubernetes others?
>
> Thanks,
> Leo
>

 

Re: Questions about Cloud Stack scale

[Hongtu Zang <za...@gmail.com>]

1.  CloudStack can handle clusters of hundreds or thousands of bare metal
machines. The largest known installation of CloudStack is reportedly by
China Mobile, which has a cloud platform consisting of over 100,000
physical servers running CloudStack.
3.  CloudStack is primarily focused on providing IaaS capabilities, while
OpenStack offers a broader range of cloud services, including IaaS, PaaS,
and SaaS. Kubernetes is primarily focused on managing containers and
providing container orchestration capabilities. Compared to OpenStack,
CloudStack is considered to be more lightweight and easier to deploy and
manage, while OpenStack is more flexible and customizable. Compared to
Kubernetes, CloudStack provides a more comprehensive set of IaaS features
and is better suited for managing virtual machines, while Kubernetes is
better suited for managing containers.

Leo <vo...@gmail.com> 于2023年4月14日周五 14:15写道：

> Hello Cloud Stack experts!
>
> We are considering using Cloud Stack to setup a private cloud. I was
> wondering if there are any scale and performance numbers that are
> published. I would like to know the following:
>
> - How large a single cloud stack cluster can be in terms of number of bare
> metal machines? Anyone know of the largest installation?
> - What is the VM placement rate? i.e. How many VMs create requests can be
> submitted and how fast does the scheduler process these requests?
> - Any pros or limitations compared to other cloud softwares like
> OpenStack or Kubernetes others?
>
> Thanks,
> Leo
>