You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by jordan j <yo...@gmail.com> on 2023/01/31 00:58:09 UTC
understand Cloudstack Database performance
Hello everyone!
ACS 4.17.2 with a separate database. ACS currently has no vm instances.
While creating some /16 user networks we noticed some timeouts on the API.
After some tests - the smaller the new network the less the issues.
Checking the database - there were 600 slow queries on average.
The db server is separate - 8gb of ram and 6gb given for
innodb_buffer_pool_size.
Buffing the vm RAM to 64 gb did not help.
What did help was increasing join_buffer_size to 64MB.
Optimization tips in the docs do not give much info: page
https://docs.cloudstack.apache.org/en/latest/adminguide/tuning.html
Is there an optimization guide that has to be done for CS to perform
normally?
Are there any rules that need to be followed while scaling the
infrastructure?
Regards,
Jordan
Re: understand Cloudstack Database performance
Posted by jordan j <yo...@gmail.com>.
Thanks for the tip Kiran!
We already increased that to 700 but there wasn't any
performance improvement whatsoever.
On the other hand when using a db stress tool (mysqlslap) we could easily
over 20000 queries per second root cause is probably still in Cloudstack
config somewhere.
Regards.
Jordan
On Thu, Feb 2, 2023 at 1:02 PM Kiran Chavala <ki...@shapeblue.com>
wrote:
> Hi Jordan
>
> Rookie query regarding mysql performance
>
> Will increase or decreasing the value of "max_connections" in mysql.cnf
> help in the cloudstack database performance?
>
> [mysqld]
>
> innodb_rollback_on_timeout=1
> innodb_lock_wait_timeout=600
> max_connections=350
> log-bin=mysql-bin
> binlog-format = 'ROW'
> server-id=source-01
> innodb_rollback_on_timeout=1
> innodb_lock_wait_timeout=600
> max_connections=350
> log-bin=mysql-bin
> binlog-format = 'ROW'
>
> Regards
> Kiran
>
> ________________________________
> From: jordan j <yo...@gmail.com>
> Sent: 02 February 2023 13:24
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> Subject: Re: understand Cloudstack Database performance
>
> During some analysis I noticed that Cloudstack does not send more than 2000
> queries to the database.
> Is there a way to increase that value?
>
> With the current setup creating a /16 network takes about 70 seconds.
> I found a variable on the CS global settings called
> details.batch.query.size which is 2000 and increased it to 5000.
>
> However after CS reboot the amount of queries going to the database still
> did not pass more than 2000.
>
> Does anyone know where the value of the database query limit is?
>
> Regards,
> Jordan
>
>
>
>
> On Tue, Jan 31, 2023 at 2:58 AM jordan j <yo...@gmail.com> wrote:
>
> > Hello everyone!
> >
> > ACS 4.17.2 with a separate database. ACS currently has no vm instances.
> >
> > While creating some /16 user networks we noticed some timeouts on the
> API.
> > After some tests - the smaller the new network the less the issues.
> >
> > Checking the database - there were 600 slow queries on average.
> > The db server is separate - 8gb of ram and 6gb given for
> > innodb_buffer_pool_size.
> > Buffing the vm RAM to 64 gb did not help.
> >
> > What did help was increasing join_buffer_size to 64MB.
> >
> > Optimization tips in the docs do not give much info: page
> > https://docs.cloudstack.apache.org/en/latest/adminguide/tuning.html
> >
> > Is there an optimization guide that has to be done for CS to perform
> > normally?
> > Are there any rules that need to be followed while scaling the
> > infrastructure?
> >
> > Regards,
> > Jordan
> >
>
Re: understand Cloudstack Database performance
Posted by Kiran Chavala <ki...@shapeblue.com>.
Hi Jordan
Rookie query regarding mysql performance
Will increase or decreasing the value of "max_connections" in mysql.cnf help in the cloudstack database performance?
[mysqld]
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
log-bin=mysql-bin
binlog-format = 'ROW'
server-id=source-01
innodb_rollback_on_timeout=1
innodb_lock_wait_timeout=600
max_connections=350
log-bin=mysql-bin
binlog-format = 'ROW'
Regards
Kiran
________________________________
From: jordan j <yo...@gmail.com>
Sent: 02 February 2023 13:24
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: understand Cloudstack Database performance
During some analysis I noticed that Cloudstack does not send more than 2000
queries to the database.
Is there a way to increase that value?
With the current setup creating a /16 network takes about 70 seconds.
I found a variable on the CS global settings called
details.batch.query.size which is 2000 and increased it to 5000.
However after CS reboot the amount of queries going to the database still
did not pass more than 2000.
Does anyone know where the value of the database query limit is?
Regards,
Jordan
On Tue, Jan 31, 2023 at 2:58 AM jordan j <yo...@gmail.com> wrote:
> Hello everyone!
>
> ACS 4.17.2 with a separate database. ACS currently has no vm instances.
>
> While creating some /16 user networks we noticed some timeouts on the API.
> After some tests - the smaller the new network the less the issues.
>
> Checking the database - there were 600 slow queries on average.
> The db server is separate - 8gb of ram and 6gb given for
> innodb_buffer_pool_size.
> Buffing the vm RAM to 64 gb did not help.
>
> What did help was increasing join_buffer_size to 64MB.
>
> Optimization tips in the docs do not give much info: page
> https://docs.cloudstack.apache.org/en/latest/adminguide/tuning.html
>
> Is there an optimization guide that has to be done for CS to perform
> normally?
> Are there any rules that need to be followed while scaling the
> infrastructure?
>
> Regards,
> Jordan
>
Re: understand Cloudstack Database performance
Posted by jordan j <yo...@gmail.com>.
During some analysis I noticed that Cloudstack does not send more than 2000
queries to the database.
Is there a way to increase that value?
With the current setup creating a /16 network takes about 70 seconds.
I found a variable on the CS global settings called
details.batch.query.size which is 2000 and increased it to 5000.
However after CS reboot the amount of queries going to the database still
did not pass more than 2000.
Does anyone know where the value of the database query limit is?
Regards,
Jordan
On Tue, Jan 31, 2023 at 2:58 AM jordan j <yo...@gmail.com> wrote:
> Hello everyone!
>
> ACS 4.17.2 with a separate database. ACS currently has no vm instances.
>
> While creating some /16 user networks we noticed some timeouts on the API.
> After some tests - the smaller the new network the less the issues.
>
> Checking the database - there were 600 slow queries on average.
> The db server is separate - 8gb of ram and 6gb given for
> innodb_buffer_pool_size.
> Buffing the vm RAM to 64 gb did not help.
>
> What did help was increasing join_buffer_size to 64MB.
>
> Optimization tips in the docs do not give much info: page
> https://docs.cloudstack.apache.org/en/latest/adminguide/tuning.html
>
> Is there an optimization guide that has to be done for CS to perform
> normally?
> Are there any rules that need to be followed while scaling the
> infrastructure?
>
> Regards,
> Jordan
>