You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Aniket <an...@gslab.com> on 2013/03/08 13:00:59 UTC

Problems starting management server

We are using Cloudplatform v3.0.6 trial release. I believe underneath 
cloudstack there is v3.0.2.
I successfully did single node install but then now management server 
refuses to start. When I check server logs it says it's not able to 
connect to mysql. I followed all steps in guide and fo rtime being, in 
fact I tried stopping firewall on the box. I'm manually able to connect 
to "cloud" database as a root user. Also that works from remote box. I'm 
right now completely stuck on this as fro mysql context there's no issue 
but somehow management server is not able to connect to it.

[root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# /etc/init.d/iptables 
status
iptables: Firewall is not running.

[root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# sestatus
SELinux status:                 disabled

[root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# mysql -h 10.43.10.21 
-u root -pCloudstack123
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 7
Server version: 5.1.67-log Source distribution

Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input 
statement.

mysql>

# Still see this in management server logs:
2013-03-08 17:19:24,793 ERROR [db.Transaction.Transaction] (main:null) 
Unexpected exception:
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: 
Could not create connection to database server. Attempted reconnect 3 
times. Giving up.

All permissions are granted for root user for all databases (*.*).
Appreciate any quick help or pointers. This is all Centos 6.3 based 
clean install.

-- 
Thanks,
Aniket

Re: Problems starting management server

Posted by Aniket Kulkarni <an...@gslab.com>.
Thanks.

----- Original Message -----
From: "Shanker Balan" <sh...@shapeblue.com>
To: "<cl...@incubator.apache.org>" <cl...@incubator.apache.org>
Sent: Monday, March 11, 2013 6:04:08 PM
Subject: Re: Problems starting management server

Hi Aniket, 


https://issues.apache.org/jira/browse/CLOUDSTACK-1623 


Regards. 

-- 
Shanker Balan 
Managing Consultant 




M: +91 98860 60539 

shanker.balan@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue 
ShapeBlue India, 22nd floor, Unit 2201, World Trade Centre, Bangalore - 560 055 
On 11-Mar-2013, at 12:19 PM, Aniket Kulkarni < aniket@gslab.com > wrote: 



Thanks Shanker. This was the problem. After removing hosts file entry for IPv6 and restoring db.properties things are still working. 
This should be added in trial installation guide for Centos/RHEL6.2+ steps. Otherwise all new users like me will struggle each time to get the setup up and running. 

ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue’s expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user. 



This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.

Re: Problems starting management server

Posted by Shanker Balan <sh...@shapeblue.com>.
Hi Aniket,

https://issues.apache.org/jira/browse/CLOUDSTACK-1623

Regards.

--
Shanker Balan
Managing Consultant

[cid:E7CE8425-E245-4C99-B967-713DF2967392@local]

M: +91 98860 60539
shanker.balan@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com> | Twitter:@shapeblue
ShapeBlue India, 22nd floor, Unit 2201, World Trade Centre, Bangalore - 560 055

On 11-Mar-2013, at 12:19 PM, Aniket Kulkarni <an...@gslab.com>> wrote:

Thanks Shanker. This was the problem. After removing hosts file entry for IPv6 and restoring db.properties things are still working.
This should be added in trial installation guide for Centos/RHEL6.2+ steps. Otherwise all new users like me will struggle each time to get the setup up and running.

ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue's expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.

________________________________

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.

Re: Problems starting management server

Posted by Aniket Kulkarni <an...@gslab.com>.
Thanks Shanker. This was the problem. After removing hosts file entry for IPv6 and restoring db.properties things are still working. 
This should be added in trial installation guide for Centos/RHEL6.2+ steps. Otherwise all new users like me will struggle each time to get the setup up and running. 

----- Original Message -----
From: "Shanker Balan" <sh...@shapeblue.com>
To: "<cl...@incubator.apache.org>" <cl...@incubator.apache.org>
Sent: Monday, March 11, 2013 8:42:06 AM
Subject: Re: Problems starting management server

Hi Aniket, 


Is MySQL listening on the IPV6 loopback interface ::1? See below for the connection test on a freshly installed CentOS 6.3 with MySQL. It fails on the V6 loopback. 


Fix could be to either bind MySQL to ::1 or to remove the V6 loopback entry in /etc/hosts. 


Hth. 




[root@db01 ~]# telnet ::1 mysql 
Trying ::1... 
telnet: connect to address ::1: Connection refused 
[root@db01 ~]# telnet 127.0.0.1 mysql 
Trying 127.0.0.1... 
Connected to 127.0.0.1. 
Escape character is '^]'. 
8 
5.1.66-log?<!.c,M~vk6i1U:`Ug+: 
^] 
telnet> Connection closed. 
[root@db01 ~]# 




Regards. 

-- 
Shanker Balan 
Managing Consultant 




M: +91 98860 60539 

shanker.balan@shapeblue.com | www.shapeblue.com | Twitter:@shapeblue 
ShapeBlue India, 22nd floor, Unit 2201, World Trade Centre, Bangalore - 560 055 
On 09-Mar-2013, at 10:05 PM, Aniket Kulkarni < aniket@gslab.com > wrote: 



oh, I guess yes, it has. I'll try removing that and will try restoring db.properties file's IP entries as before. But why IPv6 entry in hosts file will cause this issue? Any guess? 

----- Original Message ----- 
From: "David Nalley" < david@gnsa.us > 
To: cloudstack-users@incubator.apache.org 
Sent: Saturday, March 9, 2013 8:25:40 PM 
Subject: Re: Problems starting management server 

On Sat, Mar 9, 2013 at 2:55 AM, Aniket Kulkarni < aniket@gslab.com > wrote: 


I tried logging in using cloud user too and it was working from mysql prompt but not from cloudstack. But I figured it out. I changed db.properties and changed all "localhost" and "127.0.0.1" with actual management server IP. Management server and DB are on same node but seems somehow mysql was blocking connections accessed with above two and was allowing by actual IP. It is working fine now and I launched my first instance too! Looks cool so far. 

Thanks for pointers anyways. Problem was in exactly the same area. 


Does your /etc/hosts line have an IPV6 entry for localhost?? 
I've seen that cause that problem 

--David 


ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue’s expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user. 



This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.

Re: Problems starting management server

Posted by Shanker Balan <sh...@shapeblue.com>.
Hi Aniket,

Is MySQL listening on the IPV6 loopback interface ::1? See below for the connection test on a freshly installed CentOS 6.3 with MySQL. It fails on the V6 loopback.

Fix could be to either bind MySQL to ::1 or to remove the V6 loopback entry in /etc/hosts.

Hth.


[root@db01 ~]# telnet ::1 mysql
Trying ::1...
telnet: connect to address ::1: Connection refused
[root@db01 ~]# telnet 127.0.0.1 mysql
Trying 127.0.0.1...
Connected to 127.0.0.1.
Escape character is '^]'.
8
5.1.66-log?<!.c,M~vk6i1U:`Ug+:
^]
telnet> Connection closed.
[root@db01 ~]#


Regards.

--
Shanker Balan
Managing Consultant

[cid:E7CE8425-E245-4C99-B967-713DF2967392@local]

M: +91 98860 60539
shanker.balan@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com> | Twitter:@shapeblue
ShapeBlue India, 22nd floor, Unit 2201, World Trade Centre, Bangalore - 560 055

On 09-Mar-2013, at 10:05 PM, Aniket Kulkarni <an...@gslab.com>> wrote:

oh, I guess yes, it has. I'll try removing that and will try restoring db.properties file's IP entries as before. But why IPv6 entry in hosts file will cause this issue? Any guess?

----- Original Message -----
From: "David Nalley" <da...@gnsa.us>>
To: cloudstack-users@incubator.apache.org<ma...@incubator.apache.org>
Sent: Saturday, March 9, 2013 8:25:40 PM
Subject: Re: Problems starting management server

On Sat, Mar 9, 2013 at 2:55 AM, Aniket Kulkarni <an...@gslab.com>> wrote:
I tried logging in using cloud user too and it was working from mysql prompt but not from cloudstack. But I figured it out. I changed db.properties and changed all "localhost" and "127.0.0.1" with actual management server IP. Management server and DB are on same node but seems somehow mysql was blocking connections accessed with above two and was allowing by actual IP. It is working fine now and I launched my first instance too! Looks cool so far.

Thanks for pointers anyways. Problem was in exactly the same area.


Does your /etc/hosts line have an IPV6 entry for localhost??
I've seen that cause that problem

--David


ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue's expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.

________________________________

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.

Re: Problems starting management server

Posted by Aniket Kulkarni <an...@gslab.com>.
oh, I guess yes, it has. I'll try removing that and will try restoring db.properties file's IP entries as before. But why IPv6 entry in hosts file will cause this issue? Any guess?

----- Original Message -----
From: "David Nalley" <da...@gnsa.us>
To: cloudstack-users@incubator.apache.org
Sent: Saturday, March 9, 2013 8:25:40 PM
Subject: Re: Problems starting management server

On Sat, Mar 9, 2013 at 2:55 AM, Aniket Kulkarni <an...@gslab.com> wrote:
> I tried logging in using cloud user too and it was working from mysql prompt but not from cloudstack. But I figured it out. I changed db.properties and changed all "localhost" and "127.0.0.1" with actual management server IP. Management server and DB are on same node but seems somehow mysql was blocking connections accessed with above two and was allowing by actual IP. It is working fine now and I launched my first instance too! Looks cool so far.
>
> Thanks for pointers anyways. Problem was in exactly the same area.
>

Does your /etc/hosts line have an IPV6 entry for localhost??
I've seen that cause that problem

--David

Re: Problems starting management server

Posted by David Nalley <da...@gnsa.us>.
On Sat, Mar 9, 2013 at 2:55 AM, Aniket Kulkarni <an...@gslab.com> wrote:
> I tried logging in using cloud user too and it was working from mysql prompt but not from cloudstack. But I figured it out. I changed db.properties and changed all "localhost" and "127.0.0.1" with actual management server IP. Management server and DB are on same node but seems somehow mysql was blocking connections accessed with above two and was allowing by actual IP. It is working fine now and I launched my first instance too! Looks cool so far.
>
> Thanks for pointers anyways. Problem was in exactly the same area.
>

Does your /etc/hosts line have an IPV6 entry for localhost??
I've seen that cause that problem

--David

Re: Problems starting management server

Posted by Aniket Kulkarni <an...@gslab.com>.
I tried logging in using cloud user too and it was working from mysql prompt but not from cloudstack. But I figured it out. I changed db.properties and changed all "localhost" and "127.0.0.1" with actual management server IP. Management server and DB are on same node but seems somehow mysql was blocking connections accessed with above two and was allowing by actual IP. It is working fine now and I launched my first instance too! Looks cool so far.

Thanks for pointers anyways. Problem was in exactly the same area. 

----- Original Message -----
From: "Ilya Musayev" <im...@webmd.net>
To: cloudstack-users@incubator.apache.org
Sent: Saturday, March 9, 2013 2:17:31 AM
Subject: RE: Problems starting management server

Check your settings in 

/etc/cloud/management/db.properties file

Regards
ilya

> -----Original Message-----
> From: Kirk Kosinski [mailto:kirkkosinski@gmail.com]
> Sent: Friday, March 08, 2013 1:56 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: Problems starting management server
> 
> Hi, Aniket.  CloudStack doesn't use the root user to connect to the database,
> rather it uses the user you specified in the cloud-setup-databases step of the
> installation (if you followed the instructions exactly, it is the "cloud" user).  So
> you should make sure that the user CloudStack is using can connect and not
> just the root user.
> 
> Best regards,
> Kirk
> 
> On 03/08/2013 04:00 AM, Aniket wrote:
> > We are using Cloudplatform v3.0.6 trial release. I believe underneath
> > cloudstack there is v3.0.2.
> > I successfully did single node install but then now management server
> > refuses to start. When I check server logs it says it's not able to
> > connect to mysql. I followed all steps in guide and fo rtime being, in
> > fact I tried stopping firewall on the box. I'm manually able to
> > connect to "cloud" database as a root user. Also that works from
> > remote box. I'm right now completely stuck on this as fro mysql
> > context there's no issue but somehow management server is not able to
> connect to it.
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]#
> > /etc/init.d/iptables status
> > iptables: Firewall is not running.
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# sestatus
> > SELinux status:                 disabled
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# mysql -h
> > 10.43.10.21 -u root -pCloudstack123 Welcome to the MySQL monitor.
> > Commands end with ; or \g.
> > Your MySQL connection id is 7
> > Server version: 5.1.67-log Source distribution
> >
> > Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights
> > reserved.
> >
> > Oracle is a registered trademark of Oracle Corporation and/or its
> > affiliates. Other names may be trademarks of their respective owners.
> >
> > Type 'help;' or '\h' for help. Type '\c' to clear the current input
> > statement.
> >
> > mysql>
> >
> > # Still see this in management server logs:
> > 2013-03-08 17:19:24,793 ERROR [db.Transaction.Transaction] (main:null)
> > Unexpected exception:
> >
> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> > Could not create connection to database server. Attempted reconnect 3
> > times. Giving up.
> >
> > All permissions are granted for root user for all databases (*.*).
> > Appreciate any quick help or pointers. This is all Centos 6.3 based
> > clean install.
> >



RE: Problems starting management server

Posted by "Musayev, Ilya" <im...@webmd.net>.
Check your settings in 

/etc/cloud/management/db.properties file

Regards
ilya

> -----Original Message-----
> From: Kirk Kosinski [mailto:kirkkosinski@gmail.com]
> Sent: Friday, March 08, 2013 1:56 PM
> To: cloudstack-users@incubator.apache.org
> Subject: Re: Problems starting management server
> 
> Hi, Aniket.  CloudStack doesn't use the root user to connect to the database,
> rather it uses the user you specified in the cloud-setup-databases step of the
> installation (if you followed the instructions exactly, it is the "cloud" user).  So
> you should make sure that the user CloudStack is using can connect and not
> just the root user.
> 
> Best regards,
> Kirk
> 
> On 03/08/2013 04:00 AM, Aniket wrote:
> > We are using Cloudplatform v3.0.6 trial release. I believe underneath
> > cloudstack there is v3.0.2.
> > I successfully did single node install but then now management server
> > refuses to start. When I check server logs it says it's not able to
> > connect to mysql. I followed all steps in guide and fo rtime being, in
> > fact I tried stopping firewall on the box. I'm manually able to
> > connect to "cloud" database as a root user. Also that works from
> > remote box. I'm right now completely stuck on this as fro mysql
> > context there's no issue but somehow management server is not able to
> connect to it.
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]#
> > /etc/init.d/iptables status
> > iptables: Firewall is not running.
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# sestatus
> > SELinux status:                 disabled
> >
> > [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# mysql -h
> > 10.43.10.21 -u root -pCloudstack123 Welcome to the MySQL monitor.
> > Commands end with ; or \g.
> > Your MySQL connection id is 7
> > Server version: 5.1.67-log Source distribution
> >
> > Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights
> > reserved.
> >
> > Oracle is a registered trademark of Oracle Corporation and/or its
> > affiliates. Other names may be trademarks of their respective owners.
> >
> > Type 'help;' or '\h' for help. Type '\c' to clear the current input
> > statement.
> >
> > mysql>
> >
> > # Still see this in management server logs:
> > 2013-03-08 17:19:24,793 ERROR [db.Transaction.Transaction] (main:null)
> > Unexpected exception:
> >
> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> > Could not create connection to database server. Attempted reconnect 3
> > times. Giving up.
> >
> > All permissions are granted for root user for all databases (*.*).
> > Appreciate any quick help or pointers. This is all Centos 6.3 based
> > clean install.
> >



Re: Problems starting management server

Posted by Kirk Kosinski <ki...@gmail.com>.
Hi, Aniket.  CloudStack doesn't use the root user to connect to the
database, rather it uses the user you specified in the
cloud-setup-databases step of the installation (if you followed the
instructions exactly, it is the "cloud" user).  So you should make sure
that the user CloudStack is using can connect and not just the root user.

Best regards,
Kirk

On 03/08/2013 04:00 AM, Aniket wrote:
> We are using Cloudplatform v3.0.6 trial release. I believe underneath
> cloudstack there is v3.0.2.
> I successfully did single node install but then now management server
> refuses to start. When I check server logs it says it's not able to
> connect to mysql. I followed all steps in guide and fo rtime being, in
> fact I tried stopping firewall on the box. I'm manually able to connect
> to "cloud" database as a root user. Also that works from remote box. I'm
> right now completely stuck on this as fro mysql context there's no issue
> but somehow management server is not able to connect to it.
> 
> [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# /etc/init.d/iptables
> status
> iptables: Firewall is not running.
> 
> [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# sestatus
> SELinux status:                 disabled
> 
> [root@csk-controller1 CloudStack-3.0.6-1-rhel6.2]# mysql -h 10.43.10.21
> -u root -pCloudstack123
> Welcome to the MySQL monitor.  Commands end with ; or \g.
> Your MySQL connection id is 7
> Server version: 5.1.67-log Source distribution
> 
> Copyright (c) 2000, 2012, Oracle and/or its affiliates. All rights
> reserved.
> 
> Oracle is a registered trademark of Oracle Corporation and/or its
> affiliates. Other names may be trademarks of their respective
> owners.
> 
> Type 'help;' or '\h' for help. Type '\c' to clear the current input
> statement.
> 
> mysql>
> 
> # Still see this in management server logs:
> 2013-03-08 17:19:24,793 ERROR [db.Transaction.Transaction] (main:null)
> Unexpected exception:
> com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
> Could not create connection to database server. Attempted reconnect 3
> times. Giving up.
> 
> All permissions are granted for root user for all databases (*.*).
> Appreciate any quick help or pointers. This is all Centos 6.3 based
> clean install.
>