You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Amit Dalia <Am...@tomtom.com> on 2018/02/07 06:01:49 UTC
SystemVM not starting after updating console SSL cert
Hi All,
I'm new to cloudstack and our production environment is having cloudstack as an in-house cloud. The first task was given to me to update expiring console SSL certificate.
I went through all the wiki pages on how to upload cert, private key, root CA & intermediate CA. (Note: before uploading the same I had taken old keystore table backup.)
Restarted cloud management service.
But now console system VM is in the stopped state and when I try to start then it goes to running state and then back to the stopped state.
I had done grep on log file for this VM and same is attached to the email.
I know this might be an old query, but it will be helpful if someone guide me further or point me to old archive.
Thanks & Regards,
Amit Dalia
Re: SystemVM not starting after updating console SSL cert
Posted by Amit Dalia <Am...@tomtom.com>.
Thanks Andrija.
Will try this and get back to all further update.
Regards,
Amit
________________________________
From: Andrija Panic <an...@gmail.com>
Sent: Thursday, February 8, 2018 2:14:11 AM
To: users
Subject: Re: SystemVM not starting after updating console SSL cert
Hi Amit,
you should be able to login to host and check logs as Dan said.
On the other hand, I see there is arround 30sec before agent is connected
and the time it receives the kill command - so this should be enough for
you to do one line ssh/scp command that will rsync/scp/copy logs from
inside the VM to local host (where the VM is running) - you would be doing
ssh to loopback address (169.x.x.x) i.e. ssh -p 3922 -i
.ssh/id_rsa.cloud root@169.254.x.y
Worst case restore the table and restat mgmt server.
Note one thing, that on previous ACS version (up to 4.5 or 4.3 or so...),
there was a need to convert keys and ssl via special tools to some specific
format (I can remember some CWIKI page with instructions for this using
some Google tools etc) - but in 4.8 version (if not previously) there is
full GUI support for all this and made my life easier :)
During MGMT server start (reboot) check for message similar to "invalid
trust chain", or "failed to build trust chain" or similar - I got this
ones, when improperly uploading new SSL...
Best
On 7 February 2018 at 11:23, Amit Dalia <Am...@tomtom.com> wrote:
> Not sure, but I found version details from below:
>
>
> select * from version;
> +----+----------------------+---------------------+----------+
> | id | version | updated | step |
> +----+----------------------+---------------------+----------+
> | 1 | 3.0.2.20120506223416 | 2012-07-02 13:03:10 | Complete |
> +----+----------------------+---------------------+----------+
>
> Let me check hypervisor logs.
>
> ________________________________
> From: Daan Hoogland <da...@gmail.com>
> Sent: Wednesday, February 7, 2018 3:46:54 PM
> To: users@cloudstack.apache.org
> Subject: Re: SystemVM not starting after updating console SSL cert
>
> Omit,
>
> On Wed, Feb 7, 2018 at 10:48 AM, Amit Dalia <Am...@tomtom.com> wrote:
>
> > Hi Dan,
> >
>
>
>
>
> >
> > When you say this is an old query, do you mean it is an old version of
> > CloudStack?
> >
> > >> Nope. I mean this might be an old question already discussed in the
> > group.
> >
> ah, well it resambles a lot but might not be the same, not much to go on
> here.
>
>
>
> >
> >
> > Which version is it?
> >
> > >> 3.0.2.20120506223416
> >
> > Note: This is old deployment.
> >
> Yes it is, it is also not a apache version, It looks to be a former
> citrix, now accelerite version. I'd contact their support site.
>
>
>
> >
> >
> > During your install of the new certificates, did you destroy the
> systemvms
> > and let cloudstack recreate them?
> >
> > >> Nope. But now I deleted 1 console VM and it is not recreated yet.
> > Storage vms are in running state.
> >
> >
> > And can you get to the hosts that run the console proxy to do an
> > investigation there, as to why the consoleproxy stops again?
> >
> > >> How can I get there if the machine is not running.
> >
> not to the machine itself but to the hypervisor it runs on, it might have
> logs with usefull infromation.
>
>
>
> >
> >
> > Regards,
> >
> >
> > Amit
> >
> > ________________________________
> > From: Daan Hoogland <da...@gmail.com>
> > Sent: Wednesday, February 7, 2018 2:02:29 PM
> > To: users@cloudstack.apache.org
> > Subject: Re: SystemVM not starting after updating console SSL cert
> >
> > Amit, couple of questions as I am not sure what you are asking for.
> >
> > When you say this is an old query, do you mean it is an old version of
> > CloudStack?
> > Which version is it?
> > During your install of the new certificates, did you destroy the
> systemvms
> > and let cloudstack recreate them?
> > And can you get to the hosts that runs the console proxy to do
> > investigation there, as to why the consoleproxy stops again?
> >
> > regards,
> >
> > On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com>
> wrote:
> >
> > > Hi All,
> > >
> > >
> > > I'm new to cloudstack and our production environment is having
> cloudstack
> > > as an in-house cloud. The first task was given to me to update expiring
> > > console SSL certificate.
> > >
> > >
> > > I went through all the wiki pages on how to upload cert, private key,
> > root
> > > CA & intermediate CA. (Note: before uploading the same I had taken old
> > > keystore table backup.)
> > >
> > >
> > > Restarted cloud management service.
> > >
> > > But now console system VM is in the stopped state and when I try to
> start
> > > then it goes to running state and then back to the stopped state.
> > >
> > > I had done grep on log file for this VM and same is attached to the
> > email.
> > >
> > >
> > > I know this might be an old query, but it will be helpful if someone
> > guide
> > > me further or point me to old archive.
> > >
> > >
> > > Thanks & Regards,
> > >
> > >
> > > Amit Dalia
> > >
> >
> >
> >
> > --
> > Daan
> >
>
>
>
> --
> Daan
>
--
Andrija Panić
Re: SystemVM not starting after updating console SSL cert
Posted by Andrija Panic <an...@gmail.com>.
Hi Amit,
you should be able to login to host and check logs as Dan said.
On the other hand, I see there is arround 30sec before agent is connected
and the time it receives the kill command - so this should be enough for
you to do one line ssh/scp command that will rsync/scp/copy logs from
inside the VM to local host (where the VM is running) - you would be doing
ssh to loopback address (169.x.x.x) i.e. ssh -p 3922 -i
.ssh/id_rsa.cloud root@169.254.x.y
Worst case restore the table and restat mgmt server.
Note one thing, that on previous ACS version (up to 4.5 or 4.3 or so...),
there was a need to convert keys and ssl via special tools to some specific
format (I can remember some CWIKI page with instructions for this using
some Google tools etc) - but in 4.8 version (if not previously) there is
full GUI support for all this and made my life easier :)
During MGMT server start (reboot) check for message similar to "invalid
trust chain", or "failed to build trust chain" or similar - I got this
ones, when improperly uploading new SSL...
Best
On 7 February 2018 at 11:23, Amit Dalia <Am...@tomtom.com> wrote:
> Not sure, but I found version details from below:
>
>
> select * from version;
> +----+----------------------+---------------------+----------+
> | id | version | updated | step |
> +----+----------------------+---------------------+----------+
> | 1 | 3.0.2.20120506223416 | 2012-07-02 13:03:10 | Complete |
> +----+----------------------+---------------------+----------+
>
> Let me check hypervisor logs.
>
> ________________________________
> From: Daan Hoogland <da...@gmail.com>
> Sent: Wednesday, February 7, 2018 3:46:54 PM
> To: users@cloudstack.apache.org
> Subject: Re: SystemVM not starting after updating console SSL cert
>
> Omit,
>
> On Wed, Feb 7, 2018 at 10:48 AM, Amit Dalia <Am...@tomtom.com> wrote:
>
> > Hi Dan,
> >
>
>
>
>
> >
> > When you say this is an old query, do you mean it is an old version of
> > CloudStack?
> >
> > >> Nope. I mean this might be an old question already discussed in the
> > group.
> >
> ah, well it resambles a lot but might not be the same, not much to go on
> here.
>
>
>
> >
> >
> > Which version is it?
> >
> > >> 3.0.2.20120506223416
> >
> > Note: This is old deployment.
> >
> Yes it is, it is also not a apache version, It looks to be a former
> citrix, now accelerite version. I'd contact their support site.
>
>
>
> >
> >
> > During your install of the new certificates, did you destroy the
> systemvms
> > and let cloudstack recreate them?
> >
> > >> Nope. But now I deleted 1 console VM and it is not recreated yet.
> > Storage vms are in running state.
> >
> >
> > And can you get to the hosts that run the console proxy to do an
> > investigation there, as to why the consoleproxy stops again?
> >
> > >> How can I get there if the machine is not running.
> >
> not to the machine itself but to the hypervisor it runs on, it might have
> logs with usefull infromation.
>
>
>
> >
> >
> > Regards,
> >
> >
> > Amit
> >
> > ________________________________
> > From: Daan Hoogland <da...@gmail.com>
> > Sent: Wednesday, February 7, 2018 2:02:29 PM
> > To: users@cloudstack.apache.org
> > Subject: Re: SystemVM not starting after updating console SSL cert
> >
> > Amit, couple of questions as I am not sure what you are asking for.
> >
> > When you say this is an old query, do you mean it is an old version of
> > CloudStack?
> > Which version is it?
> > During your install of the new certificates, did you destroy the
> systemvms
> > and let cloudstack recreate them?
> > And can you get to the hosts that runs the console proxy to do
> > investigation there, as to why the consoleproxy stops again?
> >
> > regards,
> >
> > On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com>
> wrote:
> >
> > > Hi All,
> > >
> > >
> > > I'm new to cloudstack and our production environment is having
> cloudstack
> > > as an in-house cloud. The first task was given to me to update expiring
> > > console SSL certificate.
> > >
> > >
> > > I went through all the wiki pages on how to upload cert, private key,
> > root
> > > CA & intermediate CA. (Note: before uploading the same I had taken old
> > > keystore table backup.)
> > >
> > >
> > > Restarted cloud management service.
> > >
> > > But now console system VM is in the stopped state and when I try to
> start
> > > then it goes to running state and then back to the stopped state.
> > >
> > > I had done grep on log file for this VM and same is attached to the
> > email.
> > >
> > >
> > > I know this might be an old query, but it will be helpful if someone
> > guide
> > > me further or point me to old archive.
> > >
> > >
> > > Thanks & Regards,
> > >
> > >
> > > Amit Dalia
> > >
> >
> >
> >
> > --
> > Daan
> >
>
>
>
> --
> Daan
>
--
Andrija Panić
Re: SystemVM not starting after updating console SSL cert
Posted by Amit Dalia <Am...@tomtom.com>.
Not sure, but I found version details from below:
select * from version;
+----+----------------------+---------------------+----------+
| id | version | updated | step |
+----+----------------------+---------------------+----------+
| 1 | 3.0.2.20120506223416 | 2012-07-02 13:03:10 | Complete |
+----+----------------------+---------------------+----------+
Let me check hypervisor logs.
________________________________
From: Daan Hoogland <da...@gmail.com>
Sent: Wednesday, February 7, 2018 3:46:54 PM
To: users@cloudstack.apache.org
Subject: Re: SystemVM not starting after updating console SSL cert
Omit,
On Wed, Feb 7, 2018 at 10:48 AM, Amit Dalia <Am...@tomtom.com> wrote:
> Hi Dan,
>
>
> When you say this is an old query, do you mean it is an old version of
> CloudStack?
>
> >> Nope. I mean this might be an old question already discussed in the
> group.
>
ah, well it resambles a lot but might not be the same, not much to go on
here.
>
>
> Which version is it?
>
> >> 3.0.2.20120506223416
>
> Note: This is old deployment.
>
Yes it is, it is also not a apache version, It looks to be a former
citrix, now accelerite version. I'd contact their support site.
>
>
> During your install of the new certificates, did you destroy the systemvms
> and let cloudstack recreate them?
>
> >> Nope. But now I deleted 1 console VM and it is not recreated yet.
> Storage vms are in running state.
>
>
> And can you get to the hosts that run the console proxy to do an
> investigation there, as to why the consoleproxy stops again?
>
> >> How can I get there if the machine is not running.
>
not to the machine itself but to the hypervisor it runs on, it might have
logs with usefull infromation.
>
>
> Regards,
>
>
> Amit
>
> ________________________________
> From: Daan Hoogland <da...@gmail.com>
> Sent: Wednesday, February 7, 2018 2:02:29 PM
> To: users@cloudstack.apache.org
> Subject: Re: SystemVM not starting after updating console SSL cert
>
> Amit, couple of questions as I am not sure what you are asking for.
>
> When you say this is an old query, do you mean it is an old version of
> CloudStack?
> Which version is it?
> During your install of the new certificates, did you destroy the systemvms
> and let cloudstack recreate them?
> And can you get to the hosts that runs the console proxy to do
> investigation there, as to why the consoleproxy stops again?
>
> regards,
>
> On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com> wrote:
>
> > Hi All,
> >
> >
> > I'm new to cloudstack and our production environment is having cloudstack
> > as an in-house cloud. The first task was given to me to update expiring
> > console SSL certificate.
> >
> >
> > I went through all the wiki pages on how to upload cert, private key,
> root
> > CA & intermediate CA. (Note: before uploading the same I had taken old
> > keystore table backup.)
> >
> >
> > Restarted cloud management service.
> >
> > But now console system VM is in the stopped state and when I try to start
> > then it goes to running state and then back to the stopped state.
> >
> > I had done grep on log file for this VM and same is attached to the
> email.
> >
> >
> > I know this might be an old query, but it will be helpful if someone
> guide
> > me further or point me to old archive.
> >
> >
> > Thanks & Regards,
> >
> >
> > Amit Dalia
> >
>
>
>
> --
> Daan
>
--
Daan
Re: SystemVM not starting after updating console SSL cert
Posted by Daan Hoogland <da...@gmail.com>.
Omit,
On Wed, Feb 7, 2018 at 10:48 AM, Amit Dalia <Am...@tomtom.com> wrote:
> Hi Dan,
>
>
> When you say this is an old query, do you mean it is an old version of
> CloudStack?
>
> >> Nope. I mean this might be an old question already discussed in the
> group.
>
ah, well it resambles a lot but might not be the same, not much to go on
here.
>
>
> Which version is it?
>
> >> 3.0.2.20120506223416
>
> Note: This is old deployment.
>
Yes it is, it is also not a apache version, It looks to be a former
citrix, now accelerite version. I'd contact their support site.
>
>
> During your install of the new certificates, did you destroy the systemvms
> and let cloudstack recreate them?
>
> >> Nope. But now I deleted 1 console VM and it is not recreated yet.
> Storage vms are in running state.
>
>
> And can you get to the hosts that run the console proxy to do an
> investigation there, as to why the consoleproxy stops again?
>
> >> How can I get there if the machine is not running.
>
not to the machine itself but to the hypervisor it runs on, it might have
logs with usefull infromation.
>
>
> Regards,
>
>
> Amit
>
> ________________________________
> From: Daan Hoogland <da...@gmail.com>
> Sent: Wednesday, February 7, 2018 2:02:29 PM
> To: users@cloudstack.apache.org
> Subject: Re: SystemVM not starting after updating console SSL cert
>
> Amit, couple of questions as I am not sure what you are asking for.
>
> When you say this is an old query, do you mean it is an old version of
> CloudStack?
> Which version is it?
> During your install of the new certificates, did you destroy the systemvms
> and let cloudstack recreate them?
> And can you get to the hosts that runs the console proxy to do
> investigation there, as to why the consoleproxy stops again?
>
> regards,
>
> On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com> wrote:
>
> > Hi All,
> >
> >
> > I'm new to cloudstack and our production environment is having cloudstack
> > as an in-house cloud. The first task was given to me to update expiring
> > console SSL certificate.
> >
> >
> > I went through all the wiki pages on how to upload cert, private key,
> root
> > CA & intermediate CA. (Note: before uploading the same I had taken old
> > keystore table backup.)
> >
> >
> > Restarted cloud management service.
> >
> > But now console system VM is in the stopped state and when I try to start
> > then it goes to running state and then back to the stopped state.
> >
> > I had done grep on log file for this VM and same is attached to the
> email.
> >
> >
> > I know this might be an old query, but it will be helpful if someone
> guide
> > me further or point me to old archive.
> >
> >
> > Thanks & Regards,
> >
> >
> > Amit Dalia
> >
>
>
>
> --
> Daan
>
--
Daan
Re: SystemVM not starting after updating console SSL cert
Posted by Amit Dalia <Am...@tomtom.com>.
Hi Dan,
When you say this is an old query, do you mean it is an old version of CloudStack?
>> Nope. I mean this might be an old question already discussed in the group.
Which version is it?
>> 3.0.2.20120506223416
Note: This is old deployment.
During your install of the new certificates, did you destroy the systemvms and let cloudstack recreate them?
>> Nope. But now I deleted 1 console VM and it is not recreated yet. Storage vms are in running state.
And can you get to the hosts that run the console proxy to do an investigation there, as to why the consoleproxy stops again?
>> How can I get there if the machine is not running.
Regards,
Amit
________________________________
From: Daan Hoogland <da...@gmail.com>
Sent: Wednesday, February 7, 2018 2:02:29 PM
To: users@cloudstack.apache.org
Subject: Re: SystemVM not starting after updating console SSL cert
Amit, couple of questions as I am not sure what you are asking for.
When you say this is an old query, do you mean it is an old version of
CloudStack?
Which version is it?
During your install of the new certificates, did you destroy the systemvms
and let cloudstack recreate them?
And can you get to the hosts that runs the console proxy to do
investigation there, as to why the consoleproxy stops again?
regards,
On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com> wrote:
> Hi All,
>
>
> I'm new to cloudstack and our production environment is having cloudstack
> as an in-house cloud. The first task was given to me to update expiring
> console SSL certificate.
>
>
> I went through all the wiki pages on how to upload cert, private key, root
> CA & intermediate CA. (Note: before uploading the same I had taken old
> keystore table backup.)
>
>
> Restarted cloud management service.
>
> But now console system VM is in the stopped state and when I try to start
> then it goes to running state and then back to the stopped state.
>
> I had done grep on log file for this VM and same is attached to the email.
>
>
> I know this might be an old query, but it will be helpful if someone guide
> me further or point me to old archive.
>
>
> Thanks & Regards,
>
>
> Amit Dalia
>
--
Daan
Re: SystemVM not starting after updating console SSL cert
Posted by Daan Hoogland <da...@gmail.com>.
Amit, couple of questions as I am not sure what you are asking for.
When you say this is an old query, do you mean it is an old version of
CloudStack?
Which version is it?
During your install of the new certificates, did you destroy the systemvms
and let cloudstack recreate them?
And can you get to the hosts that runs the console proxy to do
investigation there, as to why the consoleproxy stops again?
regards,
On Wed, Feb 7, 2018 at 7:01 AM, Amit Dalia <Am...@tomtom.com> wrote:
> Hi All,
>
>
> I'm new to cloudstack and our production environment is having cloudstack
> as an in-house cloud. The first task was given to me to update expiring
> console SSL certificate.
>
>
> I went through all the wiki pages on how to upload cert, private key, root
> CA & intermediate CA. (Note: before uploading the same I had taken old
> keystore table backup.)
>
>
> Restarted cloud management service.
>
> But now console system VM is in the stopped state and when I try to start
> then it goes to running state and then back to the stopped state.
>
> I had done grep on log file for this VM and same is attached to the email.
>
>
> I know this might be an old query, but it will be helpful if someone guide
> me further or point me to old archive.
>
>
> Thanks & Regards,
>
>
> Amit Dalia
>
--
Daan