You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Caleb Call <ca...@me.com> on 2013/02/12 20:43:59 UTC
launch console proxy Vm
The console proxy VM is one of our Zones was accidentally destroyed. Is there a way to force the zone to relaunch or recreate a new console proxy? It's been this way for several days, so I'm quite certain it's not going to do it on it's own.
Thanks
RE: launch console proxy Vm
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Celeb,
It's potentially an issue with the deployment of System VMs. It would be good to test this, but rather than destroying any more existing System VMs, you can force the creation of additional instances by changing the following global settings so that the 'capacity.standby' setting is 2x the 'session.max' setting.
consoleproxy.capacity.standby
consoleproxy.session.max
secstorage.capacity.standby
secstorage.session.max
If after changing these settings, and restarting the Management Service, no additional SSVMs or Console Proxy VMs are generated, you have definitely got a problem with creating new System VMs, and the most likely issue will be related to the Management Server accessing Secondary Storage.
Also can you confirm you are able to create new Guest Instances from a NEW template, it's important its new so that the system has to copy it from Secondary Storage to Primary Storage.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Mathias Mullins [mailto:mathias.mullins@citrix.com]
Sent: 13 February 2013 03:05
To: cloudstack-users@incubator.apache.org; aemneina@gmail.com
Subject: RE: launch console proxy Vm
Caleb,
Take the database ID of the CPVM v-XX-VM and run the following:
Update vm_instance set status = stopped where id = XX;
That will change it to stopped in the UI under the infrastructure tab. Do a restart and it should recreate the VM.
Thanks,
Matt
-----Original Message-----
From: Caleb Call [mailto:calebcall@me.com]
Sent: Tuesday, February 12, 2013 3:53 PM
To: cloudstack-users@incubator.apache.org; aemneina@gmail.com
Subject: Re: launch console proxy Vm
We've restarted the management service many times, let me dig though the logs and see what info I can pull out and see if it's even trying to start it back up (I haven't seen anything to suggest it trying, but the logs are large).
Here's a feature request, breaking logging out to individual zone files. Having several zones logging to a single management log file makes for a messy log file! :)
One thought we had was to run the cloud-sysvmadm command to see if that would force it to restart, but it didn't, it just restarted all the other system vms.
On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
> do the logs show the management server trying to start the console proxy?
> if not I'd also restart the management service, see if you get any
> further with that. If there are logs, it might help to post as much of
> the management server log as possible.
>
>
> On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
> <ch...@sungard.com>wrote:
>
>> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
>>> It is, but it was actually already destroyed from within the
>>> cloudstack
>> ui so it's not listed there and hasn't been re-spawned.
>>>
>> Hmm... interesting. I haven't run into that.
>>
>> Are you able to restart the mgmt server(s) and see if that causes it
>> to be re-spawned?
>>
>> Anyone else have ideas?
>>
>>>
>>> On Feb 12, 2013, at 12:47 PM, Chip Childers
>>> <ch...@sungard.com>
>> wrote:
>>>
>>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>>>>> The console proxy VM is one of our Zones was accidentally destroyed.
>> Is there a way to force the zone to relaunch or recreate a new
>> console proxy? It's been this way for several days, so I'm quite
>> certain it's not going to do it on it's own.
>>>>>
>>>>> Thanks
>>>>>
>>>>
>>>> Is the console proxy listed in the infrastructure page's system VMs
>>>> section? If so, destroy it from there and CS should create a new
>>>> one for you.
>>>>
>>>> -chip
>>>
>>>
>>
ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue’s expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.
________________________________
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.
RE: launch console proxy Vm
Posted by Mathias Mullins <ma...@citrix.com>.
Caleb,
Take the database ID of the CPVM v-XX-VM and run the following:
Update vm_instance set status = stopped where id = XX;
That will change it to stopped in the UI under the infrastructure tab. Do a restart and it should recreate the VM.
Thanks,
Matt
-----Original Message-----
From: Caleb Call [mailto:calebcall@me.com]
Sent: Tuesday, February 12, 2013 3:53 PM
To: cloudstack-users@incubator.apache.org; aemneina@gmail.com
Subject: Re: launch console proxy Vm
We've restarted the management service many times, let me dig though the logs and see what info I can pull out and see if it's even trying to start it back up (I haven't seen anything to suggest it trying, but the logs are large).
Here's a feature request, breaking logging out to individual zone files. Having several zones logging to a single management log file makes for a messy log file! :)
One thought we had was to run the cloud-sysvmadm command to see if that would force it to restart, but it didn't, it just restarted all the other system vms.
On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
> do the logs show the management server trying to start the console proxy?
> if not I'd also restart the management service, see if you get any
> further with that. If there are logs, it might help to post as much of
> the management server log as possible.
>
>
> On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
> <ch...@sungard.com>wrote:
>
>> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
>>> It is, but it was actually already destroyed from within the
>>> cloudstack
>> ui so it's not listed there and hasn't been re-spawned.
>>>
>> Hmm... interesting. I haven't run into that.
>>
>> Are you able to restart the mgmt server(s) and see if that causes it
>> to be re-spawned?
>>
>> Anyone else have ideas?
>>
>>>
>>> On Feb 12, 2013, at 12:47 PM, Chip Childers
>>> <ch...@sungard.com>
>> wrote:
>>>
>>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>>>>> The console proxy VM is one of our Zones was accidentally destroyed.
>> Is there a way to force the zone to relaunch or recreate a new
>> console proxy? It's been this way for several days, so I'm quite
>> certain it's not going to do it on it's own.
>>>>>
>>>>> Thanks
>>>>>
>>>>
>>>> Is the console proxy listed in the infrastructure page's system VMs
>>>> section? If so, destroy it from there and CS should create a new
>>>> one for you.
>>>>
>>>> -chip
>>>
>>>
>>
RE: launch console proxy Vm
Posted by "Musayev, Ilya" <im...@webmd.net>.
Try disabling the cluster, pod and zone and re-enabling it.
Let us know what happens then.
Also, when happens when you attempt to launch a console?
-----Original Message-----
From: Caleb Call [mailto:calebcall@me.com]
Sent: Tuesday, February 12, 2013 5:21 PM
To: cloudstack-users@incubator.apache.org
Subject: Re: launch console proxy Vm
I tried that, there was a little more to it than that. I had to up that the vm_instance table as well as update the host table. It still doesn't show up in the GUI, so I tried to start using the API but it fails.
On Feb 12, 2013, at 2:13 PM, Jaro 2079 <ja...@gmail.com> wrote:
> maybe try undelete in database....
> set on vm_instance table state to "Stopped" and removed to NULL then
> start vm from GUI if volumen exist vm could start
>
> 2013/2/12 Caleb Call <ca...@me.com>
>
>> We've restarted the management service many times, let me dig though
>> the logs and see what info I can pull out and see if it's even trying
>> to start it back up (I haven't seen anything to suggest it trying,
>> but the logs are large).
>>
>> Here's a feature request, breaking logging out to individual zone files.
>> Having several zones logging to a single management log file makes
>> for a messy log file! :)
>>
>> One thought we had was to run the cloud-sysvmadm command to see if
>> that would force it to restart, but it didn't, it just restarted all
>> the other system vms.
>>
>> On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
>>
>>> do the logs show the management server trying to start the console proxy?
>>> if not I'd also restart the management service, see if you get any
>> further
>>> with that. If there are logs, it might help to post as much of the
>>> management server log as possible.
>>>
>>>
>>> On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
>>> <ch...@sungard.com>wrote:
>>>
>>>> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
>>>>> It is, but it was actually already destroyed from within the
>>>>> cloudstack
>>>> ui so it's not listed there and hasn't been re-spawned.
>>>>>
>>>> Hmm... interesting. I haven't run into that.
>>>>
>>>> Are you able to restart the mgmt server(s) and see if that causes
>>>> it to be re-spawned?
>>>>
>>>> Anyone else have ideas?
>>>>
>>>>>
>>>>> On Feb 12, 2013, at 12:47 PM, Chip Childers
>>>>> <chip.childers@sungard.com
>>>
>>>> wrote:
>>>>>
>>>>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>>>>>>> The console proxy VM is one of our Zones was accidentally destroyed.
>>>> Is there a way to force the zone to relaunch or recreate a new
>>>> console proxy? It's been this way for several days, so I'm quite
>>>> certain it's
>> not
>>>> going to do it on it's own.
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>
>>>>>> Is the console proxy listed in the infrastructure page's system
>>>>>> VMs section? If so, destroy it from there and CS should create a
>>>>>> new one for you.
>>>>>>
>>>>>> -chip
>>>>>
>>>>>
>>>>
>>
>>
Re: launch console proxy Vm
Posted by Caleb Call <ca...@me.com>.
I tried that, there was a little more to it than that. I had to up that the vm_instance table as well as update the host table. It still doesn't show up in the GUI, so I tried to start using the API but it fails.
On Feb 12, 2013, at 2:13 PM, Jaro 2079 <ja...@gmail.com> wrote:
> maybe try undelete in database....
> set on vm_instance table state to "Stopped" and removed to NULL then start
> vm from GUI
> if volumen exist vm could start
>
> 2013/2/12 Caleb Call <ca...@me.com>
>
>> We've restarted the management service many times, let me dig though the
>> logs and see what info I can pull out and see if it's even trying to start
>> it back up (I haven't seen anything to suggest it trying, but the logs are
>> large).
>>
>> Here's a feature request, breaking logging out to individual zone files.
>> Having several zones logging to a single management log file makes for a
>> messy log file! :)
>>
>> One thought we had was to run the cloud-sysvmadm command to see if that
>> would force it to restart, but it didn't, it just restarted all the other
>> system vms.
>>
>> On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
>>
>>> do the logs show the management server trying to start the console proxy?
>>> if not I'd also restart the management service, see if you get any
>> further
>>> with that. If there are logs, it might help to post as much of the
>>> management server log as possible.
>>>
>>>
>>> On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
>>> <ch...@sungard.com>wrote:
>>>
>>>> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
>>>>> It is, but it was actually already destroyed from within the cloudstack
>>>> ui so it's not listed there and hasn't been re-spawned.
>>>>>
>>>> Hmm... interesting. I haven't run into that.
>>>>
>>>> Are you able to restart the mgmt server(s) and see if that causes it to
>>>> be re-spawned?
>>>>
>>>> Anyone else have ideas?
>>>>
>>>>>
>>>>> On Feb 12, 2013, at 12:47 PM, Chip Childers <chip.childers@sungard.com
>>>
>>>> wrote:
>>>>>
>>>>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>>>>>>> The console proxy VM is one of our Zones was accidentally destroyed.
>>>> Is there a way to force the zone to relaunch or recreate a new console
>>>> proxy? It's been this way for several days, so I'm quite certain it's
>> not
>>>> going to do it on it's own.
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>
>>>>>> Is the console proxy listed in the infrastructure page's system VMs
>>>>>> section? If so, destroy it from there and CS should create a new one
>>>>>> for you.
>>>>>>
>>>>>> -chip
>>>>>
>>>>>
>>>>
>>
>>
Re: launch console proxy Vm
Posted by Jaro 2079 <ja...@gmail.com>.
maybe try undelete in database....
set on vm_instance table state to "Stopped" and removed to NULL then start
vm from GUI
if volumen exist vm could start
2013/2/12 Caleb Call <ca...@me.com>
> We've restarted the management service many times, let me dig though the
> logs and see what info I can pull out and see if it's even trying to start
> it back up (I haven't seen anything to suggest it trying, but the logs are
> large).
>
> Here's a feature request, breaking logging out to individual zone files.
> Having several zones logging to a single management log file makes for a
> messy log file! :)
>
> One thought we had was to run the cloud-sysvmadm command to see if that
> would force it to restart, but it didn't, it just restarted all the other
> system vms.
>
> On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
>
> > do the logs show the management server trying to start the console proxy?
> > if not I'd also restart the management service, see if you get any
> further
> > with that. If there are logs, it might help to post as much of the
> > management server log as possible.
> >
> >
> > On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
> > <ch...@sungard.com>wrote:
> >
> >> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
> >>> It is, but it was actually already destroyed from within the cloudstack
> >> ui so it's not listed there and hasn't been re-spawned.
> >>>
> >> Hmm... interesting. I haven't run into that.
> >>
> >> Are you able to restart the mgmt server(s) and see if that causes it to
> >> be re-spawned?
> >>
> >> Anyone else have ideas?
> >>
> >>>
> >>> On Feb 12, 2013, at 12:47 PM, Chip Childers <chip.childers@sungard.com
> >
> >> wrote:
> >>>
> >>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
> >>>>> The console proxy VM is one of our Zones was accidentally destroyed.
> >> Is there a way to force the zone to relaunch or recreate a new console
> >> proxy? It's been this way for several days, so I'm quite certain it's
> not
> >> going to do it on it's own.
> >>>>>
> >>>>> Thanks
> >>>>>
> >>>>
> >>>> Is the console proxy listed in the infrastructure page's system VMs
> >>>> section? If so, destroy it from there and CS should create a new one
> >>>> for you.
> >>>>
> >>>> -chip
> >>>
> >>>
> >>
>
>
Re: launch console proxy Vm
Posted by Caleb Call <ca...@me.com>.
We've restarted the management service many times, let me dig though the logs and see what info I can pull out and see if it's even trying to start it back up (I haven't seen anything to suggest it trying, but the logs are large).
Here's a feature request, breaking logging out to individual zone files. Having several zones logging to a single management log file makes for a messy log file! :)
One thought we had was to run the cloud-sysvmadm command to see if that would force it to restart, but it didn't, it just restarted all the other system vms.
On Feb 12, 2013, at 1:09 PM, Ahmad Emneina <ae...@gmail.com> wrote:
> do the logs show the management server trying to start the console proxy?
> if not I'd also restart the management service, see if you get any further
> with that. If there are logs, it might help to post as much of the
> management server log as possible.
>
>
> On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
> <ch...@sungard.com>wrote:
>
>> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
>>> It is, but it was actually already destroyed from within the cloudstack
>> ui so it's not listed there and hasn't been re-spawned.
>>>
>> Hmm... interesting. I haven't run into that.
>>
>> Are you able to restart the mgmt server(s) and see if that causes it to
>> be re-spawned?
>>
>> Anyone else have ideas?
>>
>>>
>>> On Feb 12, 2013, at 12:47 PM, Chip Childers <ch...@sungard.com>
>> wrote:
>>>
>>>> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>>>>> The console proxy VM is one of our Zones was accidentally destroyed.
>> Is there a way to force the zone to relaunch or recreate a new console
>> proxy? It's been this way for several days, so I'm quite certain it's not
>> going to do it on it's own.
>>>>>
>>>>> Thanks
>>>>>
>>>>
>>>> Is the console proxy listed in the infrastructure page's system VMs
>>>> section? If so, destroy it from there and CS should create a new one
>>>> for you.
>>>>
>>>> -chip
>>>
>>>
>>
Re: launch console proxy Vm
Posted by Ahmad Emneina <ae...@gmail.com>.
do the logs show the management server trying to start the console proxy?
if not I'd also restart the management service, see if you get any further
with that. If there are logs, it might help to post as much of the
management server log as possible.
On Tue, Feb 12, 2013 at 11:54 AM, Chip Childers
<ch...@sungard.com>wrote:
> On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
> > It is, but it was actually already destroyed from within the cloudstack
> ui so it's not listed there and hasn't been re-spawned.
> >
> Hmm... interesting. I haven't run into that.
>
> Are you able to restart the mgmt server(s) and see if that causes it to
> be re-spawned?
>
> Anyone else have ideas?
>
> >
> > On Feb 12, 2013, at 12:47 PM, Chip Childers <ch...@sungard.com>
> wrote:
> >
> > > On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
> > >> The console proxy VM is one of our Zones was accidentally destroyed.
> Is there a way to force the zone to relaunch or recreate a new console
> proxy? It's been this way for several days, so I'm quite certain it's not
> going to do it on it's own.
> > >>
> > >> Thanks
> > >>
> > >
> > > Is the console proxy listed in the infrastructure page's system VMs
> > > section? If so, destroy it from there and CS should create a new one
> > > for you.
> > >
> > > -chip
> >
> >
>
Re: launch console proxy Vm
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
The CloudStack Management Log should give us the clues we need to solve this, however you could try the following.
Test to see if the management server can mount the secondary storage. It's the management server not the SSVM which deploys the System VMs.
If you can, try taking some hosts offline, and rotate them as it may be a host refusing to deploy the VM. If you have multiple Primary Storage Volumes, you can try the same with them.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44(0)20 3603 0542<tel:+442036030542> | S: +44(0)20 3603 0540<tel:+442036030540> | M: +44(0)7968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS
On 12 Feb 2013, at 19:55, "Chip Childers" <ch...@sungard.com>> wrote:
On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
It is, but it was actually already destroyed from within the cloudstack ui so it's not listed there and hasn't been re-spawned.
Hmm... interesting. I haven't run into that.
Are you able to restart the mgmt server(s) and see if that causes it to
be re-spawned?
Anyone else have ideas?
On Feb 12, 2013, at 12:47 PM, Chip Childers <ch...@sungard.com>> wrote:
On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
The console proxy VM is one of our Zones was accidentally destroyed. Is there a way to force the zone to relaunch or recreate a new console proxy? It's been this way for several days, so I'm quite certain it's not going to do it on it's own.
Thanks
Is the console proxy listed in the infrastructure page's system VMs
section? If so, destroy it from there and CS should create a new one
for you.
-chip
ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue's expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.
________________________________
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.
Re: launch console proxy Vm
Posted by Chip Childers <ch...@sungard.com>.
On Tue, Feb 12, 2013 at 12:51:46PM -0700, Caleb Call wrote:
> It is, but it was actually already destroyed from within the cloudstack ui so it's not listed there and hasn't been re-spawned.
>
Hmm... interesting. I haven't run into that.
Are you able to restart the mgmt server(s) and see if that causes it to
be re-spawned?
Anyone else have ideas?
>
> On Feb 12, 2013, at 12:47 PM, Chip Childers <ch...@sungard.com> wrote:
>
> > On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
> >> The console proxy VM is one of our Zones was accidentally destroyed. Is there a way to force the zone to relaunch or recreate a new console proxy? It's been this way for several days, so I'm quite certain it's not going to do it on it's own.
> >>
> >> Thanks
> >>
> >
> > Is the console proxy listed in the infrastructure page's system VMs
> > section? If so, destroy it from there and CS should create a new one
> > for you.
> >
> > -chip
>
>
Re: launch console proxy Vm
Posted by Caleb Call <ca...@me.com>.
It is, but it was actually already destroyed from within the cloudstack ui so it's not listed there and hasn't been re-spawned.
On Feb 12, 2013, at 12:47 PM, Chip Childers <ch...@sungard.com> wrote:
> On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
>> The console proxy VM is one of our Zones was accidentally destroyed. Is there a way to force the zone to relaunch or recreate a new console proxy? It's been this way for several days, so I'm quite certain it's not going to do it on it's own.
>>
>> Thanks
>>
>
> Is the console proxy listed in the infrastructure page's system VMs
> section? If so, destroy it from there and CS should create a new one
> for you.
>
> -chip
Re: launch console proxy Vm
Posted by Chip Childers <ch...@sungard.com>.
On Tue, Feb 12, 2013 at 12:43:59PM -0700, Caleb Call wrote:
> The console proxy VM is one of our Zones was accidentally destroyed. Is there a way to force the zone to relaunch or recreate a new console proxy? It's been this way for several days, so I'm quite certain it's not going to do it on it's own.
>
> Thanks
>
Is the console proxy listed in the infrastructure page's system VMs
section? If so, destroy it from there and CS should create a new one
for you.
-chip