You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Nux! <nu...@li.nux.ro> on 2013/01/18 11:28:22 UTC
Can't delete Zone, system VMs in error state
Hi,
I'm trying to kill a zone and start configuration of Cloudstack from 0,
but I can not delete because there are pods in it and I can't delete the
pod because:
"The pod cannot be deleted because there are virtual machines running
in this pod"
I don't have any VMs so I assume it refers to the system ones:
Secondary Storage VM is in Expunging status
Console Proxy VM is in Destroyed status
How can I get rid of them?
I want to note I deleted all my storage, primary and secondary, as it
was also interfering with the zone deletion.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by "Musayev, Ilya" <im...@webmd.net>.
Yes, from mysql db - I had that issue before. Just keep in mind you need to trace it and remove all traces properly.
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: Friday, January 18, 2013 1:17 PM
To: cloudstack-users@incubator.apache.org
Subject: RE: Can't delete Zone, system VMs in error state
On 18.01.2013 18:04, Pranav Saxena wrote:
> Well , if you could let us the know the errors you are getting , the
> community can definitely help you out. It ain't a difficult job but a
> little complicated one to delete a zone ;)
>
> -----Original Message-----
> From: Nux! [mailto:nux@li.nux.ro]
> Sent: Friday, January 18, 2013 11:32 PM
> To: cloudstack-users@incubator.apache.org
> Subject: RE: Can't delete Zone, system VMs in error state
>
> On 18.01.2013 17:55, Pranav Saxena wrote:
>> Hey Lucian ,
>>
>> I believe, to delete the network , you would have to delete the VM's
>> , then the host , then the cluster , then the pod and then try
>> deleting the network and ten the zone . I know it's a very
>> complicated procedure but that is the level of hierarchy you have to
>> go through to delete the zone.
>>
>> PS: System VM's can be deleted since they are HA enabled and would
>> try to come up everytime , if they are deleted though they can be in
>> different states.
>>
>
> Hello Pranav and thanks. This is the path I'm trying to take, but I
> just don't have any VMs running and trying to delete the host gives
> some errors.
> But it's alright, I'll start fresh as Geoff suggested.
For now I'll try to reinstall and do it in a more proper way. Very
grateful for the help, though. :-)
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 18:04, Pranav Saxena wrote:
> Well , if you could let us the know the errors you are getting , the
> community can definitely help you out. It ain't a difficult job but
> a
> little complicated one to delete a zone ;)
>
> -----Original Message-----
> From: Nux! [mailto:nux@li.nux.ro]
> Sent: Friday, January 18, 2013 11:32 PM
> To: cloudstack-users@incubator.apache.org
> Subject: RE: Can't delete Zone, system VMs in error state
>
> On 18.01.2013 17:55, Pranav Saxena wrote:
>> Hey Lucian ,
>>
>> I believe, to delete the network , you would have to delete the VM's
>> ,
>> then the host , then the cluster , then the pod and then try
>> deleting
>> the network and ten the zone . I know it's a very complicated
>> procedure but that is the level of hierarchy you have to go through
>> to
>> delete the zone.
>>
>> PS: System VM's can be deleted since they are HA enabled and would
>> try
>> to come up everytime , if they are deleted though they can be in
>> different states.
>>
>
> Hello Pranav and thanks. This is the path I'm trying to take, but I
> just don't have any VMs running and trying to delete the host gives
> some errors.
> But it's alright, I'll start fresh as Geoff suggested.
For now I'll try to reinstall and do it in a more proper way. Very
grateful for the help, though. :-)
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Pranav Saxena <pr...@citrix.com>.
Well , if you could let us the know the errors you are getting , the community can definitely help you out. It ain't a difficult job but a little complicated one to delete a zone ;)
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: Friday, January 18, 2013 11:32 PM
To: cloudstack-users@incubator.apache.org
Subject: RE: Can't delete Zone, system VMs in error state
On 18.01.2013 17:55, Pranav Saxena wrote:
> Hey Lucian ,
>
> I believe, to delete the network , you would have to delete the VM's ,
> then the host , then the cluster , then the pod and then try deleting
> the network and ten the zone . I know it's a very complicated
> procedure but that is the level of hierarchy you have to go through to
> delete the zone.
>
> PS: System VM's can be deleted since they are HA enabled and would try
> to come up everytime , if they are deleted though they can be in
> different states.
>
Hello Pranav and thanks. This is the path I'm trying to take, but I just don't have any VMs running and trying to delete the host gives some errors.
But it's alright, I'll start fresh as Geoff suggested.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 17:55, Pranav Saxena wrote:
> Hey Lucian ,
>
> I believe, to delete the network , you would have to delete the VM's
> , then the host , then the cluster , then the pod and then try
> deleting the network and ten the zone . I know it's a very
> complicated
> procedure but that is the level of hierarchy you have to go through
> to
> delete the zone.
>
> PS: System VM's can be deleted since they are HA enabled and would
> try to come up everytime , if they are deleted though they can be in
> different states.
>
Hello Pranav and thanks. This is the path I'm trying to take, but I
just don't have any VMs running and trying to delete the host gives some
errors.
But it's alright, I'll start fresh as Geoff suggested.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Pranav Saxena <pr...@citrix.com>.
Hey Lucian ,
I believe, to delete the network , you would have to delete the VM's , then the host , then the cluster , then the pod and then try deleting the network and ten the zone . I know it's a very complicated procedure but that is the level of hierarchy you have to go through to delete the zone.
PS: System VM's can be deleted since they are HA enabled and would try to come up everytime , if they are deleted though they can be in different states.
Thanks,
Pranav
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: Friday, January 18, 2013 11:18 PM
To: cloudstack-users@incubator.apache.org
Subject: Re: Can't delete Zone, system VMs in error state
On 18.01.2013 15:56, Mathias Mullins wrote:
> Hi nux,
>
> Did you first disable the zone so that one you delete the system VMs
> then they won't respawn? Also Pranav is correct that you will need to
> delete the physical network under Zone -> physical network tab. But
> that can only be done when the virtual routers, guest, and public
> networks are also deleted.
>
> Thanks,
> Matt
>
> On Jan 18, 2013, at 6:38 AM, "Nux!" <nu...@li.nux.ro> wrote:
>
>> On 18.01.2013 11:25, Pranav Saxena wrote:
>>> Did you restart the management server when you changed the expunge
>>> interval ?
>>>
>>> Also does your physical network still exist ? I believe , once you
>>> get rid of the all the VM's you need to delete it as well to be able
>>> to delete a zone.
>>
>> Hi, I have restarted the management server. What do you mean by
>> "physical network"? I do still have cloudbr0 on the hypervisor (kvm)
>> which I need to be able to connect to the server.
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
Hello Mathias,
The physical network still exists, I can't disable/delete it (says it's still in use by other network; if I try to remove the simple network it just errors out, it doesn't get removed). I don't have any VMs running.
Anything else I could try?
Thanks,
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 18:07, Geoff Higginbottom wrote:
> If you really want to delete a Zone, you need a bit of patience and a
> few tricks
>
> 1. Disable the Zone
> 2. Put Primary Storage in Maintenance Mode
> 3. Put all Hosts in Maintenance Mode (we are trying to stop ALL VMs,
> including the System VMs
> 4. Make sure all the Expunge Global Settings are very short, say 60
> Secs
> 5. Delete all VMs (if you can delete the Accounts as it will take all
> the resources with it)
> 6. Delete all Virtual Routers
> 7. Delete the System VMs
> 8. WAIT for what seems like a long time and monitor the Resources
> Tab, it should show Zero for everything.
> 9. Delete Networks, Hosts, Clusters, PODs etc
> 10. WAIT again
> 11.. Delete the Zone
>
> If any items refuse to delete, sometime I drop to the DB and mark
> them as deleted
>
> Remember if you are using XenServer Hosts, you will need to
> re-install the OS, you will not be able to simply add them back into
> a
> new Zone
>
> If you are going to resuse storage, I suggest you also clear it down
> first.
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
Wow, thanks, bookmarked!
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
If you really want to delete a Zone, you need a bit of patience and a few tricks
1. Disable the Zone
2. Put Primary Storage in Maintenance Mode
3. Put all Hosts in Maintenance Mode (we are trying to stop ALL VMs, including the System VMs
4. Make sure all the Expunge Global Settings are very short, say 60 Secs
5. Delete all VMs (if you can delete the Accounts as it will take all the resources with it)
6. Delete all Virtual Routers
7. Delete the System VMs
8. WAIT for what seems like a long time and monitor the Resources Tab, it should show Zero for everything.
9. Delete Networks, Hosts, Clusters, PODs etc
10. WAIT again
11.. Delete the Zone
If any items refuse to delete, sometime I drop to the DB and mark them as deleted
Remember if you are using XenServer Hosts, you will need to re-install the OS, you will not be able to simply add them back into a new Zone
If you are going to resuse storage, I suggest you also clear it down first.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: 18 January 2013 18:00
To: cloudstack-users@incubator.apache.org
Subject: RE: Can't delete Zone, system VMs in error state
On 18.01.2013 17:51, Geoff Higginbottom wrote:
> I've been round this many many times, if you want to completely start
> again, just drop the DB Schema and redeploy the Management Data Bases,
> you will then have a Virgin CloudStack install
>
> Regards
>
> Geoff Higginbottom
Hi Geoff,
Thanks for the tip. I was this close to reinstalling anyway, but I like to imagine this is a production setup and wiping out the DB would make some customers angry.
Anyway, I might have just shot myself in the foot by pushing all the shiny buttons. :-)
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue’s expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.
________________________________
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.
RE: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 17:51, Geoff Higginbottom wrote:
> I've been round this many many times, if you want to completely start
> again, just drop the DB Schema and redeploy the Management Data
> Bases,
> you will then have a Virgin CloudStack install
>
> Regards
>
> Geoff Higginbottom
Hi Geoff,
Thanks for the tip. I was this close to reinstalling anyway, but I like
to imagine this is a production setup and wiping out the DB would make
some customers angry.
Anyway, I might have just shot myself in the foot by pushing all the
shiny buttons. :-)
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
I've been round this many many times, if you want to completely start again, just drop the DB Schema and redeploy the Management Data Bases, you will then have a Virgin CloudStack install
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: 18 January 2013 17:48
To: cloudstack-users@incubator.apache.org
Subject: Re: Can't delete Zone, system VMs in error state
On 18.01.2013 15:56, Mathias Mullins wrote:
> Hi nux,
>
> Did you first disable the zone so that one you delete the system VMs
> then they won't respawn? Also Pranav is correct that you will need to
> delete the physical network under Zone -> physical network tab. But
> that can only be done when the virtual routers, guest, and public
> networks are also deleted.
>
> Thanks,
> Matt
>
> On Jan 18, 2013, at 6:38 AM, "Nux!" <nu...@li.nux.ro> wrote:
>
>> On 18.01.2013 11:25, Pranav Saxena wrote:
>>> Did you restart the management server when you changed the expunge
>>> interval ?
>>>
>>> Also does your physical network still exist ? I believe , once you
>>> get rid of the all the VM's you need to delete it as well to be able
>>> to delete a zone.
>>
>> Hi, I have restarted the management server. What do you mean by
>> "physical network"? I do still have cloudbr0 on the hypervisor (kvm)
>> which I need to be able to connect to the server.
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
Hello Mathias,
The physical network still exists, I can't disable/delete it (says it's still in use by other network; if I try to remove the simple network it just errors out, it doesn't get removed). I don't have any VMs running.
Anything else I could try?
Thanks,
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
ShapeBlue provides a range of strategic and technical consulting and implementation services to help IT Service Providers and Enterprises to build a true IaaS compute cloud. ShapeBlue’s expertise, combined with CloudStack technology, allows IT Service Providers and Enterprises to deliver true, utility based, IaaS to the customer or end-user.
________________________________
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales.
Re: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 15:56, Mathias Mullins wrote:
> Hi nux,
>
> Did you first disable the zone so that one you delete the system VMs
> then they won't respawn? Also Pranav is correct that you will need to
> delete the physical network under Zone -> physical network tab. But
> that can only be done when the virtual routers, guest, and public
> networks are also deleted.
>
> Thanks,
> Matt
>
> On Jan 18, 2013, at 6:38 AM, "Nux!" <nu...@li.nux.ro> wrote:
>
>> On 18.01.2013 11:25, Pranav Saxena wrote:
>>> Did you restart the management server when you changed the expunge
>>> interval ?
>>>
>>> Also does your physical network still exist ? I believe , once you
>>> get rid of the all the VM's you need to delete it as well to be
>>> able
>>> to delete a zone.
>>
>> Hi, I have restarted the management server. What do you mean by
>> "physical network"? I do still have cloudbr0 on the hypervisor (kvm)
>> which I need to be able to connect to the server.
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
Hello Mathias,
The physical network still exists, I can't disable/delete it (says it's
still in use by other network; if I try to remove the simple network it
just errors out, it doesn't get removed). I don't have any VMs running.
Anything else I could try?
Thanks,
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Suresh Sadhu <Su...@citrix.com>.
HI NagaRaju,
Did you try to upload the .vhd file or .ova. You should upload only .vhd file because you are having xen hypervisor which support .vhd format.
Regards
Sadhu
-----Original Message-----
From: Mathias Mullins [mailto:mathias.mullins@citrix.com]
Sent: 18 January 2013 21:26
To: cloudstack-users@incubator.apache.org
Subject: Re: Can't delete Zone, system VMs in error state
Hi nux,
Did you first disable the zone so that one you delete the system VMs then they won't respawn? Also Pranav is correct that you will need to delete the physical network under Zone -> physical network tab. But that can only be done when the virtual routers, guest, and public networks are also deleted.
Thanks,
Matt
On Jan 18, 2013, at 6:38 AM, "Nux!" <nu...@li.nux.ro> wrote:
> On 18.01.2013 11:25, Pranav Saxena wrote:
>> Did you restart the management server when you changed the expunge
>> interval ?
>>
>> Also does your physical network still exist ? I believe , once you
>> get rid of the all the VM's you need to delete it as well to be able
>> to delete a zone.
>
> Hi, I have restarted the management server. What do you mean by
> "physical network"? I do still have cloudbr0 on the hypervisor (kvm)
> which I need to be able to connect to the server.
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
Re: Can't delete Zone, system VMs in error state
Posted by Mathias Mullins <ma...@citrix.com>.
Hi nux,
Did you first disable the zone so that one you delete the system VMs then they won't respawn? Also Pranav is correct that you will need to delete the physical network under Zone -> physical network tab. But that can only be done when the virtual routers, guest, and public networks are also deleted.
Thanks,
Matt
On Jan 18, 2013, at 6:38 AM, "Nux!" <nu...@li.nux.ro> wrote:
> On 18.01.2013 11:25, Pranav Saxena wrote:
>> Did you restart the management server when you changed the expunge
>> interval ?
>>
>> Also does your physical network still exist ? I believe , once you
>> get rid of the all the VM's you need to delete it as well to be able
>> to delete a zone.
>
> Hi, I have restarted the management server. What do you mean by
> "physical network"? I do still have cloudbr0 on the hypervisor (kvm)
> which I need to be able to connect to the server.
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 11:25, Pranav Saxena wrote:
> Did you restart the management server when you changed the expunge
> interval ?
>
> Also does your physical network still exist ? I believe , once you
> get rid of the all the VM's you need to delete it as well to be able
> to delete a zone.
>
Hi, I have restarted the management server. What do you mean by
"physical network"? I do still have cloudbr0 on the hypervisor (kvm)
which I need to be able to connect to the server.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
RE: Can't delete Zone, system VMs in error state
Posted by Pranav Saxena <pr...@citrix.com>.
Did you restart the management server when you changed the expunge interval ?
Also does your physical network still exist ? I believe , once you get rid of the all the VM's you need to delete it as well to be able to delete a zone.
-----Original Message-----
From: Nux! [mailto:nux@li.nux.ro]
Sent: Friday, January 18, 2013 4:30 PM
To: cloudstack-users@incubator.apache.org
Subject: Re: Can't delete Zone, system VMs in error state
On 18.01.2013 10:28, Nux! wrote:
> Hi,
>
> I'm trying to kill a zone and start configuration of Cloudstack from
> 0, but I can not delete because there are pods in it and I can't
> delete the pod because:
> "The pod cannot be deleted because there are virtual machines running
> in this pod"
>
> I don't have any VMs so I assume it refers to the system ones:
> Secondary Storage VM is in Expunging status Console Proxy VM is in
> Destroyed status
>
> How can I get rid of them?
>
> I want to note I deleted all my storage, primary and secondary, as it
> was also interfering with the zone deletion.
Following the advice on another email, I changed the expunge timeouts to 60s, so far nothing happened, though.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: Can't delete Zone, system VMs in error state
Posted by Nux! <nu...@li.nux.ro>.
On 18.01.2013 10:28, Nux! wrote:
> Hi,
>
> I'm trying to kill a zone and start configuration of Cloudstack from
> 0, but I can not delete because there are pods in it and I can't
> delete the pod because:
> "The pod cannot be deleted because there are virtual machines running
> in this pod"
>
> I don't have any VMs so I assume it refers to the system ones:
> Secondary Storage VM is in Expunging status
> Console Proxy VM is in Destroyed status
>
> How can I get rid of them?
>
> I want to note I deleted all my storage, primary and secondary, as it
> was also interfering with the zone deletion.
Following the advice on another email, I changed the expunge timeouts
to 60s, so far nothing happened, though.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro