You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Sonali Jadhav <so...@servercentralen.se> on 2015/01/16 09:53:41 UTC
Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Re: Help! cant perform any operation on VMs
Posted by Nux! <nu...@li.nux.ro>.
It's okay for the VR to be v4.4.1.
4.4.2 and 4.4.3 are minor releases which do not bring any bug fixes for the VR, hence no updated images.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
> From: "Sonali Jadhav" <so...@servercentralen.se>
> To: users@cloudstack.apache.org
> Sent: Friday, 16 January, 2015 11:52:40
> Subject: RE: Help! cant perform any operation on VMs
> Super thanks. After reboot of VR it seemed to help. I am able to start VMs now.
>
> My CloudStack version is 4.4.2.
> And if I check Version of Virtual router its 4.4.1. How come? So it's trying to
> update VR, But cant ? What can be issue?
> To cross check I made new VR, and version of that was also 4.4.1.
>
> What is the meaning of zone in avoid set?
>
> And where is cleanup option?
>
> This was weird it happened suddenly. Any idea what could have caused this?
>
> /Sonali
>
> -----Original Message-----
> From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
> Sent: Friday, January 16, 2015 3:42 PM
> To: users@cloudstack.apache.org
> Subject: RE: Help! cant perform any operation on VMs
>
> Sonali,
>
> As well as updating the DB did you stop then start the VR (note a simple restart
> may not work, you must stop and start it)
>
> A good test is to log into the VR and tail the messages log, then when you start
> a VM you should see the DHCP log entries as it gets updated.
>
> The attached log is indicating that CloudStack cannot update the VR. It's also
> saying your Zone is in an avoid set.
>
> The next step would be to restart the network and use the clean up option, this
> will destroy the VR and create a new one.
>
> I'm sure it has nothing to do with HA on your XenServer Cluster, but just in
> case it was not setup correctly also try disabling HA on your Cluster etc
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Sonali Jadhav [mailto:sonali@servercentralen.se]
> Sent: 16 January 2015 10:01
> To: users@cloudstack.apache.org
> Subject: RE: Help! cant perform any operation on VMs
>
> Ok updated value in database. But now if I try to start VM in CloudStack its
> giving new error.
>
> Can you check attached log file?
>
> It was totally fine and up, I don’t know what happened. On last Friday I
> configured HA. It looked fine, After that there was no other changes in
> CloudStack.
>
> /sonali
> -----Original Message-----
> From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
> Sent: Friday, January 16, 2015 2:44 PM
> To: users@cloudstack.apache.org
> Subject: RE: Help! cant perform any operation on VMs
>
> What state does CloudStack 'think' the VR is in and what state is it actually
> in?
>
> Assuming it is running but CloudStack thinks its stopped, mark it as Running in
> the DB (table vm_instance), then stop it from CloudStack, and then start it
> from CloudStack.
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Sonali Jadhav [mailto:sonali@servercentralen.se]
> Sent: 16 January 2015 09:07
> To: users@cloudstack.apache.org
> Subject: RE: Help! cant perform any operation on VMs
>
> Hi yes I did.
> I have even applied all available updates for XenServer 6.2, to be sure.
> I even restarted management service.
> /Sonali
>
> -----Original Message-----
> From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
> Sent: Friday, January 16, 2015 2:27 PM
> To: users@cloudstack.apache.org
> Subject: RE: Help! cant perform any operation on VMs
>
> Sonali,
>
> Have you tried restarting the VR?
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Sonali Jadhav [mailto:sonali@servercentralen.se]
> Sent: 16 January 2015 08:54
> To: users@cloudstack.apache.org
> Subject: Help! cant perform any operation on VMs
>
> Hi,
>
> My all instances are stopped on CloudStack but in fact they are up on hosts. If
> I try to start instance from CloudStack it throws this error "Job failed due to
> exception Resource [Host:6] is unreachable: Host 6: Unable to start instance
> due to Unable to change the state of VM[DomainRouter|r-4-VM]"
>
> 2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing
> org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
> 2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus:
> FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job
> failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to
> start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
>
> r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up
> on host.
>
> I have cluster of 4 Hosts. With HA enabled as per Geoff's guide
> http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
>
> Right now I have only one virtual router and 4 VMs in same isolated network. And
> on all those I can't perform any function.
>
> Yours sincerely,
>
> Sonali Jadhav | System Administrator
> Nordiska Servercentralen
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely
> for the use of the individual to whom it is addressed. Any views or opinions
> expressed are solely those of the author and do not necessarily represent those
> of Shape Blue Ltd or related companies. If you are not the intended recipient
> of this email, you must neither take any action based upon its contents, nor
> copy or show it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company incorporated in
> India and is operated under license from Shape Blue Ltd. Shape Blue Brasil
> Consultoria Ltda is a company incorporated in Brasil and is operated under
> license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
> The Republic of South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue is a registered trademark.
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely
> for the use of the individual to whom it is addressed. Any views or opinions
> expressed are solely those of the author and do not necessarily represent those
> of Shape Blue Ltd or related companies. If you are not the intended recipient
> of this email, you must neither take any action based upon its contents, nor
> copy or show it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company incorporated in
> India and is operated under license from Shape Blue Ltd. Shape Blue Brasil
> Consultoria Ltda is a company incorporated in Brasil and is operated under
> license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
> The Republic of South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue is a registered trademark.
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software
> Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely
> for the use of the individual to whom it is addressed. Any views or opinions
> expressed are solely those of the author and do not necessarily represent those
> of Shape Blue Ltd or related companies. If you are not the intended recipient
> of this email, you must neither take any action based upon its contents, nor
> copy or show it to anyone. Please contact the sender if you believe you have
> received this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company incorporated in
> India and is operated under license from Shape Blue Ltd. Shape Blue Brasil
> Consultoria Ltda is a company incorporated in Brasil and is operated under
> license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by
> The Republic of South Africa and is traded under license from Shape Blue Ltd.
> ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Sonali Jadhav <so...@servercentralen.se>.
Super thanks. After reboot of VR it seemed to help. I am able to start VMs now.
My CloudStack version is 4.4.2.
And if I check Version of Virtual router its 4.4.1. How come? So it's trying to update VR, But cant ? What can be issue?
To cross check I made new VR, and version of that was also 4.4.1.
What is the meaning of zone in avoid set?
And where is cleanup option?
This was weird it happened suddenly. Any idea what could have caused this?
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 3:42 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
As well as updating the DB did you stop then start the VR (note a simple restart may not work, you must stop and start it)
A good test is to log into the VR and tail the messages log, then when you start a VM you should see the DHCP log entries as it gets updated.
The attached log is indicating that CloudStack cannot update the VR. It's also saying your Zone is in an avoid set.
The next step would be to restart the network and use the clean up option, this will destroy the VR and create a new one.
I'm sure it has nothing to do with HA on your XenServer Cluster, but just in case it was not setup correctly also try disabling HA on your Cluster etc
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 10:01
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Ok updated value in database. But now if I try to start VM in CloudStack its giving new error.
Can you check attached log file?
It was totally fine and up, I don’t know what happened. On last Friday I configured HA. It looked fine, After that there was no other changes in CloudStack.
/sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:44 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
What state does CloudStack 'think' the VR is in and what state is it actually in?
Assuming it is running but CloudStack thinks its stopped, mark it as Running in the DB (table vm_instance), then stop it from CloudStack, and then start it from CloudStack.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 09:07
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Hi yes I did.
I have even applied all available updates for XenServer 6.2, to be sure.
I even restarted management service.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:27 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Sonali,
As well as updating the DB did you stop then start the VR (note a simple restart may not work, you must stop and start it)
A good test is to log into the VR and tail the messages log, then when you start a VM you should see the DHCP log entries as it gets updated.
The attached log is indicating that CloudStack cannot update the VR. It's also saying your Zone is in an avoid set.
The next step would be to restart the network and use the clean up option, this will destroy the VR and create a new one.
I'm sure it has nothing to do with HA on your XenServer Cluster, but just in case it was not setup correctly also try disabling HA on your Cluster etc
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 10:01
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Ok updated value in database. But now if I try to start VM in CloudStack its giving new error.
Can you check attached log file?
It was totally fine and up, I don’t know what happened. On last Friday I configured HA. It looked fine, After that there was no other changes in CloudStack.
/sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:44 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
What state does CloudStack 'think' the VR is in and what state is it actually in?
Assuming it is running but CloudStack thinks its stopped, mark it as Running in the DB (table vm_instance), then stop it from CloudStack, and then start it from CloudStack.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 09:07
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Hi yes I did.
I have even applied all available updates for XenServer 6.2, to be sure.
I even restarted management service.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:27 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Sonali Jadhav <so...@servercentralen.se>.
Ok updated value in database. But now if I try to start VM in CloudStack its giving new error.
Can you check attached log file?
It was totally fine and up, I don’t know what happened. On last Friday I configured HA. It looked fine, After that there was no other changes in CloudStack.
/sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:44 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
What state does CloudStack 'think' the VR is in and what state is it actually in?
Assuming it is running but CloudStack thinks its stopped, mark it as Running in the DB (table vm_instance), then stop it from CloudStack, and then start it from CloudStack.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 09:07
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Hi yes I did.
I have even applied all available updates for XenServer 6.2, to be sure.
I even restarted management service.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:27 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
What state does CloudStack 'think' the VR is in and what state is it actually in?
Assuming it is running but CloudStack thinks its stopped, mark it as Running in the DB (table vm_instance), then stop it from CloudStack, and then start it from CloudStack.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 09:07
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Hi yes I did.
I have even applied all available updates for XenServer 6.2, to be sure.
I even restarted management service.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:27 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Sonali Jadhav <so...@servercentralen.se>.
Hi yes I did.
I have even applied all available updates for XenServer 6.2, to be sure.
I even restarted management service.
/Sonali
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Friday, January 16, 2015 2:27 PM
To: users@cloudstack.apache.org
Subject: RE: Help! cant perform any operation on VMs
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Help! cant perform any operation on VMs
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Sonali,
Have you tried restarting the VR?
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Sonali Jadhav [mailto:sonali@servercentralen.se]
Sent: 16 January 2015 08:54
To: users@cloudstack.apache.org
Subject: Help! cant perform any operation on VMs
Hi,
My all instances are stopped on CloudStack but in fact they are up on hosts. If I try to start instance from CloudStack it throws this error "Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"
2015-01-16 09:15:00,156 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2015-01-16 09:15:00,157 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-4f63f9e8 job-299) Complete async job-299, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Job failed due to exception Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to change the state of VM[DomainRouter|r-4-VM]"}
r-4-VM is a virtual router. In CloudStack it says status "starting" but it's up on host.
I have cluster of 4 Hosts. With HA enabled as per Geoff's guide http://shapeblue.com/cloudstack/xenserver-native-ha-with-cloudstack
Right now I have only one virtual router and 4 VMs in same isolated network. And on all those I can't perform any function.
Yours sincerely,
Sonali Jadhav | System Administrator
Nordiska Servercentralen
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.