You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Pranav Saxena <pr...@citrix.com> on 2013/03/13 12:34:39 UTC
RE: Error starting system vms on latest asf/master[Solved]
Ok , my issue is resolved now . So the first time when the systemvm.iso wasn't found and CS tried to use some old template in my primary storage as a reference to create systemVm's. After manually copying the systemvm.iso file to the host and also deleting those stale images on my primary storage and re-deploying the db solved the issue for me .
System VM's are up and running now.
Thanks Devdeep for helping in solving the issue !
Regards,
Pranav
-----Original Message-----
From: Pranav Saxena [mailto:pranav.saxena@citrix.com]
Sent: Wednesday, March 13, 2013 4:45 PM
To: cloudstack-dev@incubator.apache.org
Subject: RE: Error starting system vms on latest asf/master
$/pranav/incubator-cloudstack# find . -name vhd-util
./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/xenserver/vhd-util
./client/target/cloud-client-ui-4.2.0-SNAPSHOT/WEB-INF/classes/scripts/vm/hypervisor/xenserver/vhd-util
./scripts/vm/hypervisor/xenserver/vhd-util
-----Original Message-----
From: srivatsav.prasanna@gmail.com [mailto:srivatsav.prasanna@gmail.com] On Behalf Of prasanna
Sent: Wednesday, March 13, 2013 4:34 PM
To: cloudstack-dev@incubator.apache.org
Subject: Re: Error starting system vms on latest asf/master
On 13 March 2013 16:26, Anshul Gangwar <an...@citrix.com> wrote:
> I am also getting the same error
>
> Thanks,
> Anshul
> On 13/03/13 16:25, Pranav Saxena wrote:
>> Hi ,
>>
>> I tried to deploy latest master code to set up a developer's
>> environment (Ubuntu 12.10 , Xenserver 6.1 ) -
>>
>>
>> 1) mvn -P systemvm clean install (systemvm.iso got created)
>>
>> 2) Deployed the db
>>
>> 3) Started the jetty server
>>
>> The systemvm.iso wasn't found on my host so I tried to manually copy
>> it there but it threw an exception while starting the systemVM's as
>> below -
>>
>> Anybody else seen this error ? Any workarounds ?
>>
>> Thanks,
>> Pranav
>>
>> _____________________________________________________________________
>> _____________________________________________________________________
>> _____________________________________
>>
>> at java.lang.Thread.run(Thread.java:722)
>> 2013-03-13 15:58:12,837 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>> nameLabel: Async.VM.start_on
>> nameDescription:
>> allowedOperations: []
>> currentOperations: {}
>> created: Wed Mar 13 16:00:13 IST 2013
>> finished: Wed Mar 13 16:00:15 IST 2013
>> status: failure
>> residentOn: com.xensource.xenapi.Host@c460e443
>> progress: 1.0
>> type: <none/>
>> result:
>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>> File "/usr/bin/pygrub", line 900, in ?
>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>> IOError: [Errno 95] Operation not supported ]
>> otherConfig: {}
>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>> subtasks: []
>>
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>> nameLabel: Async.VM.start_on
>> nameDescription:
>> allowedOperations: []
>> currentOperations: {}
>> created: Wed Mar 13 16:00:13 IST 2013
>> finished: Wed Mar 13 16:00:15 IST 2013
>> status: failure
>> residentOn: com.xensource.xenapi.Host@c460e443
>> progress: 1.0
>> type: <none/>
>> result:
>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>> File "/usr/bin/pygrub", line 900, in ?
>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>> IOError: [Errno 95] Operation not supported ]
>> otherConfig: {}
>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>> subtasks: []
>>
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:3424)
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1427)
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:530)
>> at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
>> at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>> at java.lang.Thread.run(Thread.java:722)
>> 2013-03-13 15:58:12,838 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Unable to start s-42-VM due to
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>> nameLabel: Async.VM.start_on
>> nameDescription:
>> allowedOperations: []
>> currentOperations: {}
>> created: Wed Mar 13 16:00:13 IST 2013
>> finished: Wed Mar 13 16:00:15 IST 2013
>> status: failure
>> residentOn: com.xensource.xenapi.Host@c460e443
>> progress: 1.0
>> type: <none/>
>> result:
>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>> File "/usr/bin/pygrub", line 900, in ?
>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>> IOError: [Errno 95] Operation not supported ]
>> otherConfig: {}
>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>> subtasks: []
>>
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:3424)
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1427)
>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:530)
>> at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
>> at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>> at java.lang.Thread.run(Thread.java:722)
>> 2013-03-13 15:58:12,978 WARN [xen.resource.CitrixResourceBase]
>> (DirectAgent-2:null) Unable to clean up VBD due to You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
>> at com.xensource.xenapi.Types.checkResponse(Types.java:209)
>> at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>> at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059)
>>
>>
>>
~/incubator-cloudstack$ find . -name vhd-util -type f?
Re: Error starting system vms on latest asf/master[Solved]
Posted by Anshul Gangwar <an...@citrix.com>.
For me its little different. I am getting BOOTLOADER_FAILED error. I
have vhd-util on my host. Systemvm.iso is also getting downloaded but
its not starting.
Thanks,
Anshul
____________________________________________________________________________________________________________________________
2013-03-13 11:32:18,778 DEBUG [agent.transport.Request]
(consoleproxy-1:null) Seq 1-368574479: Waiting for Seq 368574478
Scheduling: { Cmd , MgmtId: 50708199391567, via: 1, Ver: v1, Flags:
100111,
[{"storage.CreateCommand":{"volId":2,"pool":{"id":200,"uuid":"22a5d010-6ca4-31cd-a09c-5e40e89fbd4b","host":"10.102.192.100","path":"/cpg_vol/anshul/primary","port":2049,"type":"NetworkFilesystem"},"diskCharacteristics":{"size":0,"tags":[],"type":"ROOT","name":"ROOT-2","useLocalStorage":false,"recreatable":true,"diskOfferingId":10,"volumeId":2},"templateUrl":"4358a505-1abd-49b0-92fa-9177c7ac5065","wait":0}}]
}
2013-03-13 11:32:18,804 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-12:null) Created a vif c277cee8-9ff7-736e-6671-34d46b7275fb
on 3
2013-03-13 11:32:20,873 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-12:null) Task failed! Task record: uuid:
4207bf0e-1fa3-6d3a-e288-76115294460e
nameLabel: Async.VM.start_on
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Mar 13 11:40:20 IST 2013
finished: Wed Mar 13 11:40:22 IST 2013
status: failure
residentOn: com.xensource.xenapi.Host@4bae8b78
progress: 1.0
type: <none/>
result:
errorInfo: [BOOTLOADER_FAILED,
OpaqueRef:d2e67bfb-db3c-b65e-4ae1-e579bb9dcede, Unable to find partition
containing kernel
]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
2013-03-13 11:32:20,890 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-12:null) Unable to start VM(s-1-VM) on
host(3a6b2d04-c5df-4e15-bcbc-4867c591d0b7) due to Task failed! Task
record: uuid: 4207bf0e-1fa3-6d3a-e288-76115294460e
nameLabel: Async.VM.start_on
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Mar 13 11:40:20 IST 2013
finished: Wed Mar 13 11:40:22 IST 2013
status: failure
residentOn: com.xensource.xenapi.Host@4bae8b78
progress: 1.0
type: <none/>
result:
errorInfo: [BOOTLOADER_FAILED,
OpaqueRef:d2e67bfb-db3c-b65e-4ae1-e579bb9dcede, Unable to find partition
containing kernel
On 13/03/13 17:04, Pranav Saxena wrote:
> Ok , my issue is resolved now . So the first time when the systemvm.iso wasn't found and CS tried to use some old template in my primary storage as a reference to create systemVm's. After manually copying the systemvm.iso file to the host and also deleting those stale images on my primary storage and re-deploying the db solved the issue for me .
>
> System VM's are up and running now.
>
> Thanks Devdeep for helping in solving the issue !
>
> Regards,
> Pranav
>
> -----Original Message-----
> From: Pranav Saxena [mailto:pranav.saxena@citrix.com]
> Sent: Wednesday, March 13, 2013 4:45 PM
> To: cloudstack-dev@incubator.apache.org
> Subject: RE: Error starting system vms on latest asf/master
>
> $/pranav/incubator-cloudstack# find . -name vhd-util
>
> ./client/target/generated-webapp/WEB-INF/classes/scripts/vm/hypervisor/xenserver/vhd-util
> ./client/target/cloud-client-ui-4.2.0-SNAPSHOT/WEB-INF/classes/scripts/vm/hypervisor/xenserver/vhd-util
> ./scripts/vm/hypervisor/xenserver/vhd-util
>
> -----Original Message-----
> From: srivatsav.prasanna@gmail.com [mailto:srivatsav.prasanna@gmail.com] On Behalf Of prasanna
> Sent: Wednesday, March 13, 2013 4:34 PM
> To: cloudstack-dev@incubator.apache.org
> Subject: Re: Error starting system vms on latest asf/master
>
> On 13 March 2013 16:26, Anshul Gangwar <an...@citrix.com> wrote:
>> I am also getting the same error
>>
>> Thanks,
>> Anshul
>> On 13/03/13 16:25, Pranav Saxena wrote:
>>> Hi ,
>>>
>>> I tried to deploy latest master code to set up a developer's
>>> environment (Ubuntu 12.10 , Xenserver 6.1 ) -
>>>
>>>
>>> 1) mvn -P systemvm clean install (systemvm.iso got created)
>>>
>>> 2) Deployed the db
>>>
>>> 3) Started the jetty server
>>>
>>> The systemvm.iso wasn't found on my host so I tried to manually copy
>>> it there but it threw an exception while starting the systemVM's as
>>> below -
>>>
>>> Anybody else seen this error ? Any workarounds ?
>>>
>>> Thanks,
>>> Pranav
>>>
>>> _____________________________________________________________________
>>> _____________________________________________________________________
>>> _____________________________________
>>>
>>> at java.lang.Thread.run(Thread.java:722)
>>> 2013-03-13 15:58:12,837 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Catch Exception: class com.cloud.utils.exception.CloudRuntimeException due to com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>>> nameLabel: Async.VM.start_on
>>> nameDescription:
>>> allowedOperations: []
>>> currentOperations: {}
>>> created: Wed Mar 13 16:00:13 IST 2013
>>> finished: Wed Mar 13 16:00:15 IST 2013
>>> status: failure
>>> residentOn: com.xensource.xenapi.Host@c460e443
>>> progress: 1.0
>>> type: <none/>
>>> result:
>>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>>> File "/usr/bin/pygrub", line 900, in ?
>>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>>> IOError: [Errno 95] Operation not supported ]
>>> otherConfig: {}
>>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>>> subtasks: []
>>>
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>>> nameLabel: Async.VM.start_on
>>> nameDescription:
>>> allowedOperations: []
>>> currentOperations: {}
>>> created: Wed Mar 13 16:00:13 IST 2013
>>> finished: Wed Mar 13 16:00:15 IST 2013
>>> status: failure
>>> residentOn: com.xensource.xenapi.Host@c460e443
>>> progress: 1.0
>>> type: <none/>
>>> result:
>>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>>> File "/usr/bin/pygrub", line 900, in ?
>>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>>> IOError: [Errno 95] Operation not supported ]
>>> otherConfig: {}
>>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>>> subtasks: []
>>>
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:3424)
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1427)
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:530)
>>> at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
>>> at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>> at java.lang.Thread.run(Thread.java:722)
>>> 2013-03-13 15:58:12,838 WARN [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Unable to start s-42-VM due to
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start VM(s-42-VM) on host(0d014dbd-f2e8-47e1-807d-5fb0e5a59fa1) due to Task failed! Task record: uuid: 702df462-1c78-a76e-ab02-513bb2523c4a
>>> nameLabel: Async.VM.start_on
>>> nameDescription:
>>> allowedOperations: []
>>> currentOperations: {}
>>> created: Wed Mar 13 16:00:13 IST 2013
>>> finished: Wed Mar 13 16:00:15 IST 2013
>>> status: failure
>>> residentOn: com.xensource.xenapi.Host@c460e443
>>> progress: 1.0
>>> type: <none/>
>>> result:
>>> errorInfo: [INTERNAL_ERROR, xenopsd internal error: VM = cf8b3190-3d6e-f7df-f328-43fe1ff1f504; domid = 2; Bootloader.Bad_error Traceback (most recent call last):
>>> File "/usr/bin/pygrub", line 900, in ?
>>> fs = fsimage.open(file, part_offs[0], bootfsoptions)
>>> IOError: [Errno 95] Operation not supported ]
>>> otherConfig: {}
>>> subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>>> subtasks: []
>>>
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.startVM(CitrixResourceBase.java:3424)
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1427)
>>> at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:530)
>>> at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
>>> at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
>>> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>> at java.lang.Thread.run(Thread.java:722)
>>> 2013-03-13 15:58:12,978 WARN [xen.resource.CitrixResourceBase]
>>> (DirectAgent-2:null) Unable to clean up VBD due to You gave an invalid object reference. The object may have recently been deleted. The class parameter gives the type of reference given, and the handle parameter echoes the bad value given.
>>> at com.xensource.xenapi.Types.checkResponse(Types.java:209)
>>> at com.xensource.xenapi.Connection.dispatch(Connection.java:368)
>>> at com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909)
>>> at com.xensource.xenapi.VBD.unplug(VBD.java:1059)
>>>
>>>
>>>
> ~/incubator-cloudstack$ find . -name vhd-util -type f?