You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Maurice Lawler <ma...@me.com> on 2013/10/01 18:56:31 UTC

Error when taking host out of maintenance

Anyone able to dycpher what htis is trying to tell me ?

- Maurice

013-10-01 12:54:41,347 DEBUG 
[cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-10:job-188 = 
[ 9552b42a-eac5-4744-8323-d71eb78bc0fb ]) MessageBus message: host 
reserved capacity released for VM: 1, checking if host reservation can 
be released for host:1
2013-10-01 12:54:41,354 DEBUG [cloud.resource.ResourceManagerImpl] 
(Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-d71eb78bc0fb ]) 
Sent resource event EVENT_CANCEL_MAINTENANCE_AFTER to listener 
CapacityManagerImpl_EnhancerByCloudStack_55a560e8
2013-10-01 12:54:41,354 ERROR [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-d71eb78bc0fb ]) 
Unexpected exception while executing 
org.apache.cloudstack.api.command.admin.host.CancelMaintenanceCmd
com.cloud.utils.exception.CloudRuntimeException: Internal error 
cancelling maintenance.
     at 
com.cloud.resource.ResourceManagerImpl.cancelMaintenance(ResourceManagerImpl.java:1156)
     at 
org.apache.cloudstack.api.command.admin.host.CancelMaintenanceCmd.execute(CancelMaintenanceCmd.java:101)
     at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
     at 
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
     at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
     at java.util.concurrent.FutureTask.run(FutureTask.java:166)
     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
     at java.lang.Thread.run(Thread.java:679)
2013-10-01 12:54:41,356 DEBUG [cloud.async.AsyncJobManagerImpl] 
(Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-d71eb78bc0fb ]) 
Complete async job-188 = [ 9552b42a-eac5-4744-8323-d71eb78bc0fb ], 
jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: 
Internal error cancelling maintenance.
2013-10-01 12:54:42,380 DEBUG [cloud.api.ApiServlet] 
(catalina-exec-21:null) ===START===
-- GET 
command=queryAsyncJobResult&jobId=9552b42a-eac5-4744-8323-d71eb78bc0fb&response=json&sessionkey=e3ePddUCCz2xG%2FTvAbZ8jspIpvw%3D&_=1380646468186 


Re: Error when taking host out of maintenance

Posted by Maurice Lawler <ma...@me.com>.
That error is no longer, now getting an error about 
vm_snapshot_chain_size being a duplicate.

The upgrade script has:   ALTER TABLE volumes ADD COLUMN 
vm_snapshot_chain_size bigint(20) unsigned;

Error message is:


2013-10-01 15:03:29,531 DEBUG [db.Transaction.Transaction] 
(Timer-2:null) Rolling back the transaction: Time = 14 Name = 
-CloudStartupServlet$1.run:52-TimerThread.mainLoop:534-TimerThread.run:484; 
called by 
-Transaction.rollback:898-Transaction.removeUpTo:841-Transaction.close:665-DatabaseUpgradeChecker.upgrade:295-DatabaseUpgradeChecker.check:391-ComponentContext.initComponentsLifeCycle:90-CloudStartupServlet$1.run:54-TimerThread.mainLoop:534-TimerThread.run:484
2013-10-01 15:03:29,532 ERROR [utils.component.ComponentContext] 
(Timer-2:null) System integrity check failed. Refuse to startup
com.cloud.utils.exception.CloudRuntimeException: Unable to upgrade the 
database
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:293)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.check(DatabaseUpgradeChecker.java:391)
     at 
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:90)
     at 
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:54)
     at java.util.TimerThread.mainLoop(Timer.java:534)
     at java.util.TimerThread.run(Timer.java:484)
Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to 
execute upgrade script: 
/usr/share/cloudstack-management/setup/db/schema-410to420.sql
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:210)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:262)
     ... 5 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
Duplicate column name 'vm_snapshot_chain_size'
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:193)
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:87)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:201)
     ... 6 more

Re: Error when taking host out of maintenance

Posted by Maurice Lawler <ma...@me.com>.
Seems as though I am running into MULTIPLE errors now. :|


013-10-01 14:49:34,197 ERROR [utils.db.ScriptRunner] (Timer-2:null) 
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate 
column name 'default'
2013-10-01 14:49:34,199 ERROR [cloud.upgrade.DatabaseUpgradeChecker] 
(Timer-2:null) Unable to execute upgrade script: 
/usr/share/cloudstack-management/setup/db/schema-410to420.sql
com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate 
column name 'default'
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:193)
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:87)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:201)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:262)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.check(DatabaseUpgradeChecker.java:391)
     at 
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:90)
     at 
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:54)
     at java.util.TimerThread.mainLoop(Timer.java:534)
     at java.util.TimerThread.run(Timer.java:484)
2013-10-01 14:49:34,200 ERROR [cloud.upgrade.DatabaseUpgradeChecker] 
(Timer-2:null) Unable to upgrade the database
com.cloud.utils.exception.CloudRuntimeException: Unable to execute 
upgrade script: 
/usr/share/cloudstack-management/setup/db/schema-410to420.sql
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:210)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:262)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.check(DatabaseUpgradeChecker.java:391)
     at 
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:90)
     at 
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:54)
     at java.util.TimerThread.mainLoop(Timer.java:534)
     at java.util.TimerThread.run(Timer.java:484)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
Duplicate column name 'default'
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:193)
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:87)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:201)
     ... 6 more
2013-10-01 14:49:34,201 DEBUG [db.Transaction.Transaction] 
(Timer-2:null) Rolling back the transaction: Time = 431 Name = 
-CloudStartupServlet$1.run:52-TimerThread.mainLoop:534-TimerThread.run:484; 
called by 
-Transaction.rollback:898-Transaction.removeUpTo:841-Transaction.close:665-DatabaseUpgradeChecker.upgrade:295-DatabaseUpgradeChecker.check:391-ComponentContext.initComponentsLifeCycle:90-CloudStartupServlet$1.run:54-TimerThread.mainLoop:534-TimerThread.run:484
2013-10-01 14:49:34,202 ERROR [utils.component.ComponentContext] 
(Timer-2:null) System integrity check failed. Refuse to startup
com.cloud.utils.exception.CloudRuntimeException: Unable to upgrade the 
database
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:293)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.check(DatabaseUpgradeChecker.java:391)
     at 
com.cloud.utils.component.ComponentContext.initComponentsLifeCycle(ComponentContext.java:90)
     at 
com.cloud.servlet.CloudStartupServlet$1.run(CloudStartupServlet.java:54)
     at java.util.TimerThread.mainLoop(Timer.java:534)
     at java.util.TimerThread.run(Timer.java:484)
Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to 
execute upgrade script: 
/usr/share/cloudstack-management/setup/db/schema-410to420.sql
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:210)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.upgrade(DatabaseUpgradeChecker.java:262)
     ... 5 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: 
Duplicate column name 'default'
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:193)
     at com.cloud.utils.db.ScriptRunner.runScript(ScriptRunner.java:87)
     at 
com.cloud.upgrade.DatabaseUpgradeChecker.runScript(DatabaseUpgradeChecker.java:201)
     ... 6 more
On 10/1/13, 1:48 PM, Travis Graham wrote:
> Are you using the new systemvm image?
>
> On Oct 1, 2013, at 1:37 PM, Maurice Lawler <ma...@me.com> wrote:
>
>> Since upgrading, and restarting system VM's, nothing is coming back online. System VM's are still in starting state, nothing in the way of error messages in the logs. Did you or anyone else encounter this and if so, how was it resolved.
>>
>>
>> On 10/1/13, 1:19 PM, Marcus Sorensen wrote:
>>> I've gotten errors canceling maintenance too, but it still worked (host was
>>> enabled afterward) so I haven't dug into it yet.
>>> On Oct 1, 2013 10:57 AM, "Maurice Lawler" <ma...@me.com> wrote:
>>>
>>>> Anyone able to dycpher what htis is trying to tell me ?
>>>>
>>>> - Maurice
>>>>
>>>> 013-10-01 12:54:41,347 DEBUG [cloud.deploy.**DeploymentPlanningManagerImpl]
>>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>>> MessageBus message: host reserved capacity released for VM: 1, checking if
>>>> host reservation can be released for host:1
>>>> 2013-10-01 12:54:41,354 DEBUG [cloud.resource.**ResourceManagerImpl]
>>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>>> Sent resource event EVENT_CANCEL_MAINTENANCE_AFTER to listener
>>>> CapacityManagerImpl_**EnhancerByCloudStack_55a560e8
>>>> 2013-10-01 12:54:41,354 ERROR [cloud.async.**AsyncJobManagerImpl]
>>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>>> Unexpected exception while executing org.apache.cloudstack.api.**
>>>> command.admin.host.**CancelMaintenanceCmd
>>>> com.cloud.utils.exception.**CloudRuntimeException: Internal error
>>>> cancelling maintenance.
>>>>      at com.cloud.resource.**ResourceManagerImpl.**cancelMaintenance(**
>>>> ResourceManagerImpl.java:1156)
>>>>      at org.apache.cloudstack.api.**command.admin.host.**
>>>> CancelMaintenanceCmd.execute(**CancelMaintenanceCmd.java:101)
>>>>      at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:**158)
>>>>      at com.cloud.async.**AsyncJobManagerImpl$1.run(**
>>>> AsyncJobManagerImpl.java:531)
>>>>      at java.util.concurrent.**Executors$RunnableAdapter.**
>>>> call(Executors.java:471)
>>>>      at java.util.concurrent.**FutureTask$Sync.innerRun(**
>>>> FutureTask.java:334)
>>>>      at java.util.concurrent.**FutureTask.run(FutureTask.**java:166)
>>>>      at java.util.concurrent.**ThreadPoolExecutor.runWorker(**
>>>> ThreadPoolExecutor.java:1146)
>>>>      at java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
>>>> ThreadPoolExecutor.java:615)
>>>>      at java.lang.Thread.run(Thread.**java:679)
>>>> 2013-10-01 12:54:41,356 DEBUG [cloud.async.**AsyncJobManagerImpl]
>>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>>> Complete async job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ],
>>>> jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Internal
>>>> error cancelling maintenance.
>>>> 2013-10-01 12:54:42,380 DEBUG [cloud.api.ApiServlet]
>>>> (catalina-exec-21:null) ===START===
>>>> -- GET command=queryAsyncJobResult&**jobId=9552b42a-eac5-4744-8323-**
>>>> d71eb78bc0fb&response=json&**sessionkey=e3ePddUCCz2xG%**
>>>> 2FTvAbZ8jspIpvw%3D&_=**1380646468186
>>>>


Re: Error when taking host out of maintenance

Posted by Travis Graham <tg...@tgraham.us>.
Are you using the new systemvm image?

On Oct 1, 2013, at 1:37 PM, Maurice Lawler <ma...@me.com> wrote:

> Since upgrading, and restarting system VM's, nothing is coming back online. System VM's are still in starting state, nothing in the way of error messages in the logs. Did you or anyone else encounter this and if so, how was it resolved.
> 
> 
> On 10/1/13, 1:19 PM, Marcus Sorensen wrote:
>> I've gotten errors canceling maintenance too, but it still worked (host was
>> enabled afterward) so I haven't dug into it yet.
>> On Oct 1, 2013 10:57 AM, "Maurice Lawler" <ma...@me.com> wrote:
>> 
>>> Anyone able to dycpher what htis is trying to tell me ?
>>> 
>>> - Maurice
>>> 
>>> 013-10-01 12:54:41,347 DEBUG [cloud.deploy.**DeploymentPlanningManagerImpl]
>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>> MessageBus message: host reserved capacity released for VM: 1, checking if
>>> host reservation can be released for host:1
>>> 2013-10-01 12:54:41,354 DEBUG [cloud.resource.**ResourceManagerImpl]
>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>> Sent resource event EVENT_CANCEL_MAINTENANCE_AFTER to listener
>>> CapacityManagerImpl_**EnhancerByCloudStack_55a560e8
>>> 2013-10-01 12:54:41,354 ERROR [cloud.async.**AsyncJobManagerImpl]
>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>> Unexpected exception while executing org.apache.cloudstack.api.**
>>> command.admin.host.**CancelMaintenanceCmd
>>> com.cloud.utils.exception.**CloudRuntimeException: Internal error
>>> cancelling maintenance.
>>>     at com.cloud.resource.**ResourceManagerImpl.**cancelMaintenance(**
>>> ResourceManagerImpl.java:1156)
>>>     at org.apache.cloudstack.api.**command.admin.host.**
>>> CancelMaintenanceCmd.execute(**CancelMaintenanceCmd.java:101)
>>>     at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:**158)
>>>     at com.cloud.async.**AsyncJobManagerImpl$1.run(**
>>> AsyncJobManagerImpl.java:531)
>>>     at java.util.concurrent.**Executors$RunnableAdapter.**
>>> call(Executors.java:471)
>>>     at java.util.concurrent.**FutureTask$Sync.innerRun(**
>>> FutureTask.java:334)
>>>     at java.util.concurrent.**FutureTask.run(FutureTask.**java:166)
>>>     at java.util.concurrent.**ThreadPoolExecutor.runWorker(**
>>> ThreadPoolExecutor.java:1146)
>>>     at java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
>>> ThreadPoolExecutor.java:615)
>>>     at java.lang.Thread.run(Thread.**java:679)
>>> 2013-10-01 12:54:41,356 DEBUG [cloud.async.**AsyncJobManagerImpl]
>>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>>> Complete async job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ],
>>> jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Internal
>>> error cancelling maintenance.
>>> 2013-10-01 12:54:42,380 DEBUG [cloud.api.ApiServlet]
>>> (catalina-exec-21:null) ===START===
>>> -- GET command=queryAsyncJobResult&**jobId=9552b42a-eac5-4744-8323-**
>>> d71eb78bc0fb&response=json&**sessionkey=e3ePddUCCz2xG%**
>>> 2FTvAbZ8jspIpvw%3D&_=**1380646468186
>>> 
> 


Re: Error when taking host out of maintenance

Posted by Maurice Lawler <ma...@me.com>.
Since upgrading, and restarting system VM's, nothing is coming back 
online. System VM's are still in starting state, nothing in the way of 
error messages in the logs. Did you or anyone else encounter this and if 
so, how was it resolved.


On 10/1/13, 1:19 PM, Marcus Sorensen wrote:
> I've gotten errors canceling maintenance too, but it still worked (host was
> enabled afterward) so I haven't dug into it yet.
> On Oct 1, 2013 10:57 AM, "Maurice Lawler" <ma...@me.com> wrote:
>
>> Anyone able to dycpher what htis is trying to tell me ?
>>
>> - Maurice
>>
>> 013-10-01 12:54:41,347 DEBUG [cloud.deploy.**DeploymentPlanningManagerImpl]
>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>> MessageBus message: host reserved capacity released for VM: 1, checking if
>> host reservation can be released for host:1
>> 2013-10-01 12:54:41,354 DEBUG [cloud.resource.**ResourceManagerImpl]
>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>> Sent resource event EVENT_CANCEL_MAINTENANCE_AFTER to listener
>> CapacityManagerImpl_**EnhancerByCloudStack_55a560e8
>> 2013-10-01 12:54:41,354 ERROR [cloud.async.**AsyncJobManagerImpl]
>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>> Unexpected exception while executing org.apache.cloudstack.api.**
>> command.admin.host.**CancelMaintenanceCmd
>> com.cloud.utils.exception.**CloudRuntimeException: Internal error
>> cancelling maintenance.
>>      at com.cloud.resource.**ResourceManagerImpl.**cancelMaintenance(**
>> ResourceManagerImpl.java:1156)
>>      at org.apache.cloudstack.api.**command.admin.host.**
>> CancelMaintenanceCmd.execute(**CancelMaintenanceCmd.java:101)
>>      at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:**158)
>>      at com.cloud.async.**AsyncJobManagerImpl$1.run(**
>> AsyncJobManagerImpl.java:531)
>>      at java.util.concurrent.**Executors$RunnableAdapter.**
>> call(Executors.java:471)
>>      at java.util.concurrent.**FutureTask$Sync.innerRun(**
>> FutureTask.java:334)
>>      at java.util.concurrent.**FutureTask.run(FutureTask.**java:166)
>>      at java.util.concurrent.**ThreadPoolExecutor.runWorker(**
>> ThreadPoolExecutor.java:1146)
>>      at java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
>> ThreadPoolExecutor.java:615)
>>      at java.lang.Thread.run(Thread.**java:679)
>> 2013-10-01 12:54:41,356 DEBUG [cloud.async.**AsyncJobManagerImpl]
>> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
>> Complete async job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ],
>> jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Internal
>> error cancelling maintenance.
>> 2013-10-01 12:54:42,380 DEBUG [cloud.api.ApiServlet]
>> (catalina-exec-21:null) ===START===
>> -- GET command=queryAsyncJobResult&**jobId=9552b42a-eac5-4744-8323-**
>> d71eb78bc0fb&response=json&**sessionkey=e3ePddUCCz2xG%**
>> 2FTvAbZ8jspIpvw%3D&_=**1380646468186
>>


Re: Error when taking host out of maintenance

Posted by Marcus Sorensen <sh...@gmail.com>.
I've gotten errors canceling maintenance too, but it still worked (host was
enabled afterward) so I haven't dug into it yet.
On Oct 1, 2013 10:57 AM, "Maurice Lawler" <ma...@me.com> wrote:

> Anyone able to dycpher what htis is trying to tell me ?
>
> - Maurice
>
> 013-10-01 12:54:41,347 DEBUG [cloud.deploy.**DeploymentPlanningManagerImpl]
> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
> MessageBus message: host reserved capacity released for VM: 1, checking if
> host reservation can be released for host:1
> 2013-10-01 12:54:41,354 DEBUG [cloud.resource.**ResourceManagerImpl]
> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
> Sent resource event EVENT_CANCEL_MAINTENANCE_AFTER to listener
> CapacityManagerImpl_**EnhancerByCloudStack_55a560e8
> 2013-10-01 12:54:41,354 ERROR [cloud.async.**AsyncJobManagerImpl]
> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
> Unexpected exception while executing org.apache.cloudstack.api.**
> command.admin.host.**CancelMaintenanceCmd
> com.cloud.utils.exception.**CloudRuntimeException: Internal error
> cancelling maintenance.
>     at com.cloud.resource.**ResourceManagerImpl.**cancelMaintenance(**
> ResourceManagerImpl.java:1156)
>     at org.apache.cloudstack.api.**command.admin.host.**
> CancelMaintenanceCmd.execute(**CancelMaintenanceCmd.java:101)
>     at com.cloud.api.ApiDispatcher.**dispatch(ApiDispatcher.java:**158)
>     at com.cloud.async.**AsyncJobManagerImpl$1.run(**
> AsyncJobManagerImpl.java:531)
>     at java.util.concurrent.**Executors$RunnableAdapter.**
> call(Executors.java:471)
>     at java.util.concurrent.**FutureTask$Sync.innerRun(**
> FutureTask.java:334)
>     at java.util.concurrent.**FutureTask.run(FutureTask.**java:166)
>     at java.util.concurrent.**ThreadPoolExecutor.runWorker(**
> ThreadPoolExecutor.java:1146)
>     at java.util.concurrent.**ThreadPoolExecutor$Worker.run(**
> ThreadPoolExecutor.java:615)
>     at java.lang.Thread.run(Thread.**java:679)
> 2013-10-01 12:54:41,356 DEBUG [cloud.async.**AsyncJobManagerImpl]
> (Job-Executor-10:job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ])
> Complete async job-188 = [ 9552b42a-eac5-4744-8323-**d71eb78bc0fb ],
> jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Internal
> error cancelling maintenance.
> 2013-10-01 12:54:42,380 DEBUG [cloud.api.ApiServlet]
> (catalina-exec-21:null) ===START===
> -- GET command=queryAsyncJobResult&**jobId=9552b42a-eac5-4744-8323-**
> d71eb78bc0fb&response=json&**sessionkey=e3ePddUCCz2xG%**
> 2FTvAbZ8jspIpvw%3D&_=**1380646468186
>