You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Simon Weller <sw...@ena.com> on 2017/03/19 00:27:34 UTC
Re: Host Disconnected after upgrade to ACS 4.9.2
Ghaith,
Do you have a load balancer between your management servers and hosts by any chance?
- Si
________________________________
From: Ghaith Bannoura <gb...@etq.com>
Sent: Saturday, March 18, 2017 8:27 AM
To: users@cloudstack.apache.org
Subject: Host Disconnected after upgrade to ACS 4.9.2
Hello All,
I Have a ACS version 4.8 with xenserver 6.5 and after upgrade ACS to 4.9.2.0 All hosts appear in disconnect state I checked the logs and I found the below error for all hosts
WARN [c.c.a.m.ClusteredAgentManagerImpl] (ClusteredAgentManager Timer:ctx-00f87152) (logid:e54c2b87) can not load directly connected host due to
com.cloud.utils.exception.CloudRuntimeException: Unable to create master connection to host, due to The credentials given by the user are incorrect, so access has been denied, and you have not been issued a session handle.
Can you please advise how can I resolve this issue .
Best Regards,
EtQ, Inc.
Ghaith Bannoura
Senior System Administrator
MCT, MCSE (Messaging, Server Infrastructure)
MCSA (Windows Server 2008, 2012), MCP
* Phone: +9626-537-0923 Ext. 376
* Gbannoura@etq.com <ma...@etq.com>
* http://www.etq.com<http://www.etq.com/>
RE: Host Disconnected after upgrade to ACS 4.9.2
Posted by Ghaith Bannoura <gb...@etq.com>.
The Dom0 in all servers around 80-85% full , is there anything else should I check ?
Best Regards,
EtQ, Inc.
Ghaith Bannoura
Senior System Administrator
MCT, MCSE (Messaging, Server Infrastructure)
MCSA (Windows Server 2008, 2012), MCP
Phone: +9626-537-0923 Ext. 376
P Gbannoura@etq.com
G http://www.etq.com
-----Original Message-----
From: Prakash Sharma [mailto:sharmaprakash1@gmail.com]
Sent: Sunday, March 19, 2017 5:34 PM
To: users@cloudstack.apache.org
Subject: Re: Host Disconnected after upgrade to ACS 4.9.2
Well, If that works out then its fine.
But I think, issue is management is not able to pull correct status of VR.
Or VR is not getting setup correctly.
2017-03-19 10:23:39,768 WARN [o.a.c.alerts] (Work-Job-Executor-4:ctx-00f8fec4
job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) alertType:: 9 //
dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Command:
com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
2017-03-19 10:23:39,774 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
(logid:0e5bb9fa) GetDomRVersionCmd failed
2017-03-19 10:23:39,774 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
(logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
On Sun, Mar 19, 2017 at 8:40 PM, Gabriel Beims Bräscher < gabriel@autonomiccs.com.br> wrote:
> Hi Ghaith,
>
> I had a similar problem due to Dom0 out of disk space.
>
> XenServer 6.5 Dom0 has a limited disk space (4.0 GB). You can check if
> the
> Dom0 is out of disk space with "df -h".
> If that is the case, just have to clean some old log files.
>
> Cheers,
> Gabriel.
>
>
> Em 19/03/2017 05:38, Ghaith Bannoura escreveu:
>
>> Hello Simon,
>>
>> I don't have any load balancer , but after update the host password
>> using updatehostpassword api , the hosts is up and running but
>> unfortunately there is no any vm, system vm or virtual router can be
>> started (when try to start any vm the virtual router created and
>> after finish booting its destroyed automatically) , below sample from
>> the log the log
>>
>>
>> 2017-03-19 10:23:39,761 DEBUG [c.c.a.t.Request]
>> (DirectAgent-185:ctx-2689b47b) (logid:0e5bb9fa) Seq 6-5388275479172087905:
>> Processing: { Ans: , MgmtId: 233845173047295, via: 6(JOHQHOST02),
>> Ver: v1,
>> Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":733,"name":"
>> r-733-VM","bootloader":"PyGrub","type":"DomainRouter",
>> "cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"
>> maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux
>> 7(64-bit)","platformEmulator":"Debian Wheezy 7.0 (64-bit)","bootArgs":"
>> template=domP name=r-733-VM eth0ip=192.168.104.157
>> eth0mask=255.255.252.0
>> gateway=192.168.104.1 domain=cs1cloud.internal cidrsize=22
>> dhcprange=192.168.104.1 eth1ip=169.254.1.74 eth1mask=255.255.0.0
>> type=dhcpsrvr disable_rp_filter=true dns1=192.168.30.2 dns2= ip6dns1=
>> ip6dns2= baremetalnotificationsecuritykey=IwUZ+UPiYew8AFsVM8fo8CZ7IIM
>> FWftmmcmzBqQPPBCq8sWHrcrvTpz4qOiWTNzScqDNpAlQBs3BwFKNKoE1LFB
>> giSkGt1rFEKq6z88zyydXsz6+YwwAL1inwxVMdgkG
>> giSkGt1rFEKq6z88zyydXsz6+baremetalnotificationapikey=I9
>> 4EoET6AnrIuy3mo6Fv2zEhSBrPIuWdNxt2jnTTxTkX33c9z4ByGo7Tz8KJTcc7es6oB38
>> zjZr8LonxU8fKzQ
>> host=192.168.104.2 port=8080","enableHA":true,"li
>> mitCpuUse":false,"enableDynamicallyScaleVm":false,"
>> vncPassword":"qfXB2RD5Y4gLWbaFVlEi8A","params":{},"uuid":"
>> 3bd402ee-564e-46bf-a6b5-edb08094c0ec","disks":[{"data":{"org.apache.
>> cloudstack.storage.to.VolumeObjectTO":{"uuid":"009c6bf0-fb71-43c8-
>> ad99-092aafe1984e","volumeType":"ROOT","dataStore":{"org.
>> apache.cloudstack.storage.to.PrimaryDataStoreTO"
>> :{"uuid":"7864d43b-b0a4-d479-3119-710fd9f0d4fd","id":2,"poo
>> lType":"LVM","host":"192.168.104.11","path":"lvm","port":0,"url":"LVM
>> ://
>> 192.168.104.11/lvm/?ROLE=Primary&STOREUUID=7864d43b-b0a4-d479-3119-
>> 710fd9f0d4fd"}},"name":"ROOT-733","size":3145728000,"path":
>> "0d7285d3-3f48-4541-86b6-38020d9d59bd","volumeId":734,"
>> vmName":"r-733-VM","accountId":1,"format":"VHD","provisionin
>> gType":"THIN","id":734,"deviceId":0,"bytesReadRate":0,
>> "bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hyper
>> visorType":"XenServer"}},"diskSeq":0,"path":"0d7285d3-3f
>> 48-4541-86b6-38020d9d59bd","type":"ROOT","_details":{"manage
>> d":"false","storagePort":"0","storageHost":"192.168.104.11",
>> "volumeSize":"3145728000"}}],"nics":[{"deviceId":0,"
>> networkRateMbps":200,"defaultNic":true,"pxeDisable":
>> true,"nicUuid":"c8f551f0-73c3-429b-8404-f4ca40dc98be","uuid"
>> :"53dd9246-ceb5-4484-b8f8-6f214466c67d","ip":"192.168.104.
>> 157","netmask":"255.255.252.0","gateway":"192.168.104.1","
>> mac":"06:c8:dc:00:00:6c","dns1":"192.168.30.2","dns2":"","
>> broadcastType":"Native","type":"Guest","broadcastUri":"vlan:
>> //untagged","isSecurityGroupEnabled":true},{"deviceId":1,"ne
>> tworkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"
>> nicUuid":"0344754e-292a-407a-8d8d-578303e418b9","uuid":"
>> 1196bf19-1bae-4beb-a511-68cc310fd1db","ip":"169.254.1.
>> 74","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"
>> 0e:00:a9:fe:01:4a","broadcastType":"LinkLocal","type":"
>> Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"
>> result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSsh
>> Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetD
>> omRVersionAnswer":{"result":false,"details":"GetDomRVersionCmd
>> failed","wait":0}}] }
>> 2017-03-19 10:23:39,768 WARN [o.a.c.alerts]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) alertType:: 9 // dataCenterId:: 1 // podId:: 1 //
>> clusterId:: null // message:: Command:
>> com.cloud.agent.api.GetDomRVersionCommand
>> failed while starting virtual router
>> 2017-03-19 10:23:39,774 ERROR
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) GetDomRVersionCmd failed
>> 2017-03-19 10:23:39,774 WARN
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand
>> failed while starting virtual router
>> 2017-03-19 10:23:41,499 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-13:ctx-5a19ecc3 ctx-04aa7c8a) (logid:e427c85a)
>> Received unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:23:44,500 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-10:ctx-86278f34 ctx-259dbd1b) (logid:da522034)
>> Received unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:23:46,033 ERROR [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Failed to start instance VM[DomainRouter|r-733-VM]
>> com.cloud.utils.exception.ExecutionException: Unable to start
>> VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in
>> finalizeStart, not retrying
>> 2017-03-19 10:23:46,079 DEBUG [c.c.c.CapacityManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event:
>> OperationFailedvm's original host id: null new host id: null host id
>> before state transition: 6
>> 2017-03-19 10:23:46,088 INFO [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Unable to contact resource.
>> com.cloud.exception.AgentUnavailableException: Resource [Host:6] is
>> unreachable: Host 6: Unable to start instance due to Unable to start
>> VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in
>> finalizeStart, not retrying Caused by:
>> com.cloud.utils.exception.ExecutionException: Unable to start
>> VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in
>> finalizeStart, not retrying
>> 2017-03-19 10:23:46,187 DEBUG [c.c.c.CapacityManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event:
>> OperationFailedvm's original host id: 6 new host id: null host id
>> before state transition: 7
>> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobHandlerProxy]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Invocation exception, caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,205 INFO [c.c.v.VmWorkJobHandlerProxy]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Rethrow exception com.cloud.exception.InsufficientServerCapacityException:
>> Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobDispatcher]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa)
>> Unable to complete AsyncJobVO {id:7504, userId: 2, accountId: 2,
>> instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart,
>> cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oA
>> BGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50
>> UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5n
>> L0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xh
>> bmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVy
>> cQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0
>> AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29t
>> LmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNl
>> cklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAA
>> AAIAAAAAAAAAm3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwc
>> HBwcHA,
>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>> result: null, initMsid: 233845173047295, completeMsid: null, lastUpdated:
>> null, lastPolled: null, created: Sun Mar 19 10:22:36 EET 2017}, job
>> origin:7501
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa)
>> Complete async job-7504, jobStatus: FAILED, resultCode: 0, result:
>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZl
>> ckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vw
>> c0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRD
>> YXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5n
>> L0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xv
>> dWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vy
>> cm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2
>> YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4a
>> OxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNh
>> dXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQA
>> EkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFu
>> Zy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QA
>> EExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA1VW5hYmxlIHRvIGNyZWF0ZSBh
>> IGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS04LTE1NS1WTV11cgAeW0xqYXZh
>> LmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAb
>> amF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5l
>> TnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ACkwACGZpbGVOYW1lcQB-AApM
>> AAptZXRob2ROYW1lcQB-AAp4cAAAA710ACZjb20uY2xvdWQudm0uVmlydHVh
>> bE1hY2hpbmVNYW5hZ2VySW1wbHQAHlZpcnR1YWxNYWNoaW5lTWFuYWdlcklt
>> cGwuamF2YXQAEG9yY2hlc3RyYXRlU3RhcnRzcQB-ABEAABH9cQB-ABNxAH4A
>> FHEAfgAVc3EAfgAR_____nQAJHN1bi5yZWZsZWN0Lk5hdGl2ZU1ldGhvZEFj
>> Y2Vzc29ySW1wbHQAHU5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbC5qYXZhdAAH
>> aW52b2tlMHNxAH4AEQAAADlxAH4AGHEAfgAZdAAGaW52b2tlc3EAfgARAAAA
>> K3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0
>> ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AHHNxAH4A
>> EQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2
>> YXEAfgAcc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5k
>> bGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRs
>> ZVZtV29ya0pvYnNxAH4AEQAAEp5xAH4AE3EAfgAUcQB-ACZzcQB-ABEAAABm
>> dAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtK
>> b2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFw
>> YWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JN
>> YW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVu
>> SW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5t
>> YW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFu
>> YWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9y
>> Zy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZh
>> dWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5q
>> YXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2su
>> bWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-
>> ADZ0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADlxAH4ANnQADnJ1
>> bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFj
>> ay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAy
>> cQB-ADNzcQB-ABEAAAH2cQB-AC1xAH4ALnEAfgAzc3EAfgARAAAB13QALmph
>> dmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0
>> AA5FeGVjdXRvcnMuamF2YXEAfgA3c3EAfgARAAABBnQAH2phdmEudXRpbC5j
>> b25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AM3Nx
>> AH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhl
>> Y3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNx
>> AH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhl
>> Y3V0b3IkV29ya2VycQB-AEhxAH4AM3NxAH4AEQAAAul0ABBqYXZhLmxhbmcu
>> VGhyZWFkdAALVGhyZWFkLmphdmFxAH4AM3NyACZqYXZhLnV0aWwuQ29sbGVj
>> dGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAM
>> eHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0
>> aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hw
>> c3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAA
>> AAB3BAAAAAB4cQB-AFR4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgC
>> AAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAA
>> EO9zcQB-AFMAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPf
>> AgABSgAFdmFsdWV4cQB-AFYAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0
>> YUNlbnRlcrLxCuun53i-AgAAeHAA
>>
>
> 2017-03-19 10:23:46,231 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa)
>> Unexpected exception while executing org.apache.cloudstack.api.comm
>> and.admin.vm.StartVMCmdByAdmin
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException:
>> Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,242 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Complete
>> async job-7501, jobStatus: FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"
>> uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2017-03-19 10:23:47,500 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-19:ctx-c5732f56 ctx-d7afadc9) (logid:8c0eb462)
>> Received unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:26:54,733 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-21:ctx-78a8b918 ctx-9f08b269) (logid:47d4deec)
>> Received unknown parameters for command listLdapConfigurations. Unknown parameters :
>> listall
>> 2017-03-19 10:26:57,055 WARN [o.a.c.alerts]
>> (CapacityChecker:ctx-a39bc246) (logid:df7f94f9) alertType:: 25 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert:
>> Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1
>> pod
>> JO-HQ-POD1 of availability zone JO-HQ
>> 2017-03-19 10:26:59,646 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-20:ctx-b1debd61 ctx-2d20decd) (logid:96719d42)
>> Received unknown parameters for command listBaremetalRct. Unknown parameters :
>> listall
>> 2017-03-19 10:27:02,350 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-5:ctx-ab69e2bb ctx-51083bf6) (logid:c83381f2) Received
>> unknown parameters for command listHypervisorCapabilities. Unknown
>> parameters : listall
>> 2017-03-19 10:31:27,009 WARN [o.a.c.alerts] (HA-2:ctx-6fdbe9c2)
>> (logid:f8aeefce) alertType:: 13 // dataCenterId:: 0 // podId:: 0 //
>> clusterId:: null // message:: No usage server process running
>> 2017-03-19 10:31:57,060 WARN [o.a.c.alerts]
>> (CapacityChecker:ctx-86ad95ac) (logid:39a26e60) alertType:: 25 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert:
>> Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1
>> pod
>> JO-HQ-POD1 of availability zone JO-HQ
>> 2017-03-19 10:33:01,520 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-16:ctx-0e36b0fe ctx-3ad1edfb) (logid:07ad308f)
>> Received unknown parameters for command listZones. Unknown parameters
>> : listall
>> 2017-03-19 10:33:01,524 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-18:ctx-76db405a ctx-dd7f9f16) (logid:6b187401)
>> Received unknown parameters for command listPods. Unknown parameters
>> : listall
>> 2017-03-19 10:33:01,529 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-17:ctx-76472820 ctx-dc1c021d) (logid:2d68f1a9)
>> Received unknown parameters for command listClusters. Unknown
>> parameters : listall
>> 2017-03-19 10:33:01,531 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-22:ctx-384018fa ctx-e6d52085) (logid:0aa15a63)
>> Received unknown parameters for command listStoragePools. Unknown parameters :
>> listall
>> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-2:ctx-937d0545 ctx-f180b96b) (logid:77521124) Received
>> unknown parameters for command listImageStores. Unknown parameters :
>> listall type
>> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-14:ctx-21018932 ctx-ac45366b) (logid:9b7581b4)
>> Received unknown parameters for command listHosts. Unknown parameters
>> : listall
>> 2017-03-19 10:33:01,556 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-3:ctx-bfe083a3 ctx-09039a75) (logid:018779dc) Received
>> unknown parameters for command listSystemVms. Unknown parameters :
>> listall
>> 2017-03-19 10:33:03,085 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-23:ctx-499cee62 ctx-ed681045) (logid:cc2f05e6)
>> Received unknown parameters for command listHosts. Unknown parameters
>> : listall
>> 2017-03-19 10:33:04,612 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-21:ctx-79f266d8 ctx-e0cdbe3b) (logid:b0a475a0)
>> Received unknown parameters for command listZones. Unknown parameters
>> : listall
>> 2017-03-19 10:33:04,616 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-20:ctx-87c35ca1 ctx-6e69036a) (logid:ad115fb3)
>> Received unknown parameters for command listPods. Unknown parameters
>> : listall
>> 2017-03-19 10:33:04,620 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-5:ctx-92794f98 ctx-138184de) (logid:e76f1b75) Received
>> unknown parameters for command listClusters. Unknown parameters :
>> listall
>> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-18:ctx-9da0f2af ctx-b0a11301) (logid:0b75334c)
>> Received unknown parameters for command listStoragePools. Unknown parameters :
>> listall
>> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-25:ctx-1a7bca82 ctx-bba0e3e7) (logid:a5645aaf)
>> Received unknown parameters for command listHosts. Unknown parameters
>> : listall
>> 2017-03-19 10:33:04,624 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-16:ctx-11bd4054 ctx-9d1233c8) (logid:6ed8835b)
>> Received unknown parameters for command listImageStores. Unknown parameters :
>> listall type
>> 2017-03-19 10:33:04,647 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-2:ctx-ea24db96 ctx-19027bd0) (logid:5eb98b9b) Received
>> unknown parameters for command listSystemVms. Unknown parameters :
>> listall
>>
>> Best Regards,
>> EtQ, Inc.
>> Ghaith Bannoura
>> Senior System Administrator
>> MCT, MCSE (Messaging, Server Infrastructure) MCSA (Windows Server
>> 2008, 2012), MCP
>>
>> Phone: +9626-537-0923 Ext. 376
>> P Gbannoura@etq.com
>> G http://www.etq.com
>>
>> -----Original Message-----
>> From: Simon Weller [mailto:sweller@ena.com]
>> Sent: Sunday, March 19, 2017 2:28 AM
>> To: users@cloudstack.apache.org
>> Subject: Re: Host Disconnected after upgrade to ACS 4.9.2
>>
>> Ghaith,
>>
>>
>> Do you have a load balancer between your management servers and hosts
>> by any chance?
>>
>>
>> - Si
>>
>>
>>
>>
>> ________________________________
>> From: Ghaith Bannoura <gb...@etq.com>
>> Sent: Saturday, March 18, 2017 8:27 AM
>> To: users@cloudstack.apache.org
>> Subject: Host Disconnected after upgrade to ACS 4.9.2
>>
>> Hello All,
>>
>> I Have a ACS version 4.8 with xenserver 6.5 and after upgrade ACS to
>> 4.9.2.0 All hosts appear in disconnect state I checked the logs and I
>> found the below error for all hosts
>>
>> WARN [c.c.a.m.ClusteredAgentManagerImpl] (ClusteredAgentManager
>> Timer:ctx-00f87152) (logid:e54c2b87) can not load directly connected
>> host due to
>> com.cloud.utils.exception.CloudRuntimeException: Unable to create
>> master connection to host, due to The credentials given by the user
>> are incorrect, so access has been denied, and you have not been issued a session handle.
>>
>>
>> Can you please advise how can I resolve this issue .
>>
>> Best Regards,
>> EtQ, Inc.
>> Ghaith Bannoura
>> Senior System Administrator
>> MCT, MCSE (Messaging, Server Infrastructure) MCSA (Windows Server
>> 2008, 2012), MCP
>>
>> * Phone: +9626-537-0923 Ext. 376
>> * Gbannoura@etq.com <ma...@etq.com>
>> * http://www.etq.com<http://www.etq.com/>
>>
>>
>
>
--
Thanks & Regards
Prakash Sharma
Re: Host Disconnected after upgrade to ACS 4.9.2
Posted by Prakash Sharma <sh...@gmail.com>.
Well, If that works out then its fine.
But I think, issue is management is not able to pull correct status of VR.
Or VR is not getting setup correctly.
2017-03-19 10:23:39,768 WARN [o.a.c.alerts] (Work-Job-Executor-4:ctx-00f8fec4
job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) alertType:: 9 //
dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Command:
com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual
router
2017-03-19 10:23:39,774 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
(logid:0e5bb9fa) GetDomRVersionCmd failed
2017-03-19 10:23:39,774 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
(logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand failed
while starting virtual router
On Sun, Mar 19, 2017 at 8:40 PM, Gabriel Beims Bräscher <
gabriel@autonomiccs.com.br> wrote:
> Hi Ghaith,
>
> I had a similar problem due to Dom0 out of disk space.
>
> XenServer 6.5 Dom0 has a limited disk space (4.0 GB). You can check if the
> Dom0 is out of disk space with "df -h".
> If that is the case, just have to clean some old log files.
>
> Cheers,
> Gabriel.
>
>
> Em 19/03/2017 05:38, Ghaith Bannoura escreveu:
>
>> Hello Simon,
>>
>> I don't have any load balancer , but after update the host password using
>> updatehostpassword api , the hosts is up and running but unfortunately
>> there is no any vm, system vm or virtual router can be started (when try to
>> start any vm the virtual router created and after finish booting its
>> destroyed automatically) , below sample from the log the log
>>
>>
>> 2017-03-19 10:23:39,761 DEBUG [c.c.a.t.Request]
>> (DirectAgent-185:ctx-2689b47b) (logid:0e5bb9fa) Seq 6-5388275479172087905:
>> Processing: { Ans: , MgmtId: 233845173047295, via: 6(JOHQHOST02), Ver: v1,
>> Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":733,"name":"
>> r-733-VM","bootloader":"PyGrub","type":"DomainRouter",
>> "cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"
>> maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux
>> 7(64-bit)","platformEmulator":"Debian Wheezy 7.0 (64-bit)","bootArgs":"
>> template=domP name=r-733-VM eth0ip=192.168.104.157 eth0mask=255.255.252.0
>> gateway=192.168.104.1 domain=cs1cloud.internal cidrsize=22
>> dhcprange=192.168.104.1 eth1ip=169.254.1.74 eth1mask=255.255.0.0
>> type=dhcpsrvr disable_rp_filter=true dns1=192.168.30.2 dns2= ip6dns1=
>> ip6dns2= baremetalnotificationsecuritykey=IwUZ+UPiYew8AFsVM8fo8CZ7IIM
>> FWftmmcmzBqQPPBCq8sWHrcrvTpz4qOiWTNzScqDNpAlQBs3BwFKNKoE1LFB
>> giSkGt1rFEKq6z88zyydXsz6+YwwAL1inwxVMdgkG baremetalnotificationapikey=I9
>> 4EoET6AnrIuy3mo6Fv2zEhSBrPIuWdNxt2jnTTxTkX33c9z4ByGo7Tz8KJTcc7es6oB38zjZr8LonxU8fKzQ
>> host=192.168.104.2 port=8080","enableHA":true,"li
>> mitCpuUse":false,"enableDynamicallyScaleVm":false,"
>> vncPassword":"qfXB2RD5Y4gLWbaFVlEi8A","params":{},"uuid":"
>> 3bd402ee-564e-46bf-a6b5-edb08094c0ec","disks":[{"data":{"org.apache.
>> cloudstack.storage.to.VolumeObjectTO":{"uuid":"009c6bf0-fb71-43c8-
>> ad99-092aafe1984e","volumeType":"ROOT","dataStore":{"org.
>> apache.cloudstack.storage.to.PrimaryDataStoreTO"
>> :{"uuid":"7864d43b-b0a4-d479-3119-710fd9f0d4fd","id":2,"poo
>> lType":"LVM","host":"192.168.104.11","path":"lvm","port":0,"url":"LVM://
>> 192.168.104.11/lvm/?ROLE=Primary&STOREUUID=7864d43b-b0a4-d479-3119-
>> 710fd9f0d4fd"}},"name":"ROOT-733","size":3145728000,"path":
>> "0d7285d3-3f48-4541-86b6-38020d9d59bd","volumeId":734,"
>> vmName":"r-733-VM","accountId":1,"format":"VHD","provisionin
>> gType":"THIN","id":734,"deviceId":0,"bytesReadRate":0,
>> "bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hyper
>> visorType":"XenServer"}},"diskSeq":0,"path":"0d7285d3-3f
>> 48-4541-86b6-38020d9d59bd","type":"ROOT","_details":{"manage
>> d":"false","storagePort":"0","storageHost":"192.168.104.11",
>> "volumeSize":"3145728000"}}],"nics":[{"deviceId":0,"
>> networkRateMbps":200,"defaultNic":true,"pxeDisable":
>> true,"nicUuid":"c8f551f0-73c3-429b-8404-f4ca40dc98be","uuid"
>> :"53dd9246-ceb5-4484-b8f8-6f214466c67d","ip":"192.168.104.
>> 157","netmask":"255.255.252.0","gateway":"192.168.104.1","
>> mac":"06:c8:dc:00:00:6c","dns1":"192.168.30.2","dns2":"","
>> broadcastType":"Native","type":"Guest","broadcastUri":"vlan:
>> //untagged","isSecurityGroupEnabled":true},{"deviceId":1,"ne
>> tworkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"
>> nicUuid":"0344754e-292a-407a-8d8d-578303e418b9","uuid":"
>> 1196bf19-1bae-4beb-a511-68cc310fd1db","ip":"169.254.1.
>> 74","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"
>> 0e:00:a9:fe:01:4a","broadcastType":"LinkLocal","type":"
>> Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"
>> result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSsh
>> Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetD
>> omRVersionAnswer":{"result":false,"details":"GetDomRVersionCmd
>> failed","wait":0}}] }
>> 2017-03-19 10:23:39,768 WARN [o.a.c.alerts]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) alertType:: 9 // dataCenterId:: 1 // podId:: 1 //
>> clusterId:: null // message:: Command: com.cloud.agent.api.GetDomRVersionCommand
>> failed while starting virtual router
>> 2017-03-19 10:23:39,774 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) GetDomRVersionCmd failed
>> 2017-03-19 10:23:39,774 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand
>> failed while starting virtual router
>> 2017-03-19 10:23:41,499 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-13:ctx-5a19ecc3 ctx-04aa7c8a) (logid:e427c85a) Received
>> unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:23:44,500 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-10:ctx-86278f34 ctx-259dbd1b) (logid:da522034) Received
>> unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:23:46,033 ERROR [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Failed to start instance VM[DomainRouter|r-733-VM]
>> com.cloud.utils.exception.ExecutionException: Unable to start
>> VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart,
>> not retrying
>> 2017-03-19 10:23:46,079 DEBUG [c.c.c.CapacityManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event:
>> OperationFailedvm's original host id: null new host id: null host id before
>> state transition: 6
>> 2017-03-19 10:23:46,088 INFO [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Unable to contact resource.
>> com.cloud.exception.AgentUnavailableException: Resource [Host:6] is
>> unreachable: Host 6: Unable to start instance due to Unable to start
>> VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart,
>> not retrying
>> Caused by: com.cloud.utils.exception.ExecutionException: Unable to
>> start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in
>> finalizeStart, not retrying
>> 2017-03-19 10:23:46,187 DEBUG [c.c.c.CapacityManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event:
>> OperationFailedvm's original host id: 6 new host id: null host id before
>> state transition: 7
>> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobHandlerProxy]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Invocation exception, caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,205 INFO [c.c.v.VmWorkJobHandlerProxy]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e)
>> (logid:0e5bb9fa) Rethrow exception com.cloud.exception.InsufficientServerCapacityException:
>> Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobDispatcher]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa)
>> Unable to complete AsyncJobVO {id:7504, userId: 2, accountId: 2,
>> instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart,
>> cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oA
>> BGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50
>> UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5n
>> L0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xh
>> bmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVy
>> cQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0
>> AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29t
>> LmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNl
>> cklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAA
>> AAIAAAAAAAAAm3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA,
>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>> result: null, initMsid: 233845173047295, completeMsid: null, lastUpdated:
>> null, lastPolled: null, created: Sun Mar 19 10:22:36 EET 2017}, job
>> origin:7501
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa)
>> Complete async job-7504, jobStatus: FAILED, resultCode: 0, result:
>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZl
>> ckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vw
>> c0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRD
>> YXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5n
>> L0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xv
>> dWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vy
>> cm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2
>> YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4a
>> OxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNh
>> dXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQA
>> EkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFu
>> Zy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QA
>> EExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA1VW5hYmxlIHRvIGNyZWF0ZSBh
>> IGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS04LTE1NS1WTV11cgAeW0xqYXZh
>> LmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAb
>> amF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5l
>> TnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ACkwACGZpbGVOYW1lcQB-AApM
>> AAptZXRob2ROYW1lcQB-AAp4cAAAA710ACZjb20uY2xvdWQudm0uVmlydHVh
>> bE1hY2hpbmVNYW5hZ2VySW1wbHQAHlZpcnR1YWxNYWNoaW5lTWFuYWdlcklt
>> cGwuamF2YXQAEG9yY2hlc3RyYXRlU3RhcnRzcQB-ABEAABH9cQB-ABNxAH4A
>> FHEAfgAVc3EAfgAR_____nQAJHN1bi5yZWZsZWN0Lk5hdGl2ZU1ldGhvZEFj
>> Y2Vzc29ySW1wbHQAHU5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbC5qYXZhdAAH
>> aW52b2tlMHNxAH4AEQAAADlxAH4AGHEAfgAZdAAGaW52b2tlc3EAfgARAAAA
>> K3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0
>> ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AHHNxAH4A
>> EQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2
>> YXEAfgAcc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5k
>> bGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRs
>> ZVZtV29ya0pvYnNxAH4AEQAAEp5xAH4AE3EAfgAUcQB-ACZzcQB-ABEAAABm
>> dAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtK
>> b2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFw
>> YWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JN
>> YW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVu
>> SW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5t
>> YW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFu
>> YWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9y
>> Zy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZh
>> dWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5q
>> YXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2su
>> bWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-
>> ADZ0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADlxAH4ANnQADnJ1
>> bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFj
>> ay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAy
>> cQB-ADNzcQB-ABEAAAH2cQB-AC1xAH4ALnEAfgAzc3EAfgARAAAB13QALmph
>> dmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0
>> AA5FeGVjdXRvcnMuamF2YXEAfgA3c3EAfgARAAABBnQAH2phdmEudXRpbC5j
>> b25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AM3Nx
>> AH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhl
>> Y3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNx
>> AH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhl
>> Y3V0b3IkV29ya2VycQB-AEhxAH4AM3NxAH4AEQAAAul0ABBqYXZhLmxhbmcu
>> VGhyZWFkdAALVGhyZWFkLmphdmFxAH4AM3NyACZqYXZhLnV0aWwuQ29sbGVj
>> dGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAM
>> eHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0
>> aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hw
>> c3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAA
>> AAB3BAAAAAB4cQB-AFR4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgC
>> AAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAA
>> EO9zcQB-AFMAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPf
>> AgABSgAFdmFsdWV4cQB-AFYAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0
>> YUNlbnRlcrLxCuun53i-AgAAeHAA
>>
>
> 2017-03-19 10:23:46,231 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Unexpected
>> exception while executing org.apache.cloudstack.api.comm
>> and.admin.vm.StartVMCmdByAdmin
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity
>> Caused by: com.cloud.exception.InsufficientServerCapacityException:
>> Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2017-03-19 10:23:46,242 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Complete
>> async job-7501, jobStatus: FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"
>> uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2017-03-19 10:23:47,500 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-19:ctx-c5732f56 ctx-d7afadc9) (logid:8c0eb462) Received
>> unknown parameters for command queryAsyncJobResult. Unknown parameters :
>> projectid
>> 2017-03-19 10:26:54,733 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-21:ctx-78a8b918 ctx-9f08b269) (logid:47d4deec) Received
>> unknown parameters for command listLdapConfigurations. Unknown parameters :
>> listall
>> 2017-03-19 10:26:57,055 WARN [o.a.c.alerts]
>> (CapacityChecker:ctx-a39bc246) (logid:df7f94f9) alertType:: 25 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert:
>> Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod
>> JO-HQ-POD1 of availability zone JO-HQ
>> 2017-03-19 10:26:59,646 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-20:ctx-b1debd61 ctx-2d20decd) (logid:96719d42) Received
>> unknown parameters for command listBaremetalRct. Unknown parameters :
>> listall
>> 2017-03-19 10:27:02,350 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-5:ctx-ab69e2bb ctx-51083bf6) (logid:c83381f2) Received
>> unknown parameters for command listHypervisorCapabilities. Unknown
>> parameters : listall
>> 2017-03-19 10:31:27,009 WARN [o.a.c.alerts] (HA-2:ctx-6fdbe9c2)
>> (logid:f8aeefce) alertType:: 13 // dataCenterId:: 0 // podId:: 0 //
>> clusterId:: null // message:: No usage server process running
>> 2017-03-19 10:31:57,060 WARN [o.a.c.alerts]
>> (CapacityChecker:ctx-86ad95ac) (logid:39a26e60) alertType:: 25 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert:
>> Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod
>> JO-HQ-POD1 of availability zone JO-HQ
>> 2017-03-19 10:33:01,520 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-16:ctx-0e36b0fe ctx-3ad1edfb) (logid:07ad308f) Received
>> unknown parameters for command listZones. Unknown parameters : listall
>> 2017-03-19 10:33:01,524 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-18:ctx-76db405a ctx-dd7f9f16) (logid:6b187401) Received
>> unknown parameters for command listPods. Unknown parameters : listall
>> 2017-03-19 10:33:01,529 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-17:ctx-76472820 ctx-dc1c021d) (logid:2d68f1a9) Received
>> unknown parameters for command listClusters. Unknown parameters : listall
>> 2017-03-19 10:33:01,531 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-22:ctx-384018fa ctx-e6d52085) (logid:0aa15a63) Received
>> unknown parameters for command listStoragePools. Unknown parameters :
>> listall
>> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-2:ctx-937d0545 ctx-f180b96b) (logid:77521124) Received
>> unknown parameters for command listImageStores. Unknown parameters :
>> listall type
>> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-14:ctx-21018932 ctx-ac45366b) (logid:9b7581b4) Received
>> unknown parameters for command listHosts. Unknown parameters : listall
>> 2017-03-19 10:33:01,556 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-3:ctx-bfe083a3 ctx-09039a75) (logid:018779dc) Received
>> unknown parameters for command listSystemVms. Unknown parameters : listall
>> 2017-03-19 10:33:03,085 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-23:ctx-499cee62 ctx-ed681045) (logid:cc2f05e6) Received
>> unknown parameters for command listHosts. Unknown parameters : listall
>> 2017-03-19 10:33:04,612 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-21:ctx-79f266d8 ctx-e0cdbe3b) (logid:b0a475a0) Received
>> unknown parameters for command listZones. Unknown parameters : listall
>> 2017-03-19 10:33:04,616 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-20:ctx-87c35ca1 ctx-6e69036a) (logid:ad115fb3) Received
>> unknown parameters for command listPods. Unknown parameters : listall
>> 2017-03-19 10:33:04,620 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-5:ctx-92794f98 ctx-138184de) (logid:e76f1b75) Received
>> unknown parameters for command listClusters. Unknown parameters : listall
>> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-18:ctx-9da0f2af ctx-b0a11301) (logid:0b75334c) Received
>> unknown parameters for command listStoragePools. Unknown parameters :
>> listall
>> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-25:ctx-1a7bca82 ctx-bba0e3e7) (logid:a5645aaf) Received
>> unknown parameters for command listHosts. Unknown parameters : listall
>> 2017-03-19 10:33:04,624 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-16:ctx-11bd4054 ctx-9d1233c8) (logid:6ed8835b) Received
>> unknown parameters for command listImageStores. Unknown parameters :
>> listall type
>> 2017-03-19 10:33:04,647 WARN [c.c.a.d.ParamGenericValidationWorker]
>> (catalina-exec-2:ctx-ea24db96 ctx-19027bd0) (logid:5eb98b9b) Received
>> unknown parameters for command listSystemVms. Unknown parameters : listall
>>
>> Best Regards,
>> EtQ, Inc.
>> Ghaith Bannoura
>> Senior System Administrator
>> MCT, MCSE (Messaging, Server Infrastructure)
>> MCSA (Windows Server 2008, 2012), MCP
>>
>> Phone: +9626-537-0923 Ext. 376
>> P Gbannoura@etq.com
>> G http://www.etq.com
>>
>> -----Original Message-----
>> From: Simon Weller [mailto:sweller@ena.com]
>> Sent: Sunday, March 19, 2017 2:28 AM
>> To: users@cloudstack.apache.org
>> Subject: Re: Host Disconnected after upgrade to ACS 4.9.2
>>
>> Ghaith,
>>
>>
>> Do you have a load balancer between your management servers and hosts by
>> any chance?
>>
>>
>> - Si
>>
>>
>>
>>
>> ________________________________
>> From: Ghaith Bannoura <gb...@etq.com>
>> Sent: Saturday, March 18, 2017 8:27 AM
>> To: users@cloudstack.apache.org
>> Subject: Host Disconnected after upgrade to ACS 4.9.2
>>
>> Hello All,
>>
>> I Have a ACS version 4.8 with xenserver 6.5 and after upgrade ACS to
>> 4.9.2.0 All hosts appear in disconnect state I checked the logs and I found
>> the below error for all hosts
>>
>> WARN [c.c.a.m.ClusteredAgentManagerImpl] (ClusteredAgentManager
>> Timer:ctx-00f87152) (logid:e54c2b87) can not load directly connected host
>> due to
>> com.cloud.utils.exception.CloudRuntimeException: Unable to create master
>> connection to host, due to The credentials given by the user are incorrect,
>> so access has been denied, and you have not been issued a session handle.
>>
>>
>> Can you please advise how can I resolve this issue .
>>
>> Best Regards,
>> EtQ, Inc.
>> Ghaith Bannoura
>> Senior System Administrator
>> MCT, MCSE (Messaging, Server Infrastructure) MCSA (Windows Server 2008,
>> 2012), MCP
>>
>> * Phone: +9626-537-0923 Ext. 376
>> * Gbannoura@etq.com <ma...@etq.com>
>> * http://www.etq.com<http://www.etq.com/>
>>
>>
>
>
--
Thanks & Regards
Prakash Sharma
Re: Host Disconnected after upgrade to ACS 4.9.2
Posted by Gabriel Beims Bräscher <ga...@autonomiccs.com.br>.
Hi Ghaith,
I had a similar problem due to Dom0 out of disk space.
XenServer 6.5 Dom0 has a limited disk space (4.0 GB). You can check if
the Dom0 is out of disk space with "df -h".
If that is the case, just have to clean some old log files.
Cheers,
Gabriel.
Em 19/03/2017 05:38, Ghaith Bannoura escreveu:
> Hello Simon,
>
> I don't have any load balancer , but after update the host password using updatehostpassword api , the hosts is up and running but unfortunately there is no any vm, system vm or virtual router can be started (when try to start any vm the virtual router created and after finish booting its destroyed automatically) , below sample from the log the log
>
>
> 2017-03-19 10:23:39,761 DEBUG [c.c.a.t.Request] (DirectAgent-185:ctx-2689b47b) (logid:0e5bb9fa) Seq 6-5388275479172087905: Processing: { Ans: , MgmtId: 233845173047295, via: 6(JOHQHOST02), Ver: v1, Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":733,"name":"r-733-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0 (64-bit)","bootArgs":" template=domP name=r-733-VM eth0ip=192.168.104.157 eth0mask=255.255.252.0 gateway=192.168.104.1 domain=cs1cloud.internal cidrsize=22 dhcprange=192.168.104.1 eth1ip=169.254.1.74 eth1mask=255.255.0.0 type=dhcpsrvr disable_rp_filter=true dns1=192.168.30.2 dns2= ip6dns1= ip6dns2= baremetalnotificationsecuritykey=IwUZ+UPiYew8AFsVM8fo8CZ7IIMFWftmmcmzBqQPPBCq8sWHrcrvTpz4qOiWTNzScqDNpAlQBs3BwFKNKoE1LFBgiSkGt1rFEKq6z88zyydXsz6+YwwAL1inwxVMdgkG baremetalnotificationapikey=I94EoET6AnrIuy3mo6Fv2zEhSBrPIuWdNxt2jnTTxTkX33c9z4ByGo7Tz8KJTcc7es6oB38zjZr8LonxU8fKzQ host=192.168.104.2 port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"qfXB2RD5Y4gLWbaFVlEi8A","params":{},"uuid":"3bd402ee-564e-46bf-a6b5-edb08094c0ec","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"009c6bf0-fb71-43c8-ad99-092aafe1984e","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7864d43b-b0a4-d479-3119-710fd9f0d4fd","id":2,"poolType":"LVM","host":"192.168.104.11","path":"lvm","port":0,"url":"LVM://192.168.104.11/lvm/?ROLE=Primary&STOREUUID=7864d43b-b0a4-d479-3119-710fd9f0d4fd"}},"name":"ROOT-733","size":3145728000,"path":"0d7285d3-3f48-4541-86b6-38020d9d59bd","volumeId":734,"vmName":"r-733-VM","accountId":1,"format":"VHD","provisioningType":"THIN","id":734,"deviceId":0,"bytesReadRate":0,"bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"0d7285d3-3f48-4541-86b6-38020d9d59bd","type":"ROOT","_details":{"managed":"false","storagePort":"0","storageHost":"192.168.104.11","volumeSize":"3145728000"}}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"c8f551f0-73c3-429b-8404-f4ca40dc98be","uuid":"53dd9246-ceb5-4484-b8f8-6f214466c67d","ip":"192.168.104.157","netmask":"255.255.252.0","gateway":"192.168.104.1","mac":"06:c8:dc:00:00:6c","dns1":"192.168.30.2","dns2":"","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://untagged","isSecurityGroupEnabled":true},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"0344754e-292a-407a-8d8d-578303e418b9","uuid":"1196bf19-1bae-4beb-a511-68cc310fd1db","ip":"169.254.1.74","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:4a","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"result":false,"details":"GetDomRVersionCmd failed","wait":0}}] }
> 2017-03-19 10:23:39,768 WARN [o.a.c.alerts] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) alertType:: 9 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Command: com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
> 2017-03-19 10:23:39,774 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) GetDomRVersionCmd failed
> 2017-03-19 10:23:39,774 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
> 2017-03-19 10:23:41,499 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-13:ctx-5a19ecc3 ctx-04aa7c8a) (logid:e427c85a) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
> 2017-03-19 10:23:44,500 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-10:ctx-86278f34 ctx-259dbd1b) (logid:da522034) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
> 2017-03-19 10:23:46,033 ERROR [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Failed to start instance VM[DomainRouter|r-733-VM]
> com.cloud.utils.exception.ExecutionException: Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
> 2017-03-19 10:23:46,079 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 6
> 2017-03-19 10:23:46,088 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Unable to contact resource.
> com.cloud.exception.AgentUnavailableException: Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
> Caused by: com.cloud.utils.exception.ExecutionException: Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
> 2017-03-19 10:23:46,187 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: 6 new host id: null host id before state transition: 7
> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
> 2017-03-19 10:23:46,205 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
> 2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa) Unable to complete AsyncJobVO {id:7504, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAm3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 233845173047295, completeMsid: null, lastUpdated: null, lastPolled: null, created: Sun Mar 19 10:22:36 EET 2017}, job origin:7501
> com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
> 2017-03-19 10:23:46,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa) Complete async job-7504, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA1VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS04LTE1NS1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ACkwACGZpbGVOYW1lcQB-AApMAAptZXRob2ROYW1lcQB-AAp4cAAAA710ACZjb20uY2xvdWQudm0uVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbHQAHlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwuamF2YXQAEG9yY2hlc3RyYXRlU3RhcnRzcQB-ABEAABH9cQB-ABNxAH4AFHEAfgAVc3EAfgAR_____nQAJHN1bi5yZWZsZWN0Lk5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbHQAHU5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbC5qYXZhdAAHaW52b2tlMHNxAH4AEQAAADlxAH4AGHEAfgAZdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AHHNxAH4AEQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAcc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEp5xAH4AE3EAfgAUcQB-ACZzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADZ0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADlxAH4ANnQADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAycQB-ADNzcQB-ABEAAAH2cQB-AC1xAH4ALnEAfgAzc3EAfgARAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA3c3EAfgARAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AM3NxAH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEhxAH4AM3NxAH4AEQAAAul0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AM3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFR4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFMAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFYAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
> 2017-03-19 10:23:46,231 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
> 2017-03-19 10:23:46,242 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Complete async job-7501, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2017-03-19 10:23:47,500 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-19:ctx-c5732f56 ctx-d7afadc9) (logid:8c0eb462) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
> 2017-03-19 10:26:54,733 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-21:ctx-78a8b918 ctx-9f08b269) (logid:47d4deec) Received unknown parameters for command listLdapConfigurations. Unknown parameters : listall
> 2017-03-19 10:26:57,055 WARN [o.a.c.alerts] (CapacityChecker:ctx-a39bc246) (logid:df7f94f9) alertType:: 25 // dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert: Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod JO-HQ-POD1 of availability zone JO-HQ
> 2017-03-19 10:26:59,646 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-20:ctx-b1debd61 ctx-2d20decd) (logid:96719d42) Received unknown parameters for command listBaremetalRct. Unknown parameters : listall
> 2017-03-19 10:27:02,350 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-5:ctx-ab69e2bb ctx-51083bf6) (logid:c83381f2) Received unknown parameters for command listHypervisorCapabilities. Unknown parameters : listall
> 2017-03-19 10:31:27,009 WARN [o.a.c.alerts] (HA-2:ctx-6fdbe9c2) (logid:f8aeefce) alertType:: 13 // dataCenterId:: 0 // podId:: 0 // clusterId:: null // message:: No usage server process running
> 2017-03-19 10:31:57,060 WARN [o.a.c.alerts] (CapacityChecker:ctx-86ad95ac) (logid:39a26e60) alertType:: 25 // dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert: Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod JO-HQ-POD1 of availability zone JO-HQ
> 2017-03-19 10:33:01,520 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-16:ctx-0e36b0fe ctx-3ad1edfb) (logid:07ad308f) Received unknown parameters for command listZones. Unknown parameters : listall
> 2017-03-19 10:33:01,524 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-18:ctx-76db405a ctx-dd7f9f16) (logid:6b187401) Received unknown parameters for command listPods. Unknown parameters : listall
> 2017-03-19 10:33:01,529 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-17:ctx-76472820 ctx-dc1c021d) (logid:2d68f1a9) Received unknown parameters for command listClusters. Unknown parameters : listall
> 2017-03-19 10:33:01,531 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-22:ctx-384018fa ctx-e6d52085) (logid:0aa15a63) Received unknown parameters for command listStoragePools. Unknown parameters : listall
> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-2:ctx-937d0545 ctx-f180b96b) (logid:77521124) Received unknown parameters for command listImageStores. Unknown parameters : listall type
> 2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-14:ctx-21018932 ctx-ac45366b) (logid:9b7581b4) Received unknown parameters for command listHosts. Unknown parameters : listall
> 2017-03-19 10:33:01,556 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-3:ctx-bfe083a3 ctx-09039a75) (logid:018779dc) Received unknown parameters for command listSystemVms. Unknown parameters : listall
> 2017-03-19 10:33:03,085 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-23:ctx-499cee62 ctx-ed681045) (logid:cc2f05e6) Received unknown parameters for command listHosts. Unknown parameters : listall
> 2017-03-19 10:33:04,612 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-21:ctx-79f266d8 ctx-e0cdbe3b) (logid:b0a475a0) Received unknown parameters for command listZones. Unknown parameters : listall
> 2017-03-19 10:33:04,616 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-20:ctx-87c35ca1 ctx-6e69036a) (logid:ad115fb3) Received unknown parameters for command listPods. Unknown parameters : listall
> 2017-03-19 10:33:04,620 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-5:ctx-92794f98 ctx-138184de) (logid:e76f1b75) Received unknown parameters for command listClusters. Unknown parameters : listall
> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-18:ctx-9da0f2af ctx-b0a11301) (logid:0b75334c) Received unknown parameters for command listStoragePools. Unknown parameters : listall
> 2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-25:ctx-1a7bca82 ctx-bba0e3e7) (logid:a5645aaf) Received unknown parameters for command listHosts. Unknown parameters : listall
> 2017-03-19 10:33:04,624 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-16:ctx-11bd4054 ctx-9d1233c8) (logid:6ed8835b) Received unknown parameters for command listImageStores. Unknown parameters : listall type
> 2017-03-19 10:33:04,647 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-2:ctx-ea24db96 ctx-19027bd0) (logid:5eb98b9b) Received unknown parameters for command listSystemVms. Unknown parameters : listall
>
> Best Regards,
> EtQ, Inc.
> Ghaith Bannoura
> Senior System Administrator
> MCT, MCSE (Messaging, Server Infrastructure)
> MCSA (Windows Server 2008, 2012), MCP
>
> Phone: +9626-537-0923 Ext. 376
> P Gbannoura@etq.com
> G http://www.etq.com
>
> -----Original Message-----
> From: Simon Weller [mailto:sweller@ena.com]
> Sent: Sunday, March 19, 2017 2:28 AM
> To: users@cloudstack.apache.org
> Subject: Re: Host Disconnected after upgrade to ACS 4.9.2
>
> Ghaith,
>
>
> Do you have a load balancer between your management servers and hosts by any chance?
>
>
> - Si
>
>
>
>
> ________________________________
> From: Ghaith Bannoura <gb...@etq.com>
> Sent: Saturday, March 18, 2017 8:27 AM
> To: users@cloudstack.apache.org
> Subject: Host Disconnected after upgrade to ACS 4.9.2
>
> Hello All,
>
> I Have a ACS version 4.8 with xenserver 6.5 and after upgrade ACS to 4.9.2.0 All hosts appear in disconnect state I checked the logs and I found the below error for all hosts
>
> WARN [c.c.a.m.ClusteredAgentManagerImpl] (ClusteredAgentManager Timer:ctx-00f87152) (logid:e54c2b87) can not load directly connected host due to
> com.cloud.utils.exception.CloudRuntimeException: Unable to create master connection to host, due to The credentials given by the user are incorrect, so access has been denied, and you have not been issued a session handle.
>
>
> Can you please advise how can I resolve this issue .
>
> Best Regards,
> EtQ, Inc.
> Ghaith Bannoura
> Senior System Administrator
> MCT, MCSE (Messaging, Server Infrastructure) MCSA (Windows Server 2008, 2012), MCP
>
> * Phone: +9626-537-0923 Ext. 376
> * Gbannoura@etq.com <ma...@etq.com>
> * http://www.etq.com<http://www.etq.com/>
>
RE: Host Disconnected after upgrade to ACS 4.9.2
Posted by Ghaith Bannoura <gb...@etq.com>.
Hello Simon,
I don't have any load balancer , but after update the host password using updatehostpassword api , the hosts is up and running but unfortunately there is no any vm, system vm or virtual router can be started (when try to start any vm the virtual router created and after finish booting its destroyed automatically) , below sample from the log the log
2017-03-19 10:23:39,761 DEBUG [c.c.a.t.Request] (DirectAgent-185:ctx-2689b47b) (logid:0e5bb9fa) Seq 6-5388275479172087905: Processing: { Ans: , MgmtId: 233845173047295, via: 6(JOHQHOST02), Ver: v1, Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":733,"name":"r-733-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0 (64-bit)","bootArgs":" template=domP name=r-733-VM eth0ip=192.168.104.157 eth0mask=255.255.252.0 gateway=192.168.104.1 domain=cs1cloud.internal cidrsize=22 dhcprange=192.168.104.1 eth1ip=169.254.1.74 eth1mask=255.255.0.0 type=dhcpsrvr disable_rp_filter=true dns1=192.168.30.2 dns2= ip6dns1= ip6dns2= baremetalnotificationsecuritykey=IwUZ+UPiYew8AFsVM8fo8CZ7IIMFWftmmcmzBqQPPBCq8sWHrcrvTpz4qOiWTNzScqDNpAlQBs3BwFKNKoE1LFBgiSkGt1rFEKq6z88zyydXsz6+YwwAL1inwxVMdgkG baremetalnotificationapikey=I94EoET6AnrIuy3mo6Fv2zEhSBrPIuWdNxt2jnTTxTkX33c9z4ByGo7Tz8KJTcc7es6oB38zjZr8LonxU8fKzQ host=192.168.104.2 port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"qfXB2RD5Y4gLWbaFVlEi8A","params":{},"uuid":"3bd402ee-564e-46bf-a6b5-edb08094c0ec","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"009c6bf0-fb71-43c8-ad99-092aafe1984e","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"7864d43b-b0a4-d479-3119-710fd9f0d4fd","id":2,"poolType":"LVM","host":"192.168.104.11","path":"lvm","port":0,"url":"LVM://192.168.104.11/lvm/?ROLE=Primary&STOREUUID=7864d43b-b0a4-d479-3119-710fd9f0d4fd"}},"name":"ROOT-733","size":3145728000,"path":"0d7285d3-3f48-4541-86b6-38020d9d59bd","volumeId":734,"vmName":"r-733-VM","accountId":1,"format":"VHD","provisioningType":"THIN","id":734,"deviceId":0,"bytesReadRate":0,"bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"0d7285d3-3f48-4541-86b6-38020d9d59bd","type":"ROOT","_details":{"managed":"false","storagePort":"0","storageHost":"192.168.104.11","volumeSize":"3145728000"}}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"c8f551f0-73c3-429b-8404-f4ca40dc98be","uuid":"53dd9246-ceb5-4484-b8f8-6f214466c67d","ip":"192.168.104.157","netmask":"255.255.252.0","gateway":"192.168.104.1","mac":"06:c8:dc:00:00:6c","dns1":"192.168.30.2","dns2":"","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://untagged","isSecurityGroupEnabled":true},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"0344754e-292a-407a-8d8d-578303e418b9","uuid":"1196bf19-1bae-4beb-a511-68cc310fd1db","ip":"169.254.1.74","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:4a","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"result":false,"details":"GetDomRVersionCmd failed","wait":0}}] }
2017-03-19 10:23:39,768 WARN [o.a.c.alerts] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) alertType:: 9 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Command: com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
2017-03-19 10:23:39,774 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) GetDomRVersionCmd failed
2017-03-19 10:23:39,774 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Command: com.cloud.agent.api.GetDomRVersionCommand failed while starting virtual router
2017-03-19 10:23:41,499 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-13:ctx-5a19ecc3 ctx-04aa7c8a) (logid:e427c85a) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
2017-03-19 10:23:44,500 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-10:ctx-86278f34 ctx-259dbd1b) (logid:da522034) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
2017-03-19 10:23:46,033 ERROR [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Failed to start instance VM[DomainRouter|r-733-VM]
com.cloud.utils.exception.ExecutionException: Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
2017-03-19 10:23:46,079 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 6
2017-03-19 10:23:46,088 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Unable to contact resource.
com.cloud.exception.AgentUnavailableException: Resource [Host:6] is unreachable: Host 6: Unable to start instance due to Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
Caused by: com.cloud.utils.exception.ExecutionException: Unable to start VM:3bd402ee-564e-46bf-a6b5-edb08094c0ec due to error in finalizeStart, not retrying
2017-03-19 10:23:46,187 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: 6 new host id: null host id before state transition: 7
2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2017-03-19 10:23:46,205 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504 ctx-152e4b4e) (logid:0e5bb9fa) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2017-03-19 10:23:46,205 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa) Unable to complete AsyncJobVO {id:7504, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAAm3QAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 233845173047295, completeMsid: null, lastUpdated: null, lastPolled: null, created: Sun Mar 19 10:22:36 EET 2017}, job origin:7501
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2017-03-19 10:23:46,208 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-4:ctx-00f8fec4 job-7501/job-7504) (logid:0e5bb9fa) Complete async job-7504, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA1VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS04LTE1NS1WTV11cgAeW0xqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnQ7AkYqPDz9IjkCAAB4cAAAABVzcgAbamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50YQnFmiY23YUCAARJAApsaW5lTnVtYmVyTAAOZGVjbGFyaW5nQ2xhc3NxAH4ACkwACGZpbGVOYW1lcQB-AApMAAptZXRob2ROYW1lcQB-AAp4cAAAA710ACZjb20uY2xvdWQudm0uVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbHQAHlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwuamF2YXQAEG9yY2hlc3RyYXRlU3RhcnRzcQB-ABEAABH9cQB-ABNxAH4AFHEAfgAVc3EAfgAR_____nQAJHN1bi5yZWZsZWN0Lk5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbHQAHU5hdGl2ZU1ldGhvZEFjY2Vzc29ySW1wbC5qYXZhdAAHaW52b2tlMHNxAH4AEQAAADlxAH4AGHEAfgAZdAAGaW52b2tlc3EAfgARAAAAK3QAKHN1bi5yZWZsZWN0LkRlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGx0ACFEZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsLmphdmFxAH4AHHNxAH4AEQAAAl50ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAcc3EAfgARAAAAa3QAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnNxAH4AEQAAEp5xAH4AE3EAfgAUcQB-ACZzcQB-ABEAAABmdAAgY29tLmNsb3VkLnZtLlZtV29ya0pvYkRpc3BhdGNoZXJ0ABhWbVdvcmtKb2JEaXNwYXRjaGVyLmphdmF0AAZydW5Kb2JzcQB-ABEAAAIqdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0c3EAfgARAAAAMXQAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVuc3EAfgARAAAAOHQAQm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuaW1wbC5EZWZhdWx0TWFuYWdlZENvbnRleHQkMXQAGkRlZmF1bHRNYW5hZ2VkQ29udGV4dC5qYXZhdAAEY2FsbHNxAH4AEQAAAGd0AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADZ0AA9jYWxsV2l0aENvbnRleHRzcQB-ABEAAAA1cQB-ADlxAH4ANnQADnJ1bldpdGhDb250ZXh0c3EAfgARAAAALnQAPG9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZXEAfgAycQB-ADNzcQB-ABEAAAH2cQB-AC1xAH4ALnEAfgAzc3EAfgARAAAB13QALmphdmEudXRpbC5jb25jdXJyZW50LkV4ZWN1dG9ycyRSdW5uYWJsZUFkYXB0ZXJ0AA5FeGVjdXRvcnMuamF2YXEAfgA3c3EAfgARAAABBnQAH2phdmEudXRpbC5jb25jdXJyZW50LkZ1dHVyZVRhc2t0AA9GdXR1cmVUYXNrLmphdmFxAH4AM3NxAH4AEQAABHl0ACdqYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3J0ABdUaHJlYWRQb29sRXhlY3V0b3IuamF2YXQACXJ1bldvcmtlcnNxAH4AEQAAAmd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5UaHJlYWRQb29sRXhlY3V0b3IkV29ya2VycQB-AEhxAH4AM3NxAH4AEQAAAul0ABBqYXZhLmxhbmcuVGhyZWFkdAALVGhyZWFkLmphdmFxAH4AM3NyACZqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlTGlzdPwPJTG17I4QAgABTAAEbGlzdHEAfgAMeHIALGphdmEudXRpbC5Db2xsZWN0aW9ucyRVbm1vZGlmaWFibGVDb2xsZWN0aW9uGUIAgMte9x4CAAFMAAFjdAAWTGphdmEvdXRpbC9Db2xsZWN0aW9uO3hwc3IAE2phdmEudXRpbC5BcnJheUxpc3R4gdIdmcdhnQMAAUkABHNpemV4cAAAAAB3BAAAAAB4cQB-AFR4c3IAEWphdmEubGFuZy5JbnRlZ2VyEuKgpPeBhzgCAAFJAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAEO9zcQB-AFMAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFYAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlcrLxCuun53i-AgAAeHAA
2017-03-19 10:23:46,231 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-8-155-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2017-03-19 10:23:46,242 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:ctx-49dc3c63 job-7501) (logid:0e5bb9fa) Complete async job-7501, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
2017-03-19 10:23:47,500 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-19:ctx-c5732f56 ctx-d7afadc9) (logid:8c0eb462) Received unknown parameters for command queryAsyncJobResult. Unknown parameters : projectid
2017-03-19 10:26:54,733 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-21:ctx-78a8b918 ctx-9f08b269) (logid:47d4deec) Received unknown parameters for command listLdapConfigurations. Unknown parameters : listall
2017-03-19 10:26:57,055 WARN [o.a.c.alerts] (CapacityChecker:ctx-a39bc246) (logid:df7f94f9) alertType:: 25 // dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert: Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod JO-HQ-POD1 of availability zone JO-HQ
2017-03-19 10:26:59,646 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-20:ctx-b1debd61 ctx-2d20decd) (logid:96719d42) Received unknown parameters for command listBaremetalRct. Unknown parameters : listall
2017-03-19 10:27:02,350 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-5:ctx-ab69e2bb ctx-51083bf6) (logid:c83381f2) Received unknown parameters for command listHypervisorCapabilities. Unknown parameters : listall
2017-03-19 10:31:27,009 WARN [o.a.c.alerts] (HA-2:ctx-6fdbe9c2) (logid:f8aeefce) alertType:: 13 // dataCenterId:: 0 // podId:: 0 // clusterId:: null // message:: No usage server process running
2017-03-19 10:31:57,060 WARN [o.a.c.alerts] (CapacityChecker:ctx-86ad95ac) (logid:39a26e60) alertType:: 25 // dataCenterId:: 1 // podId:: 1 // clusterId:: 1 // message:: System Alert: Remaining unallocated Local Storage is low in cluster JO-HQ-Cluster1 pod JO-HQ-POD1 of availability zone JO-HQ
2017-03-19 10:33:01,520 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-16:ctx-0e36b0fe ctx-3ad1edfb) (logid:07ad308f) Received unknown parameters for command listZones. Unknown parameters : listall
2017-03-19 10:33:01,524 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-18:ctx-76db405a ctx-dd7f9f16) (logid:6b187401) Received unknown parameters for command listPods. Unknown parameters : listall
2017-03-19 10:33:01,529 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-17:ctx-76472820 ctx-dc1c021d) (logid:2d68f1a9) Received unknown parameters for command listClusters. Unknown parameters : listall
2017-03-19 10:33:01,531 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-22:ctx-384018fa ctx-e6d52085) (logid:0aa15a63) Received unknown parameters for command listStoragePools. Unknown parameters : listall
2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-2:ctx-937d0545 ctx-f180b96b) (logid:77521124) Received unknown parameters for command listImageStores. Unknown parameters : listall type
2017-03-19 10:33:01,535 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-14:ctx-21018932 ctx-ac45366b) (logid:9b7581b4) Received unknown parameters for command listHosts. Unknown parameters : listall
2017-03-19 10:33:01,556 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-3:ctx-bfe083a3 ctx-09039a75) (logid:018779dc) Received unknown parameters for command listSystemVms. Unknown parameters : listall
2017-03-19 10:33:03,085 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-23:ctx-499cee62 ctx-ed681045) (logid:cc2f05e6) Received unknown parameters for command listHosts. Unknown parameters : listall
2017-03-19 10:33:04,612 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-21:ctx-79f266d8 ctx-e0cdbe3b) (logid:b0a475a0) Received unknown parameters for command listZones. Unknown parameters : listall
2017-03-19 10:33:04,616 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-20:ctx-87c35ca1 ctx-6e69036a) (logid:ad115fb3) Received unknown parameters for command listPods. Unknown parameters : listall
2017-03-19 10:33:04,620 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-5:ctx-92794f98 ctx-138184de) (logid:e76f1b75) Received unknown parameters for command listClusters. Unknown parameters : listall
2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-18:ctx-9da0f2af ctx-b0a11301) (logid:0b75334c) Received unknown parameters for command listStoragePools. Unknown parameters : listall
2017-03-19 10:33:04,623 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-25:ctx-1a7bca82 ctx-bba0e3e7) (logid:a5645aaf) Received unknown parameters for command listHosts. Unknown parameters : listall
2017-03-19 10:33:04,624 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-16:ctx-11bd4054 ctx-9d1233c8) (logid:6ed8835b) Received unknown parameters for command listImageStores. Unknown parameters : listall type
2017-03-19 10:33:04,647 WARN [c.c.a.d.ParamGenericValidationWorker] (catalina-exec-2:ctx-ea24db96 ctx-19027bd0) (logid:5eb98b9b) Received unknown parameters for command listSystemVms. Unknown parameters : listall
Best Regards,
EtQ, Inc.
Ghaith Bannoura
Senior System Administrator
MCT, MCSE (Messaging, Server Infrastructure)
MCSA (Windows Server 2008, 2012), MCP
Phone: +9626-537-0923 Ext. 376
P Gbannoura@etq.com
G http://www.etq.com
-----Original Message-----
From: Simon Weller [mailto:sweller@ena.com]
Sent: Sunday, March 19, 2017 2:28 AM
To: users@cloudstack.apache.org
Subject: Re: Host Disconnected after upgrade to ACS 4.9.2
Ghaith,
Do you have a load balancer between your management servers and hosts by any chance?
- Si
________________________________
From: Ghaith Bannoura <gb...@etq.com>
Sent: Saturday, March 18, 2017 8:27 AM
To: users@cloudstack.apache.org
Subject: Host Disconnected after upgrade to ACS 4.9.2
Hello All,
I Have a ACS version 4.8 with xenserver 6.5 and after upgrade ACS to 4.9.2.0 All hosts appear in disconnect state I checked the logs and I found the below error for all hosts
WARN [c.c.a.m.ClusteredAgentManagerImpl] (ClusteredAgentManager Timer:ctx-00f87152) (logid:e54c2b87) can not load directly connected host due to
com.cloud.utils.exception.CloudRuntimeException: Unable to create master connection to host, due to The credentials given by the user are incorrect, so access has been denied, and you have not been issued a session handle.
Can you please advise how can I resolve this issue .
Best Regards,
EtQ, Inc.
Ghaith Bannoura
Senior System Administrator
MCT, MCSE (Messaging, Server Infrastructure) MCSA (Windows Server 2008, 2012), MCP
* Phone: +9626-537-0923 Ext. 376
* Gbannoura@etq.com <ma...@etq.com>
* http://www.etq.com<http://www.etq.com/>