You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Mario Giammarco <mg...@gmail.com> on 2016/04/15 12:08:58 UTC
Guid is not updated for cluster with specified cluster id
Hello,
I had to delete and insert again two servers in a zone.
Now I was able to insert again the server artkvm2 with ip 10.4.1.3 but when
I try to add again artkvm1 with ip 10.4.1.2 I only get:
Guid is not updated for cluster with specified cluster id; need to wait for
hosts in this cluster to come up
I have seen other post in the past about this error but they are not
helpful for me.
Here is the log:
2016-04-15 12:05:11,671 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-3:null) (logid:) SeqA 22-1109: Processing Seq 22-1109: { Cmd ,
MgmtId: -1, via: 22, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":
{"_proxyVmId":3773,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2016-04-15 12:05:11,679 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-3:null) (logid:) SeqA 22-1109: Sending Seq 22-1109: { Ans: ,
MgmtId: 345041274374, via: 22, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-04-15 12:05:15,955 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-
47e15670) (logid:4d7b1671) ===START=== 10.1.0.38 -- POST
command=addHost&response=json
2016-04-15 12:05:15,966 WARN [c.c.a.d.ParamGenericValidationWorker]
(catalina-exec-7:ctx-47e15670 ctx-e6b00129) (logid:4d7b1671) Received
unknown parameters for command addHost. Unknown parameters : clustertype
2016-04-15 12:05:15,970 ERROR [c.c.a.ApiServer] (catalina-exec-7:ctx-
47e15670 ctx-e6b00129) (logid:4d7b1671) unhandled exception executing api
command: [Ljava.lang.String;@59a74e3e
com.cloud.utils.exception.CloudRuntimeException: Guid is not updated for
cluster with specified cluster id; need to wait for hosts in this cluster
to come up
at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.ja
va:588)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:5
7)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImp
l.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(Aop
Utils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoin
t(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflec
tiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Expo
seInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflec
tiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopPr
oxy.java:204)
at com.sun.proxy.$Proxy157.discoverHosts(Unknown Source)
at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.
java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
at
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Def
aultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithCo
ntext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCon
text(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:91)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicatio
nFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterC
hain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.j
ava:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.j
ava:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:12
7)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:10
3)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.jav
a:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java
:891)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(
Http11NioProtocol.java:750)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java
:2283)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
615)
at java.lang.Thread.run(Thread.java:745)
2016-04-15 12:05:15,975 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-
47e15670 ctx-e6b00129) (logid:4d7b1671) ===END=== 10.1.0.38 -- POST
command=addHost&response=json
2016-04-15 12:05:16,342 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-7:null) (logid:) SeqA 10-43274: Processing Seq 10-43274: { Cmd ,
MgmtId: -1, via: 10, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":
{"_proxyVmId":16,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2016-04-15 12:05:16,349 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-7:null) (logid:) SeqA 10-43274: Sending Seq 10-43274: { Ans: ,
MgmtId: 345041274374, via: 10, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-04-15 12:05:17,783 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Timer-8:ctx-
82aaf562) (logid:2d8237d1) getCommandHostDelegation: class
org.apache.cloudstack.storage.command.DownloadProgressCommand
2016-04-15 12:05:17,783 DEBUG [c.c.h.XenServerGuru] (Timer-8:ctx-82aaf562)
(logid:2d8237d1) getCommandHostDelegation: class
org.apache.cloudstack.storage.command.DownloadProgressCommand
2016-04-15 12:05:17,783 DEBUG [o.a.c.s.RemoteHostEndPoint] (Timer-8:ctx-
82aaf562) (logid:2d8237d1) Sending command
org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 20
2016-04-15 12:05:17,785 DEBUG [c.c.a.t.Request] (Timer-8:ctx-82aaf562)
(logid:2d8237d1) Seq 20-2502875492911153339: Sending { Cmd , MgmtId:
345041274374, via: 20(s-3772-VM), Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DownloadProgressCommand":
{"jobId":"cc910aa9-2dd1-4d23-9dcb-
9006ec66f549","request":"GET_STATUS","hvm":true,"description":"Windows2012R
2","checksum":"4cabe641a4fffc7fe2c64d4d5de52222","maxDownloadSizeInBytes":5
3687091200,"id":223,"resourceType":"TEMPLATE","installPath":"template/tmpl/
2/223","_store":{"com.cloud.agent.api.to.NfsTO":
{"_url":"nfs://10.4.4.12/data/secondary","_role":"Image"}},"url":"http://10
9.168.24.130/windows.iso","format":"ISO","accountId":2,"name":"223-2-
fd3a72cd-3994-310e-b094-
d2b64d2cc5d9","secUrl":"nfs://10.4.4.12/data/secondary","wait":0}}] }
2016-04-15 12:05:17,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-
6:null) (logid:) Seq 20-2502875492911153339: Processing: { Ans: , MgmtId:
345041274374, via: 20, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"cc910aa9-2dd1-
4d23-9dcb-9006ec66f549","downloadPct":0,"errorString":"
","downloadStatus":"NOT_DOWNLOADED","downloadPath":"/mnt/SecStorage/8b7211e
f-78a7-3bc0-8e9d-
6452c129f9c6/template/tmpl/2/223/dnld6800296659240767495tmp_","installPath"
:"template/tmpl/2/223","templateSize":0,"templatePhySicalSize":0,"checkSum"
:"4cabe641a4fffc7fe2c64d4d5de52222","result":true,"details":" ","wait":0}}]
}
2016-04-15 12:05:18,736 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-cfca74ed) (logid:83f1c3f1) Begin cleanup
expired async-jobs
2016-04-15 12:05:18,742 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-cfca74ed) (logid:83f1c3f1) End cleanup expired
async-jobs
2016-04-15 12:05:20,383 DEBUG [c.c.a.ApiServlet] (catalina-exec-11:ctx-
f74e42db) (logid:4292a110) ===START=== 10.1.0.38 -- GET
command=listZones&response=json&id=aa6ade1c-d5d7-460e-9971-
a62dbf5c062a&_=1460714720398
2016-04-15 12:05:20,397 DEBUG [c.c.a.ApiServlet] (catalina-exec-11:ctx-
f74e42db ctx-b8d2f3f7) (logid:4292a110) ===END=== 10.1.0.38 -- GET
command=listZones&response=json&id=aa6ade1c-d5d7-460e-9971-
a62dbf5c062a&_=1460714720398
2016-04-15 12:05:20,852 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-
c4980172) (logid:e3092d03) ===START=== 10.1.0.38 -- GET
command=listHosts&id=aeaf004d-2aac-488e-9e0d-
4ccad1738047&response=json&_=1460714720736
RE: Guid is not updated for cluster with specified cluster id
Posted by Kirk Kosinski <ki...@shapeblue.com>.
Hi, Mario. What version of CloudStack is this? Also, can you be more specific about what was done? Did you reinstall the agent on the hosts, or change any of the agent configuration (e.g. agent.properties)?
When you re-added artkvm2, did you add it to a new or existing cluster? If it already existed, were there any other hosts in the cluster besides artkvm2?
Did you try any troubleshooting steps from the posts you found (if so, what did you try)?
Lastly, please provide the entries for the affected cluster in the cluster and cluster_details tables. Thanks!
Regards,
KirkĀ Kosinski
kirk.kosinski@shapeblue.comĀ
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HS
@shapeblue
-----Original Message-----
From: Mario Giammarco [mailto:mgiammarco@gmail.com]
Sent: Friday, April 15, 2016 3:09 AM
To: users@cloudstack.apache.org
Subject: Guid is not updated for cluster with specified cluster id
Hello,
I had to delete and insert again two servers in a zone.
Now I was able to insert again the server artkvm2 with ip 10.4.1.3 but when I try to add again artkvm1 with ip 10.4.1.2 I only get:
Guid is not updated for cluster with specified cluster id; need to wait for hosts in this cluster to come up
I have seen other post in the past about this error but they are not helpful for me.
Here is the log:
2016-04-15 12:05:11,671 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-3:null) (logid:) SeqA 22-1109: Processing Seq 22-1109: { Cmd ,
MgmtId: -1, via: 22, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":
{"_proxyVmId":3773,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2016-04-15 12:05:11,679 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-3:null) (logid:) SeqA 22-1109: Sending Seq 22-1109: { Ans: ,
MgmtId: 345041274374, via: 22, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-04-15 12:05:15,955 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-
47e15670) (logid:4d7b1671) ===START=== 10.1.0.38 -- POST command=addHost&response=json
2016-04-15 12:05:15,966 WARN [c.c.a.d.ParamGenericValidationWorker]
(catalina-exec-7:ctx-47e15670 ctx-e6b00129) (logid:4d7b1671) Received unknown parameters for command addHost. Unknown parameters : clustertype
2016-04-15 12:05:15,970 ERROR [c.c.a.ApiServer] (catalina-exec-7:ctx-
47e15670 ctx-e6b00129) (logid:4d7b1671) unhandled exception executing api
command: [Ljava.lang.String;@59a74e3e
com.cloud.utils.exception.CloudRuntimeException: Guid is not updated for cluster with specified cluster id; need to wait for hosts in this cluster to come up
at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.ja
va:588)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:5
7)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImp
l.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(Aop
Utils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoin
t(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflec
tiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(Expo
seInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(Reflec
tiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopPr
oxy.java:204)
at com.sun.proxy.$Proxy157.discoverHosts(Unknown Source)
at
org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.
java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:698)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:529)
at
com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:297)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:127)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(Def
aultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithCo
ntext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithCon
text(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:124)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:91)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicatio
nFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterC
hain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.j
ava:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.j
ava:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:12
7)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:10
3)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:615)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.jav
a:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java
:891)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(
Http11NioProtocol.java:750)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java
:2283)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1
145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:
615)
at java.lang.Thread.run(Thread.java:745)
2016-04-15 12:05:15,975 DEBUG [c.c.a.ApiServlet] (catalina-exec-7:ctx-
47e15670 ctx-e6b00129) (logid:4d7b1671) ===END=== 10.1.0.38 -- POST command=addHost&response=json
2016-04-15 12:05:16,342 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-7:null) (logid:) SeqA 10-43274: Processing Seq 10-43274: { Cmd ,
MgmtId: -1, via: 10, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":
{"_proxyVmId":16,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2016-04-15 12:05:16,349 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-
Handler-7:null) (logid:) SeqA 10-43274: Sending Seq 10-43274: { Ans: ,
MgmtId: 345041274374, via: 10, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-04-15 12:05:17,783 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (Timer-8:ctx-
82aaf562) (logid:2d8237d1) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DownloadProgressCommand
2016-04-15 12:05:17,783 DEBUG [c.c.h.XenServerGuru] (Timer-8:ctx-82aaf562)
(logid:2d8237d1) getCommandHostDelegation: class org.apache.cloudstack.storage.command.DownloadProgressCommand
2016-04-15 12:05:17,783 DEBUG [o.a.c.s.RemoteHostEndPoint] (Timer-8:ctx-
82aaf562) (logid:2d8237d1) Sending command org.apache.cloudstack.storage.command.DownloadProgressCommand to host: 20
2016-04-15 12:05:17,785 DEBUG [c.c.a.t.Request] (Timer-8:ctx-82aaf562)
(logid:2d8237d1) Seq 20-2502875492911153339: Sending { Cmd , MgmtId:
345041274374, via: 20(s-3772-VM), Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DownloadProgressCommand":
{"jobId":"cc910aa9-2dd1-4d23-9dcb-
9006ec66f549","request":"GET_STATUS","hvm":true,"description":"Windows2012R
2","checksum":"4cabe641a4fffc7fe2c64d4d5de52222","maxDownloadSizeInBytes":5
3687091200,"id":223,"resourceType":"TEMPLATE","installPath":"template/tmpl/
2/223","_store":{"com.cloud.agent.api.to.NfsTO":
{"_url":"nfs://10.4.4.12/data/secondary","_role":"Image"}},"url":"http://10
9.168.24.130/windows.iso","format":"ISO","accountId":2,"name":"223-2-
fd3a72cd-3994-310e-b094-
d2b64d2cc5d9","secUrl":"nfs://10.4.4.12/data/secondary","wait":0}}] }
2016-04-15 12:05:17,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-
6:null) (logid:) Seq 20-2502875492911153339: Processing: { Ans: , MgmtId:
345041274374, via: 20, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"cc910aa9-2dd1-
4d23-9dcb-9006ec66f549","downloadPct":0,"errorString":"
","downloadStatus":"NOT_DOWNLOADED","downloadPath":"/mnt/SecStorage/8b7211e
f-78a7-3bc0-8e9d-
6452c129f9c6/template/tmpl/2/223/dnld6800296659240767495tmp_","installPath"
:"template/tmpl/2/223","templateSize":0,"templatePhySicalSize":0,"checkSum"
:"4cabe641a4fffc7fe2c64d4d5de52222","result":true,"details":" ","wait":0}}] }
2016-04-15 12:05:18,736 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-cfca74ed) (logid:83f1c3f1) Begin cleanup expired async-jobs
2016-04-15 12:05:18,742 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-cfca74ed) (logid:83f1c3f1) End cleanup expired async-jobs
2016-04-15 12:05:20,383 DEBUG [c.c.a.ApiServlet] (catalina-exec-11:ctx-
f74e42db) (logid:4292a110) ===START=== 10.1.0.38 -- GET
command=listZones&response=json&id=aa6ade1c-d5d7-460e-9971-
a62dbf5c062a&_=1460714720398
2016-04-15 12:05:20,397 DEBUG [c.c.a.ApiServlet] (catalina-exec-11:ctx- f74e42db ctx-b8d2f3f7) (logid:4292a110) ===END=== 10.1.0.38 -- GET
command=listZones&response=json&id=aa6ade1c-d5d7-460e-9971-
a62dbf5c062a&_=1460714720398
2016-04-15 12:05:20,852 DEBUG [c.c.a.ApiServlet] (catalina-exec-21:ctx-
c4980172) (logid:e3092d03) ===START=== 10.1.0.38 -- GET
command=listHosts&id=aeaf004d-2aac-488e-9e0d-
4ccad1738047&response=json&_=1460714720736