You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Amir Abbasi <ab...@tebyanidc.ir> on 2014/08/03 12:29:07 UTC
Host stuck in "Alert" status after adding a new primary storage
Hi,
I've removed the new Primary storage but the Host still shows Alert status and here is what I see in logs:
2014-08-03 14:51:09,401 DEBUG [cloud.host.Status] (AgentTaskPool-4:null) Agent status update: [id = 55; name = 10.3.1.5; old status = Alert; event = AgentDisconnected; new status = Alert; old update count = 14014; new update count = 14015]
Thanks in advance,
Re: Host stuck in "Alert" status after adding a new primary storage
Posted by Amir Abbasi <ab...@tebyanidc.ir>.
Hi,
I've removed the host (in alert state) from database but when I try to add
it again I get following error:
Cannot transit agent status with event AgentDisconnected for host 66,
mangement server id is 345050455587,Unable to transition to a new state from
Creating via AgentDisconnected
Here is the complete error message:
----------------
2014-08-06 15:33:51,506 DEBUG [db.Transaction.Transaction]
(catalina-exec-21:null) Rolling back the transaction: Time = 2 Name = pr
ocessConnect; called
by -Transaction.rollback:837-Transaction.removeUpTo:780-Transaction.close:599-DatabaseCallback.interceptComplet
e:67-DatabaseCallback.intercept:32-LocalStoragePoolListener.processConnect:107-DatabaseCallback.intercept:30-AgentManagerImpl.notify
MonitorsOfConnection:601-AgentManagerImpl.handleDirectConnectAgent:1496-ResourceManagerImpl.createHostAndAgent:1574-ResourceManagerI
mpl.discoverHostsFull:677-ResourceManagerImpl.discoverHosts:514
2014-08-06 15:33:51,538 WARN [cloud.storage.LocalStoragePoolListener]
(catalina-exec-21:null) Unable to setup the local storage poo
l for Host[-66-Routing]
javax.persistence.EntityExistsException: Entity already exists:
at
com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1302)
at
com.cloud.storage.dao.StoragePoolDaoImpl.persist(StoragePoolDaoImpl.java:225)
at
com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:30)
at
com.cloud.storage.LocalStoragePoolListener.processConnect(LocalStoragePoolListener.java:107)
at
com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:30)
at
com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:601)
at
com.cloud.agent.manager.AgentManagerImpl.handleDirectConnectAgent(AgentManagerImpl.java:1496)
at
com.cloud.resource.ResourceManagerImpl.createHostAndAgent(ResourceManagerImpl.java:1574)
at
com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:677)
at
com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:514)
at com.cloud.api.commands.AddHostCmd.execute(AddHostCmd.java:136)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:132)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:509)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:416)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:300)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:59)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2268)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by:
com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException:
Duplicate entry '41c00af0-3b6d-3811-90cb-9e31
a7081bdb' for key 'uuid'
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)
at com.mysql.jdbc.Util.getInstance(Util.java:381)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1015)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3515)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3447)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1951)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2101)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2554)
at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1761)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2046)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1964)
at
com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:1949)
at
org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:106)
at
com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1267)
... 40 more
2014-08-06 15:33:51,539 WARN [agent.manager.AgentManagerImpl]
(catalina-exec-21:null) Monitor LocalStoragePoolListener$$EnhancerByC
GLIB$$e783b2e5 says there is an error in the connect process for 66 due to
Unable to setup the local storage pool for Host[-66-Routi
ng]
2014-08-06 15:33:51,539 INFO [agent.manager.AgentManagerImpl]
(catalina-exec-21:null) Host 66 is disconnecting with event AgentDisc
onnected
2014-08-06 15:33:51,541 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-21:null) The next status of agent 66is Alert, current
status is Connecting
2014-08-06 15:33:51,541 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-21:null) Deregistering link for 66 with state Alert
2014-08-06 15:33:51,541 DEBUG [agent.manager.AgentManagerImpl]
(catalina-exec-21:null) Remove Agent : 66
2014-08-06 15:33:51,541 DEBUG [agent.manager.DirectAgentAttache]
(catalina-exec-21:null) Processing disconnect 66
----- Original Message -----
From: "Devdeep Singh" <de...@citrix.com>
To: <us...@cloudstack.apache.org>
Sent: Tuesday, August 05, 2014 10:22 AM
Subject: RE: Host stuck in "Alert" status after adding a new primary storage
Hi Amir,
Can you share some more logs of the management server? It looks like
management server isn't able to connect to the host; but we'll have to look
at rest of the logs to root cause the issue. What hypervisor are you working
with?
Regards,
Devdeep
> -----Original Message-----
> From: Amir Abbasi [mailto:abbasi@tebyanidc.ir]
> Sent: Sunday, August 3, 2014 3:59 PM
> To: users@cloudstack.apache.org
> Subject: Host stuck in "Alert" status after adding a new primary storage
>
> Hi,
>
> I've removed the new Primary storage but the Host still shows Alert status
> and here is what I see in logs:
>
> 2014-08-03 14:51:09,401 DEBUG [cloud.host.Status] (AgentTaskPool-4:null)
> Agent status update: [id = 55; name = 10.3.1.5; old status = Alert; event
> =
> AgentDisconnected; new status = Alert; old update count = 14014; new
> update count = 14015]
>
>
> Thanks in advance,
RE: Host stuck in "Alert" status after adding a new primary storage
Posted by Devdeep Singh <de...@citrix.com>.
Hi Amir,
Can you share some more logs of the management server? It looks like management server isn't able to connect to the host; but we'll have to look at rest of the logs to root cause the issue. What hypervisor are you working with?
Regards,
Devdeep
> -----Original Message-----
> From: Amir Abbasi [mailto:abbasi@tebyanidc.ir]
> Sent: Sunday, August 3, 2014 3:59 PM
> To: users@cloudstack.apache.org
> Subject: Host stuck in "Alert" status after adding a new primary storage
>
> Hi,
>
> I've removed the new Primary storage but the Host still shows Alert status
> and here is what I see in logs:
>
> 2014-08-03 14:51:09,401 DEBUG [cloud.host.Status] (AgentTaskPool-4:null)
> Agent status update: [id = 55; name = 10.3.1.5; old status = Alert; event =
> AgentDisconnected; new status = Alert; old update count = 14014; new
> update count = 14015]
>
>
> Thanks in advance,