You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Daan Hoogland <DH...@schubergphilis.com> on 2013/07/05 11:26:11 UTC

master not perfect:(

H,

I get a repetition of the following sequence of logging when running master. Anybody knows what happened?

INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:) Connection from /127.0.0.1 closed but no cleanup was done.
WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught problem with [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}]
com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize json object [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
       at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
       at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
       at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
       at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
       at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
       at com.google.gson.Gson.fromJson(Gson.java:551)
       at com.google.gson.Gson.fromJson(Gson.java:498)
       at com.cloud.agent.transport.Request.getCommands(Request.java:235)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1196)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1349)
       at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
       at com.cloud.utils.nio.Task.run(Task.java:83)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
       at java.lang.Thread.run(Unknown Source)
Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupSecondaryStorageCommand
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
       ... 15 more
WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the following exception but pushing on
com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize json object [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
       at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
       at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
       at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
       at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
       at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
       at com.google.gson.Gson.fromJson(Gson.java:551)
       at com.google.gson.Gson.fromJson(Gson.java:498)
       at com.cloud.agent.transport.Request.getCommands(Request.java:235)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1196)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1349)
       at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
       at com.cloud.utils.nio.Task.run(Task.java:83)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
       at java.lang.Thread.run(Unknown Source)
Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupSecondaryStorageCommand
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
       ... 15 more
WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System Alert: Number of unallocated virtual network public IPs is low in availability zone MCCDZone


Re: master not perfect:(

Posted by Prasanna Santhanam <pr...@citrix.com>.
On Fri, Jul 05, 2013 at 09:26:11AM +0000, Daan Hoogland wrote:
> H,
> 
> I get a repetition of the following sequence of logging when running
> master. Anybody knows what happened?

Try the steps here: http://markmail.org/message/ranl2l3pzq5qnzd2
> 
-- 
Prasanna.,

RE: master not perfect:(

Posted by Rajesh Battala <ra...@citrix.com>.
Hi Daan,
Please build the systemvm.iso and remove the tags on xenserver host which will copy the new generated systemvm.iso. 
Newly built systemvm.iso will resolve this issue.

Thanks
Rajesh Battala


> -----Original Message-----
> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
> Sent: Friday, July 5, 2013 2:56 PM
> To: dev@cloudstack.apache.org
> Subject: master not perfect:(
> 
> H,
> 
> I get a repetition of the following sequence of logging when running master.
> Anybody knows what happened?
> 
> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:)
> Connection from /127.0.0.1 closed but no cleanup was done.
> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the
> generated keystore. Loading fail-safe one to continue.
> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
> problem with
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCen
> ter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-
> 1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask
> ":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddres
> s":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask"
> :"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.2
> 55.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSec
> ondaryStorageResource","contextMap":{},"wait":0}}]
> com.google.gson.JsonParseException: The JsonDeserializer
> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize
> json object
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCen
> ter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-
> 1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask
> ":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddres
> s":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask"
> :"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.2
> 55.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSec
> ondaryStorageResource","contextMap":{},"wait":0}}] given the type class
> [Lcom.cloud.agent.api.Command;
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeseriali
> zerExceptionWrapper.java:64)
>        at
> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDe
> serializationVisitor.java:92)
>        at
> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDes
> erializationVisitor.java:80)
>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>        at
> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeser
> ializationContextDefault.java:67)
>        at
> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeseriali
> zationContextDefault.java:52)
>        at com.google.gson.Gson.fromJson(Gson.java:551)
>        at com.google.gson.Gson.fromJson(Gson.java:498)
>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest
> (AgentManagerImpl.java:1196)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentM
> anagerImpl.java:1349)
>        at
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHand
> ler.doTask(ClusteredAgentManagerImpl.java:659)
>        at com.cloud.utils.nio.Task.run(Task.java:83)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>        at java.lang.Thread.run(Unknown Source) Caused by:
> com.cloud.utils.exception.CloudRuntimeException: can't find
> StartupSecondaryStorageCommand
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.j
> ava:77)
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.j
> ava:37)
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeseriali
> zerExceptionWrapper.java:51)
>        ... 15 more
> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the following
> exception but pushing on
> com.google.gson.JsonParseException: The JsonDeserializer
> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize
> json object
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCen
> ter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-
> 1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask
> ":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddres
> s":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask"
> :"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.2
> 55.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSec
> ondaryStorageResource","contextMap":{},"wait":0}}] given the type class
> [Lcom.cloud.agent.api.Command;
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeseriali
> zerExceptionWrapper.java:64)
>        at
> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDe
> serializationVisitor.java:92)
>        at
> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDes
> erializationVisitor.java:80)
>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>        at
> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeser
> ializationContextDefault.java:67)
>        at
> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeseriali
> zationContextDefault.java:52)
>        at com.google.gson.Gson.fromJson(Gson.java:551)
>        at com.google.gson.Gson.fromJson(Gson.java:498)
>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest
> (AgentManagerImpl.java:1196)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentM
> anagerImpl.java:1349)
>        at
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHand
> ler.doTask(ClusteredAgentManagerImpl.java:659)
>        at com.cloud.utils.nio.Task.run(Task.java:83)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>        at java.lang.Thread.run(Unknown Source) Caused by:
> com.cloud.utils.exception.CloudRuntimeException: can't find
> StartupSecondaryStorageCommand
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.j
> ava:77)
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.j
> ava:37)
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeseriali
> zerExceptionWrapper.java:51)
>        ... 15 more
> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 //
> dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System Alert:
> Number of unallocated virtual network public IPs is low in availability zone
> MCCDZone


Re: master not perfect:(

Posted by Nitin Mehta <Ni...@citrix.com>.
Good solution Hugo.
Can we also not embed md5sum in the tag ? In that case it would push the
iso if the md5sum doesn't match
Will it break more things than it will solve :) ?

Thanks,
-Nitin

On 05/07/13 5:45 PM, "Hugo Trippaers" <HT...@schubergphilis.com>
wrote:

>Heya,
>
>It will be done automagically once you upgrade the version number. The
>tag lists the version number and checks that against the current version
>you are running.
>
>This is probably good for users who only want to update the systemvm
>once, when they upgrade to a new version. For developers who generally
>work on the same version its more troublesome, just like database
>upgrades. A developer typically recompiles regularly and needs the latest
>version of both database and systemvm.
>
>A solution could be to ignore the tag when developer is set to true in
>the global config. Any better ideas?
>
>Cheers,
>
>Hugo
>
>> -----Original Message-----
>> From: Nitin Mehta [mailto:Nitin.Mehta@citrix.com]
>> Sent: Friday, July 05, 2013 12:48 PM
>> To: dev@cloudstack.apache.org
>> Subject: Re: master not perfect:(
>> 
>> Shouldn't we have a better mechanism of pushing systemvm.iso onto XS ?
>> Why does it have to be manually done by clearing the tags ?
>> 
>> Thanks,
>> -Nitin
>> 
>> On 05/07/13 3:43 PM, "Rajesh Battala" <ra...@citrix.com> wrote:
>> 
>> >After the new systemvm.iso is generated and tags/systemvm.iso are
>> >removed on xenserver host , when mgmt. server starts, it will copy the
>> >new systemvm.iso to the Host.
>> >Then the issue will be resolved.
>> >
>> >> -----Original Message-----
>> >> From: Likitha Shetty [mailto:likitha.shetty@citrix.com]
>> >> Sent: Friday, July 5, 2013 3:38 PM
>> >> To: dev@cloudstack.apache.org
>> >> Subject: RE: master not perfect:(
>> >>
>> >> In my case the discussed steps didn't resolve the issue (removing all
>> >>the tags  from the host , cleaning up systemvm.iso from the codebase ,
>> >>ensuring the  systemvm profile is enabled during maven build and also
>> >>ensuring the host  has the newly generated systemvm.iso).
>> >> Only once I rebooted the host was the issue resolved.
>> >>
>> >> Thanks,
>> >> Likitha
>> >>
>> >> >-----Original Message-----
>> >> >From: Hugo Trippaers [mailto:HTrippaers@schubergphilis.com]
>> >> >Sent: Friday, July 05, 2013 3:23 PM
>> >> >To: dev@cloudstack.apache.org
>> >> >Subject: RE: master not perfect:(
>> >> >
>> >> >Hey guys,
>> >> >
>> >> >Did you use the latest systemvm.iso on the systemvm? This error
>> >> >might occur when the classes on the secondary storage vm are out of
>> >> >sync with the classes on the management server.
>> >> >
>> >> >If you are running from a maven build make sure that the systemvm
>> >> >profile is enabled to generate the systemvm.iso and that the file is
>> >> >properly uploaded/copied.
>> >> >
>> >> >Cheers,
>> >> >
>> >> >
>> >> >Hugo
>> >> >
>> >> >> -----Original Message-----
>> >> >> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
>> >> >> Sent: Friday, July 05, 2013 11:44 AM
>> >> >> To: dev@cloudstack.apache.org
>> >> >> Subject: RE: master not perfect:(
>> >> >>
>> >> >> I faced the same issue, then I logged on to the xenserver host and
>> >> >> deleted the tags, restarted the MS but even after that i could see
>> >> >> these errors. Finally I rebooted the Xen Host and after that the
>> >> >> error was not seen. Filed a bug for the same,
>> >> >> https://issues.apache.org/jira/browse/CLOUDSTACK-3377
>> >> >>
>> >> >> Thanks and regards,
>> >> >> Abhinav
>> >> >> -----Original Message-----
>> >> >> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
>> >> >> Sent: Friday, July 05, 2013 2:56 PM
>> >> >> To: dev@cloudstack.apache.org
>> >> >> Subject: master not perfect:(
>> >> >>
>> >> >> H,
>> >> >>
>> >> >> I get a repetition of the following sequence of logging when
>> >> >> running
>> >> master.
>> >> >> Anybody knows what happened?
>> >> >>
>> >> >> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-
>> 11:)
>> >> >> Connection from /127.0.0.1 closed but no cleanup was done.
>> >> >> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find
>> >> >> the generated keystore. Loading fail-safe one to continue.
>> >> >> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
>> >> >> problem with
>> >> >>
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
>> >> >> etm
>> >> >> a
>> >> >> s
>> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
>> >> >> teI
>> >> >> p
>> >> >> Addr
>> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
>> >> >> teN
>> >> >> e
>> >> >> tma
>> >> >>
>> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> >> :"2
>> >> >>
>> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
>> "
>> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}]
>> >> >> com.google.gson.JsonParseException: The JsonDeserializer
>> >> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> >> >> deserialize json object
>> >> >>
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
>> >> >> etm
>> >> >> a
>> >> >> s
>> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
>> >> >> teI
>> >> >> p
>> >> >> Addr
>> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
>> >> >> teN
>> >> >> e
>> >> >> tma
>> >> >>
>> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> >> :"2
>> >> >>
>> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
>> "
>> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given
>> >> >> the type class [Lcom.cloud.agent.api.Command;
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
>> >> >> ese
>> >> >> r
>> >> >> ial
>> >> >> izerExceptionWrapper.java:64)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserialize
>> >> >> r(J
>> >> >> s
>> >> >> onD
>> >> >> eserializationVisitor.java:92)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler
>> >> >> (Js
>> >> >> o
>> >> >> nDe
>> >> >> serializationVisitor.java:80)
>> >> >>        at
>> >>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(Js
>> >> >> onD
>> >> >> e
>> >> >> s
>> >> >> erializationContextDefault.java:67)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationContextDefault.deserialize(Json
>> >> >> Des
>> >> >> e
>> >> >> rial
>> >> >> izationContextDefault.java:52)
>> >> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
>> >> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
>> >> >>        at
>> >> com.cloud.agent.transport.Request.getCommands(Request.java:235)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> >> >> st(AgentManagerImpl.java:1196)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> >> >> ManagerImpl.java:1349)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> >> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
>> >> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
>> >> >>        at
>> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
>> >> Source)
>> >> >>        at
>> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> >> >> Source)
>> >> >>        at java.lang.Thread.run(Unknown Source) Caused by:
>> >> >> com.cloud.utils.exception.CloudRuntimeException: can't find
>> >> >> StartupSecondaryStorageCommand
>> >> >>        at
>> >> >>
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
>> >> >> apt
>> >> >> o
>> >> >> r
>> >> >> .java:77)
>> >> >>        at
>> >> >>
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
>> >> >> apt
>> >> >> o
>> >> >> r
>> >> >> .java:37)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
>> >> >> ese
>> >> >> r
>> >> >> ial
>> >> >> izerExceptionWrapper.java:51)
>> >> >>        ... 15 more
>> >> >> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the
>> >> >> following exception but pushing on
>> >> >> com.google.gson.JsonParseException: The JsonDeserializer
>> >> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> >> >> deserialize json object
>> >> >>
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
>> >> >> etm
>> >> >> a
>> >> >> s
>> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
>> >> >> teI
>> >> >> p
>> >> >> Addr
>> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
>> >> >> teN
>> >> >> e
>> >> >> tma
>> >> >>
>> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> >> :"2
>> >> >>
>> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
>> "
>> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given
>> >> >> the type class [Lcom.cloud.agent.api.Command;
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
>> >> >> ese
>> >> >> r
>> >> >> ial
>> >> >> izerExceptionWrapper.java:64)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserialize
>> >> >> r(J
>> >> >> s
>> >> >> onD
>> >> >> eserializationVisitor.java:92)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler
>> >> >> (Js
>> >> >> o
>> >> >> nDe
>> >> >> serializationVisitor.java:80)
>> >> >>        at
>> >>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(Js
>> >> >> onD
>> >> >> e
>> >> >> s
>> >> >> erializationContextDefault.java:67)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializationContextDefault.deserialize(Json
>> >> >> Des
>> >> >> e
>> >> >> rial
>> >> >> izationContextDefault.java:52)
>> >> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
>> >> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
>> >> >>        at
>> >> com.cloud.agent.transport.Request.getCommands(Request.java:235)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> >> >> st(AgentManagerImpl.java:1196)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> >> >> ManagerImpl.java:1349)
>> >> >>        at
>> >> >>
>> >>
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> >> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
>> >> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
>> >> >>        at
>> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
>> >> Source)
>> >> >>        at
>> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> >> >> Source)
>> >> >>        at java.lang.Thread.run(Unknown Source) Caused by:
>> >> >> com.cloud.utils.exception.CloudRuntimeException: can't find
>> >> >> StartupSecondaryStorageCommand
>> >> >>        at
>> >> >>
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
>> >> >> apt
>> >> >> o
>> >> >> r
>> >> >> .java:77)
>> >> >>        at
>> >> >>
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
>> >> >> apt
>> >> >> o
>> >> >> r
>> >> >> .java:37)
>> >> >>        at
>> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
>> >> >> ese
>> >> >> r
>> >> >> ial
>> >> >> izerExceptionWrapper.java:51)
>> >> >>        ... 15 more
>> >> >> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4
>> >> >> //
>> >> >> dataCenterId:: 1 // podId:: null // clusterId:: null // message::
>> >>System
>> >> Alert:
>> >> >> Number of unallocated virtual network public IPs is low in
>> >> >> availability zone MCCDZone
>> >
>


RE: master not perfect:(

Posted by Hugo Trippaers <HT...@schubergphilis.com>.
Heya,

It will be done automagically once you upgrade the version number. The tag lists the version number and checks that against the current version you are running.

This is probably good for users who only want to update the systemvm once, when they upgrade to a new version. For developers who generally work on the same version its more troublesome, just like database upgrades. A developer typically recompiles regularly and needs the latest version of both database and systemvm.

A solution could be to ignore the tag when developer is set to true in the global config. Any better ideas?

Cheers,

Hugo

> -----Original Message-----
> From: Nitin Mehta [mailto:Nitin.Mehta@citrix.com]
> Sent: Friday, July 05, 2013 12:48 PM
> To: dev@cloudstack.apache.org
> Subject: Re: master not perfect:(
> 
> Shouldn't we have a better mechanism of pushing systemvm.iso onto XS ?
> Why does it have to be manually done by clearing the tags ?
> 
> Thanks,
> -Nitin
> 
> On 05/07/13 3:43 PM, "Rajesh Battala" <ra...@citrix.com> wrote:
> 
> >After the new systemvm.iso is generated and tags/systemvm.iso are
> >removed on xenserver host , when mgmt. server starts, it will copy the
> >new systemvm.iso to the Host.
> >Then the issue will be resolved.
> >
> >> -----Original Message-----
> >> From: Likitha Shetty [mailto:likitha.shetty@citrix.com]
> >> Sent: Friday, July 5, 2013 3:38 PM
> >> To: dev@cloudstack.apache.org
> >> Subject: RE: master not perfect:(
> >>
> >> In my case the discussed steps didn't resolve the issue (removing all
> >>the tags  from the host , cleaning up systemvm.iso from the codebase ,
> >>ensuring the  systemvm profile is enabled during maven build and also
> >>ensuring the host  has the newly generated systemvm.iso).
> >> Only once I rebooted the host was the issue resolved.
> >>
> >> Thanks,
> >> Likitha
> >>
> >> >-----Original Message-----
> >> >From: Hugo Trippaers [mailto:HTrippaers@schubergphilis.com]
> >> >Sent: Friday, July 05, 2013 3:23 PM
> >> >To: dev@cloudstack.apache.org
> >> >Subject: RE: master not perfect:(
> >> >
> >> >Hey guys,
> >> >
> >> >Did you use the latest systemvm.iso on the systemvm? This error
> >> >might occur when the classes on the secondary storage vm are out of
> >> >sync with the classes on the management server.
> >> >
> >> >If you are running from a maven build make sure that the systemvm
> >> >profile is enabled to generate the systemvm.iso and that the file is
> >> >properly uploaded/copied.
> >> >
> >> >Cheers,
> >> >
> >> >
> >> >Hugo
> >> >
> >> >> -----Original Message-----
> >> >> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
> >> >> Sent: Friday, July 05, 2013 11:44 AM
> >> >> To: dev@cloudstack.apache.org
> >> >> Subject: RE: master not perfect:(
> >> >>
> >> >> I faced the same issue, then I logged on to the xenserver host and
> >> >> deleted the tags, restarted the MS but even after that i could see
> >> >> these errors. Finally I rebooted the Xen Host and after that the
> >> >> error was not seen. Filed a bug for the same,
> >> >> https://issues.apache.org/jira/browse/CLOUDSTACK-3377
> >> >>
> >> >> Thanks and regards,
> >> >> Abhinav
> >> >> -----Original Message-----
> >> >> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
> >> >> Sent: Friday, July 05, 2013 2:56 PM
> >> >> To: dev@cloudstack.apache.org
> >> >> Subject: master not perfect:(
> >> >>
> >> >> H,
> >> >>
> >> >> I get a repetition of the following sequence of logging when
> >> >> running
> >> master.
> >> >> Anybody knows what happened?
> >> >>
> >> >> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-
> 11:)
> >> >> Connection from /127.0.0.1 closed but no cleanup was done.
> >> >> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find
> >> >> the generated keystore. Loading fail-safe one to continue.
> >> >> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
> >> >> problem with
> >> >>
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
> >> >> etm
> >> >> a
> >> >> s
> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
> >> >> teI
> >> >> p
> >> >> Addr
> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
> >> >> teN
> >> >> e
> >> >> tma
> >> >>
> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> >> :"2
> >> >>
> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
> "
> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}]
> >> >> com.google.gson.JsonParseException: The JsonDeserializer
> >> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
> >> >> deserialize json object
> >> >>
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
> >> >> etm
> >> >> a
> >> >> s
> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
> >> >> teI
> >> >> p
> >> >> Addr
> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
> >> >> teN
> >> >> e
> >> >> tma
> >> >>
> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> >> :"2
> >> >>
> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
> "
> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given
> >> >> the type class [Lcom.cloud.agent.api.Command;
> >> >>        at
> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
> >> >> ese
> >> >> r
> >> >> ial
> >> >> izerExceptionWrapper.java:64)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserialize
> >> >> r(J
> >> >> s
> >> >> onD
> >> >> eserializationVisitor.java:92)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler
> >> >> (Js
> >> >> o
> >> >> nDe
> >> >> serializationVisitor.java:80)
> >> >>        at
> >>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(Js
> >> >> onD
> >> >> e
> >> >> s
> >> >> erializationContextDefault.java:67)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationContextDefault.deserialize(Json
> >> >> Des
> >> >> e
> >> >> rial
> >> >> izationContextDefault.java:52)
> >> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
> >> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
> >> >>        at
> >> com.cloud.agent.transport.Request.getCommands(Request.java:235)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> >> >> st(AgentManagerImpl.java:1196)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> >> >> ManagerImpl.java:1349)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> >> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
> >> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
> >> >>        at
> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> >> Source)
> >> >>        at
> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> >> >> Source)
> >> >>        at java.lang.Thread.run(Unknown Source) Caused by:
> >> >> com.cloud.utils.exception.CloudRuntimeException: can't find
> >> >> StartupSecondaryStorageCommand
> >> >>        at
> >> >>
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
> >> >> apt
> >> >> o
> >> >> r
> >> >> .java:77)
> >> >>        at
> >> >>
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
> >> >> apt
> >> >> o
> >> >> r
> >> >> .java:37)
> >> >>        at
> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
> >> >> ese
> >> >> r
> >> >> ial
> >> >> izerExceptionWrapper.java:51)
> >> >>        ... 15 more
> >> >> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the
> >> >> following exception but pushing on
> >> >> com.google.gson.JsonParseException: The JsonDeserializer
> >> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
> >> >> deserialize json object
> >> >>
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicN
> >> >> etm
> >> >> a
> >> >> s
> >> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","priva
> >> >> teI
> >> >> p
> >> >> Addr
> >> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","priva
> >> >> teN
> >> >> e
> >> >> tma
> >> >>
> >>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> >> :"2
> >> >>
> >>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":
> "
> >> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given
> >> >> the type class [Lcom.cloud.agent.api.Command;
> >> >>        at
> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
> >> >> ese
> >> >> r
> >> >> ial
> >> >> izerExceptionWrapper.java:64)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserialize
> >> >> r(J
> >> >> s
> >> >> onD
> >> >> eserializationVisitor.java:92)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler
> >> >> (Js
> >> >> o
> >> >> nDe
> >> >> serializationVisitor.java:80)
> >> >>        at
> >>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(Js
> >> >> onD
> >> >> e
> >> >> s
> >> >> erializationContextDefault.java:67)
> >> >>        at
> >> >> com.google.gson.JsonDeserializationContextDefault.deserialize(Json
> >> >> Des
> >> >> e
> >> >> rial
> >> >> izationContextDefault.java:52)
> >> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
> >> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
> >> >>        at
> >> com.cloud.agent.transport.Request.getCommands(Request.java:235)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> >> >> st(AgentManagerImpl.java:1196)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> >> >> ManagerImpl.java:1349)
> >> >>        at
> >> >>
> >>
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> >> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
> >> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
> >> >>        at
> >> >> java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> >> Source)
> >> >>        at
> >> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> >> >> Source)
> >> >>        at java.lang.Thread.run(Unknown Source) Caused by:
> >> >> com.cloud.utils.exception.CloudRuntimeException: can't find
> >> >> StartupSecondaryStorageCommand
> >> >>        at
> >> >>
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
> >> >> apt
> >> >> o
> >> >> r
> >> >> .java:77)
> >> >>        at
> >> >>
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAd
> >> >> apt
> >> >> o
> >> >> r
> >> >> .java:37)
> >> >>        at
> >> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonD
> >> >> ese
> >> >> r
> >> >> ial
> >> >> izerExceptionWrapper.java:51)
> >> >>        ... 15 more
> >> >> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4
> >> >> //
> >> >> dataCenterId:: 1 // podId:: null // clusterId:: null // message::
> >>System
> >> Alert:
> >> >> Number of unallocated virtual network public IPs is low in
> >> >> availability zone MCCDZone
> >


Re: master not perfect:(

Posted by Nitin Mehta <Ni...@citrix.com>.
Shouldn't we have a better mechanism of pushing systemvm.iso onto XS ? Why
does it have to be manually done by clearing the tags ?

Thanks,
-Nitin

On 05/07/13 3:43 PM, "Rajesh Battala" <ra...@citrix.com> wrote:

>After the new systemvm.iso is generated and tags/systemvm.iso are removed
>on xenserver host , when mgmt. server starts, it will copy the new
>systemvm.iso to the Host.
>Then the issue will be resolved.
>
>> -----Original Message-----
>> From: Likitha Shetty [mailto:likitha.shetty@citrix.com]
>> Sent: Friday, July 5, 2013 3:38 PM
>> To: dev@cloudstack.apache.org
>> Subject: RE: master not perfect:(
>> 
>> In my case the discussed steps didn't resolve the issue (removing all
>>the tags
>> from the host , cleaning up systemvm.iso from the codebase , ensuring
>>the
>> systemvm profile is enabled during maven build and also ensuring the
>>host
>> has the newly generated systemvm.iso).
>> Only once I rebooted the host was the issue resolved.
>> 
>> Thanks,
>> Likitha
>> 
>> >-----Original Message-----
>> >From: Hugo Trippaers [mailto:HTrippaers@schubergphilis.com]
>> >Sent: Friday, July 05, 2013 3:23 PM
>> >To: dev@cloudstack.apache.org
>> >Subject: RE: master not perfect:(
>> >
>> >Hey guys,
>> >
>> >Did you use the latest systemvm.iso on the systemvm? This error might
>> >occur when the classes on the secondary storage vm are out of sync with
>> >the classes on the management server.
>> >
>> >If you are running from a maven build make sure that the systemvm
>> >profile is enabled to generate the systemvm.iso and that the file is
>> >properly uploaded/copied.
>> >
>> >Cheers,
>> >
>> >
>> >Hugo
>> >
>> >> -----Original Message-----
>> >> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
>> >> Sent: Friday, July 05, 2013 11:44 AM
>> >> To: dev@cloudstack.apache.org
>> >> Subject: RE: master not perfect:(
>> >>
>> >> I faced the same issue, then I logged on to the xenserver host and
>> >> deleted the tags, restarted the MS but even after that i could see
>> >> these errors. Finally I rebooted the Xen Host and after that the
>> >> error was not seen. Filed a bug for the same,
>> >> https://issues.apache.org/jira/browse/CLOUDSTACK-3377
>> >>
>> >> Thanks and regards,
>> >> Abhinav
>> >> -----Original Message-----
>> >> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
>> >> Sent: Friday, July 05, 2013 2:56 PM
>> >> To: dev@cloudstack.apache.org
>> >> Subject: master not perfect:(
>> >>
>> >> H,
>> >>
>> >> I get a repetition of the following sequence of logging when running
>> master.
>> >> Anybody knows what happened?
>> >>
>> >> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:)
>> >> Connection from /127.0.0.1 closed but no cleanup was done.
>> >> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the
>> >> generated keystore. Loading fail-safe one to continue.
>> >> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
>> >> problem with
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
>> >> a
>> >> s
>> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
>> >> p
>> >> Addr
>> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
>> >> e
>> >> tma
>> >> 
>>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> :"2
>> >> 
>>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}]
>> >> com.google.gson.JsonParseException: The JsonDeserializer
>> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> >> deserialize json object
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
>> >> a
>> >> s
>> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
>> >> p
>> >> Addr
>> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
>> >> e
>> >> tma
>> >> 
>>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> :"2
>> >> 
>>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
>> >> type class [Lcom.cloud.agent.api.Command;
>> >>        at
>> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
>> >> r
>> >> ial
>> >> izerExceptionWrapper.java:64)
>> >>        at
>> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(J
>> >> s
>> >> onD
>> >> eserializationVisitor.java:92)
>> >>        at
>> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Js
>> >> o
>> >> nDe
>> >> serializationVisitor.java:80)
>> >>        at 
>>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>> >>        at
>> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonD
>> >> e
>> >> s
>> >> erializationContextDefault.java:67)
>> >>        at
>> >> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDes
>> >> e
>> >> rial
>> >> izationContextDefault.java:52)
>> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
>> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
>> >>        at
>> com.cloud.agent.transport.Request.getCommands(Request.java:235)
>> >>        at
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> >> st(AgentManagerImpl.java:1196)
>> >>        at
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> >> ManagerImpl.java:1349)
>> >>        at
>> >>
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
>> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
>> >>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
>> Source)
>> >>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> >> Source)
>> >>        at java.lang.Thread.run(Unknown Source) Caused by:
>> >> com.cloud.utils.exception.CloudRuntimeException: can't find
>> >> StartupSecondaryStorageCommand
>> >>        at
>> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
>> >> o
>> >> r
>> >> .java:77)
>> >>        at
>> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
>> >> o
>> >> r
>> >> .java:37)
>> >>        at
>> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
>> >> r
>> >> ial
>> >> izerExceptionWrapper.java:51)
>> >>        ... 15 more
>> >> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the
>> >> following exception but pushing on
>> >> com.google.gson.JsonParseException: The JsonDeserializer
>> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> >> deserialize json object
>> >>
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> >> nter":"1","pod":"1","guid":"s-1-VM-
>> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
>> >> a
>> >> s
>> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
>> >> p
>> >> Addr
>> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
>> >> e
>> >> tma
>> >> 
>>sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> >> :"2
>> >> 
>>55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
>> >> type class [Lcom.cloud.agent.api.Command;
>> >>        at
>> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
>> >> r
>> >> ial
>> >> izerExceptionWrapper.java:64)
>> >>        at
>> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(J
>> >> s
>> >> onD
>> >> eserializationVisitor.java:92)
>> >>        at
>> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Js
>> >> o
>> >> nDe
>> >> serializationVisitor.java:80)
>> >>        at 
>>com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>> >>        at
>> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonD
>> >> e
>> >> s
>> >> erializationContextDefault.java:67)
>> >>        at
>> >> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDes
>> >> e
>> >> rial
>> >> izationContextDefault.java:52)
>> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
>> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
>> >>        at
>> com.cloud.agent.transport.Request.getCommands(Request.java:235)
>> >>        at
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> >> st(AgentManagerImpl.java:1196)
>> >>        at
>> >>
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> >> ManagerImpl.java:1349)
>> >>        at
>> >>
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
>> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
>> >>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
>> Source)
>> >>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> >> Source)
>> >>        at java.lang.Thread.run(Unknown Source) Caused by:
>> >> com.cloud.utils.exception.CloudRuntimeException: can't find
>> >> StartupSecondaryStorageCommand
>> >>        at
>> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
>> >> o
>> >> r
>> >> .java:77)
>> >>        at
>> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
>> >> o
>> >> r
>> >> .java:37)
>> >>        at
>> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
>> >> r
>> >> ial
>> >> izerExceptionWrapper.java:51)
>> >>        ... 15 more
>> >> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 //
>> >> dataCenterId:: 1 // podId:: null // clusterId:: null // message::
>>System
>> Alert:
>> >> Number of unallocated virtual network public IPs is low in
>> >> availability zone MCCDZone
>


RE: master not perfect:(

Posted by Rajesh Battala <ra...@citrix.com>.
After the new systemvm.iso is generated and tags/systemvm.iso are removed on xenserver host , when mgmt. server starts, it will copy the new systemvm.iso to the Host.
Then the issue will be resolved. 

> -----Original Message-----
> From: Likitha Shetty [mailto:likitha.shetty@citrix.com]
> Sent: Friday, July 5, 2013 3:38 PM
> To: dev@cloudstack.apache.org
> Subject: RE: master not perfect:(
> 
> In my case the discussed steps didn't resolve the issue (removing all the tags
> from the host , cleaning up systemvm.iso from the codebase , ensuring the
> systemvm profile is enabled during maven build and also ensuring the host
> has the newly generated systemvm.iso).
> Only once I rebooted the host was the issue resolved.
> 
> Thanks,
> Likitha
> 
> >-----Original Message-----
> >From: Hugo Trippaers [mailto:HTrippaers@schubergphilis.com]
> >Sent: Friday, July 05, 2013 3:23 PM
> >To: dev@cloudstack.apache.org
> >Subject: RE: master not perfect:(
> >
> >Hey guys,
> >
> >Did you use the latest systemvm.iso on the systemvm? This error might
> >occur when the classes on the secondary storage vm are out of sync with
> >the classes on the management server.
> >
> >If you are running from a maven build make sure that the systemvm
> >profile is enabled to generate the systemvm.iso and that the file is
> >properly uploaded/copied.
> >
> >Cheers,
> >
> >
> >Hugo
> >
> >> -----Original Message-----
> >> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
> >> Sent: Friday, July 05, 2013 11:44 AM
> >> To: dev@cloudstack.apache.org
> >> Subject: RE: master not perfect:(
> >>
> >> I faced the same issue, then I logged on to the xenserver host and
> >> deleted the tags, restarted the MS but even after that i could see
> >> these errors. Finally I rebooted the Xen Host and after that the
> >> error was not seen. Filed a bug for the same,
> >> https://issues.apache.org/jira/browse/CLOUDSTACK-3377
> >>
> >> Thanks and regards,
> >> Abhinav
> >> -----Original Message-----
> >> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
> >> Sent: Friday, July 05, 2013 2:56 PM
> >> To: dev@cloudstack.apache.org
> >> Subject: master not perfect:(
> >>
> >> H,
> >>
> >> I get a repetition of the following sequence of logging when running
> master.
> >> Anybody knows what happened?
> >>
> >> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:)
> >> Connection from /127.0.0.1 closed but no cleanup was done.
> >> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the
> >> generated keystore. Loading fail-safe one to continue.
> >> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
> >> problem with
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
> >> a
> >> s
> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
> >> p
> >> Addr
> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
> >> e
> >> tma
> >> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> :"2
> >> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}]
> >> com.google.gson.JsonParseException: The JsonDeserializer
> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
> >> deserialize json object
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
> >> a
> >> s
> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
> >> p
> >> Addr
> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
> >> e
> >> tma
> >> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> :"2
> >> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
> >> type class [Lcom.cloud.agent.api.Command;
> >>        at
> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
> >> r
> >> ial
> >> izerExceptionWrapper.java:64)
> >>        at
> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(J
> >> s
> >> onD
> >> eserializationVisitor.java:92)
> >>        at
> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Js
> >> o
> >> nDe
> >> serializationVisitor.java:80)
> >>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
> >>        at
> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonD
> >> e
> >> s
> >> erializationContextDefault.java:67)
> >>        at
> >> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDes
> >> e
> >> rial
> >> izationContextDefault.java:52)
> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
> >>        at
> com.cloud.agent.transport.Request.getCommands(Request.java:235)
> >>        at
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> >> st(AgentManagerImpl.java:1196)
> >>        at
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> >> ManagerImpl.java:1349)
> >>        at
> >>
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
> >>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
> >>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> >> Source)
> >>        at java.lang.Thread.run(Unknown Source) Caused by:
> >> com.cloud.utils.exception.CloudRuntimeException: can't find
> >> StartupSecondaryStorageCommand
> >>        at
> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
> >> o
> >> r
> >> .java:77)
> >>        at
> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
> >> o
> >> r
> >> .java:37)
> >>        at
> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
> >> r
> >> ial
> >> izerExceptionWrapper.java:51)
> >>        ... 15 more
> >> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the
> >> following exception but pushing on
> >> com.google.gson.JsonParseException: The JsonDeserializer
> >> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
> >> deserialize json object
> >>
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> >> nter":"1","pod":"1","guid":"s-1-VM-
> >> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> >> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetm
> >> a
> >> s
> >> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateI
> >> p
> >> Addr
> >> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateN
> >> e
> >> tma
> >> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
> >> :"2
> >> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
> >> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
> >> type class [Lcom.cloud.agent.api.Command;
> >>        at
> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
> >> r
> >> ial
> >> izerExceptionWrapper.java:64)
> >>        at
> >> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(J
> >> s
> >> onD
> >> eserializationVisitor.java:92)
> >>        at
> >> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Js
> >> o
> >> nDe
> >> serializationVisitor.java:80)
> >>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
> >>        at
> >> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonD
> >> e
> >> s
> >> erializationContextDefault.java:67)
> >>        at
> >> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDes
> >> e
> >> rial
> >> izationContextDefault.java:52)
> >>        at com.google.gson.Gson.fromJson(Gson.java:551)
> >>        at com.google.gson.Gson.fromJson(Gson.java:498)
> >>        at
> com.cloud.agent.transport.Request.getCommands(Request.java:235)
> >>        at
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> >> st(AgentManagerImpl.java:1196)
> >>        at
> >>
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> >> ManagerImpl.java:1349)
> >>        at
> >>
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> >> dler.doTask(ClusteredAgentManagerImpl.java:659)
> >>        at com.cloud.utils.nio.Task.run(Task.java:83)
> >>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
> Source)
> >>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> >> Source)
> >>        at java.lang.Thread.run(Unknown Source) Caused by:
> >> com.cloud.utils.exception.CloudRuntimeException: can't find
> >> StartupSecondaryStorageCommand
> >>        at
> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
> >> o
> >> r
> >> .java:77)
> >>        at
> >> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapt
> >> o
> >> r
> >> .java:37)
> >>        at
> >> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDese
> >> r
> >> ial
> >> izerExceptionWrapper.java:51)
> >>        ... 15 more
> >> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 //
> >> dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System
> Alert:
> >> Number of unallocated virtual network public IPs is low in
> >> availability zone MCCDZone


RE: master not perfect:(

Posted by Likitha Shetty <li...@citrix.com>.
In my case the discussed steps didn't resolve the issue (removing all the tags from the host , cleaning up systemvm.iso from the codebase , ensuring the systemvm profile is enabled during maven build and also ensuring the host has the newly generated systemvm.iso).
Only once I rebooted the host was the issue resolved.

Thanks,
Likitha

>-----Original Message-----
>From: Hugo Trippaers [mailto:HTrippaers@schubergphilis.com]
>Sent: Friday, July 05, 2013 3:23 PM
>To: dev@cloudstack.apache.org
>Subject: RE: master not perfect:(
>
>Hey guys,
>
>Did you use the latest systemvm.iso on the systemvm? This error might occur
>when the classes on the secondary storage vm are out of sync with the classes
>on the management server.
>
>If you are running from a maven build make sure that the systemvm profile is
>enabled to generate the systemvm.iso and that the file is properly
>uploaded/copied.
>
>Cheers,
>
>
>Hugo
>
>> -----Original Message-----
>> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
>> Sent: Friday, July 05, 2013 11:44 AM
>> To: dev@cloudstack.apache.org
>> Subject: RE: master not perfect:(
>>
>> I faced the same issue, then I logged on to the xenserver host and
>> deleted the tags, restarted the MS but even after that i could see
>> these errors. Finally I rebooted the Xen Host and after that the error
>> was not seen. Filed a bug for the same,
>> https://issues.apache.org/jira/browse/CLOUDSTACK-3377
>>
>> Thanks and regards,
>> Abhinav
>> -----Original Message-----
>> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
>> Sent: Friday, July 05, 2013 2:56 PM
>> To: dev@cloudstack.apache.org
>> Subject: master not perfect:(
>>
>> H,
>>
>> I get a repetition of the following sequence of logging when running master.
>> Anybody knows what happened?
>>
>> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:)
>> Connection from /127.0.0.1 closed but no cleanup was done.
>> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the
>> generated keystore. Loading fail-safe one to continue.
>> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
>> problem with
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> nter":"1","pod":"1","guid":"s-1-VM-
>> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetma
>> s
>> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIp
>> Addr
>> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNe
>> tma
>> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> :"2
>> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> N fsSecondaryStorageResource","contextMap":{},"wait":0}}]
>> com.google.gson.JsonParseException: The JsonDeserializer
>> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> deserialize json object
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> nter":"1","pod":"1","guid":"s-1-VM-
>> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetma
>> s
>> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIp
>> Addr
>> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNe
>> tma
>> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> :"2
>> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
>> type class [Lcom.cloud.agent.api.Command;
>>        at
>> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeser
>> ial
>> izerExceptionWrapper.java:64)
>>        at
>> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(Js
>> onD
>> eserializationVisitor.java:92)
>>        at
>> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Jso
>> nDe
>> serializationVisitor.java:80)
>>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>>        at
>> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDe
>> s
>> erializationContextDefault.java:67)
>>        at
>> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDese
>> rial
>> izationContextDefault.java:52)
>>        at com.google.gson.Gson.fromJson(Gson.java:551)
>>        at com.google.gson.Gson.fromJson(Gson.java:498)
>>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>>        at
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> st(AgentManagerImpl.java:1196)
>>        at
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> ManagerImpl.java:1349)
>>        at
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> dler.doTask(ClusteredAgentManagerImpl.java:659)
>>        at com.cloud.utils.nio.Task.run(Task.java:83)
>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>>        at java.lang.Thread.run(Unknown Source) Caused by:
>> com.cloud.utils.exception.CloudRuntimeException: can't find
>> StartupSecondaryStorageCommand
>>        at
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapto
>> r
>> .java:77)
>>        at
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapto
>> r
>> .java:37)
>>        at
>> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeser
>> ial
>> izerExceptionWrapper.java:51)
>>        ... 15 more
>> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the following
>> exception but pushing on
>> com.google.gson.JsonParseException: The JsonDeserializer
>> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to
>> deserialize json object
>> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
>> nter":"1","pod":"1","guid":"s-1-VM-
>> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
>> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetma
>> s
>> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIp
>> Addr
>> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNe
>> tma
>> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask"
>> :"2
>> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"
>> N fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the
>> type class [Lcom.cloud.agent.api.Command;
>>        at
>> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeser
>> ial
>> izerExceptionWrapper.java:64)
>>        at
>> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(Js
>> onD
>> eserializationVisitor.java:92)
>>        at
>> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(Jso
>> nDe
>> serializationVisitor.java:80)
>>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>>        at
>> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDe
>> s
>> erializationContextDefault.java:67)
>>        at
>> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDese
>> rial
>> izationContextDefault.java:52)
>>        at com.google.gson.Gson.fromJson(Gson.java:551)
>>        at com.google.gson.Gson.fromJson(Gson.java:498)
>>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>>        at
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
>> st(AgentManagerImpl.java:1196)
>>        at
>> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
>> ManagerImpl.java:1349)
>>        at
>> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
>> dler.doTask(ClusteredAgentManagerImpl.java:659)
>>        at com.cloud.utils.nio.Task.run(Task.java:83)
>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
>> Source)
>>        at java.lang.Thread.run(Unknown Source) Caused by:
>> com.cloud.utils.exception.CloudRuntimeException: can't find
>> StartupSecondaryStorageCommand
>>        at
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapto
>> r
>> .java:77)
>>        at
>> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdapto
>> r
>> .java:37)
>>        at
>> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeser
>> ial
>> izerExceptionWrapper.java:51)
>>        ... 15 more
>> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 //
>> dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System Alert:
>> Number of unallocated virtual network public IPs is low in
>> availability zone MCCDZone


RE: master not perfect:(

Posted by Hugo Trippaers <HT...@schubergphilis.com>.
Hey guys,

Did you use the latest systemvm.iso on the systemvm? This error might occur when the classes on the secondary storage vm are out of sync with the classes on the management server. 

If you are running from a maven build make sure that the systemvm profile is enabled to generate the systemvm.iso and that the file is properly uploaded/copied.

Cheers,


Hugo

> -----Original Message-----
> From: Abhinav Roy [mailto:abhinav.roy@citrix.com]
> Sent: Friday, July 05, 2013 11:44 AM
> To: dev@cloudstack.apache.org
> Subject: RE: master not perfect:(
> 
> I faced the same issue, then I logged on to the xenserver host and deleted
> the tags, restarted the MS but even after that i could see these errors. Finally
> I rebooted the Xen Host and after that the error was not seen. Filed a bug for
> the same, https://issues.apache.org/jira/browse/CLOUDSTACK-3377
> 
> Thanks and regards,
> Abhinav
> -----Original Message-----
> From: Daan Hoogland [mailto:DHoogland@schubergphilis.com]
> Sent: Friday, July 05, 2013 2:56 PM
> To: dev@cloudstack.apache.org
> Subject: master not perfect:(
> 
> H,
> 
> I get a repetition of the following sequence of logging when running master.
> Anybody knows what happened?
> 
> INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:)
> Connection from /127.0.0.1 closed but no cleanup was done.
> WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the
> generated keystore. Loading fail-safe one to continue.
> ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught
> problem with
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> nter":"1","pod":"1","guid":"s-1-VM-
> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmas
> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddr
> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetma
> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"2
> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"N
> fsSecondaryStorageResource","contextMap":{},"wait":0}}]
> com.google.gson.JsonParseException: The JsonDeserializer
> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize
> json object
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> nter":"1","pod":"1","guid":"s-1-VM-
> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmas
> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddr
> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetma
> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"2
> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"N
> fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type
> class [Lcom.cloud.agent.api.Command;
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserial
> izerExceptionWrapper.java:64)
>        at
> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonD
> eserializationVisitor.java:92)
>        at
> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDe
> serializationVisitor.java:80)
>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>        at
> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDes
> erializationContextDefault.java:67)
>        at
> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserial
> izationContextDefault.java:52)
>        at com.google.gson.Gson.fromJson(Gson.java:551)
>        at com.google.gson.Gson.fromJson(Gson.java:498)
>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> st(AgentManagerImpl.java:1196)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> ManagerImpl.java:1349)
>        at
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> dler.doTask(ClusteredAgentManagerImpl.java:659)
>        at com.cloud.utils.nio.Task.run(Task.java:83)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>        at java.lang.Thread.run(Unknown Source) Caused by:
> com.cloud.utils.exception.CloudRuntimeException: can't find
> StartupSecondaryStorageCommand
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor
> .java:77)
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor
> .java:37)
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserial
> izerExceptionWrapper.java:51)
>        ... 15 more
> WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the following
> exception but pushing on
> com.google.gson.JsonParseException: The JsonDeserializer
> com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize
> json object
> [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCe
> nter":"1","pod":"1","guid":"s-1-VM-
> NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-
> SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmas
> k":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddr
> ess":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetma
> sk":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"2
> 55.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"N
> fsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type
> class [Lcom.cloud.agent.api.Command;
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserial
> izerExceptionWrapper.java:64)
>        at
> com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonD
> eserializationVisitor.java:92)
>        at
> com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDe
> serializationVisitor.java:80)
>        at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
>        at
> com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDes
> erializationContextDefault.java:67)
>        at
> com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserial
> izationContextDefault.java:52)
>        at com.google.gson.Gson.fromJson(Gson.java:551)
>        at com.google.gson.Gson.fromJson(Gson.java:498)
>        at com.cloud.agent.transport.Request.getCommands(Request.java:235)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processReque
> st(AgentManagerImpl.java:1196)
>        at
> com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(Agent
> ManagerImpl.java:1349)
>        at
> com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHan
> dler.doTask(ClusteredAgentManagerImpl.java:659)
>        at com.cloud.utils.nio.Task.run(Task.java:83)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
> Source)
>        at java.lang.Thread.run(Unknown Source) Caused by:
> com.cloud.utils.exception.CloudRuntimeException: can't find
> StartupSecondaryStorageCommand
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor
> .java:77)
>        at
> com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor
> .java:37)
>        at
> com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserial
> izerExceptionWrapper.java:51)
>        ... 15 more
> WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 //
> dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System Alert:
> Number of unallocated virtual network public IPs is low in availability zone
> MCCDZone


RE: master not perfect:(

Posted by Abhinav Roy <ab...@citrix.com>.
I faced the same issue, then I logged on to the xenserver host and deleted the tags, restarted the MS but even after that i could see these errors. Finally I rebooted the Xen Host and after that the error was not seen. Filed a bug for the same, https://issues.apache.org/jira/browse/CLOUDSTACK-3377

Thanks and regards,
Abhinav
-----Original Message-----
From: Daan Hoogland [mailto:DHoogland@schubergphilis.com] 
Sent: Friday, July 05, 2013 2:56 PM
To: dev@cloudstack.apache.org
Subject: master not perfect:(

H,

I get a repetition of the following sequence of logging when running master. Anybody knows what happened?

INFO  [agent.manager.AgentManagerImpl] (AgentManager-Handler-11:) Connection from /127.0.0.1 closed but no cleanup was done.
WARN  [utils.nio.Link] (AgentManager-Selector:) SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
ERROR [agent.transport.Request] (AgentManager-Handler-13:) Caught problem with [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}]
com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize json object [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
       at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
       at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
       at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
       at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
       at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
       at com.google.gson.Gson.fromJson(Gson.java:551)
       at com.google.gson.Gson.fromJson(Gson.java:498)
       at com.cloud.agent.transport.Request.getCommands(Request.java:235)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1196)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1349)
       at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
       at com.cloud.utils.nio.Task.run(Task.java:83)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
       at java.lang.Thread.run(Unknown Source) Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupSecondaryStorageCommand
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
       ... 15 more
WARN  [utils.nio.Task] (AgentManager-Handler-13:) Caught the following exception but pushing on
com.google.gson.JsonParseException: The JsonDeserializer com.cloud.agent.transport.ArrayTypeAdaptor@7db106d failed to deserialize json object [{"StartupSecondaryStorageCommand":{"type":"SecondaryStorage","dataCenter":"1","pod":"1","guid":"s-1-VM-NfsSecondaryStorageResource","name":"s-1-VM","version":"4.2.0-SNAPSHOT","iqn":"NoIqn","publicIpAddress":"195.66.90.212","publicNetmask":"255.255.255.224","publicMacAddress":"06:fb:ca:00:00:01","privateIpAddress":"10.200.23.62","privateMacAddress":"06:ad:58:00:00:08","privateNetmask":"255.255.255.0","storageIpAddress":"10.200.23.62","storageNetmask":"255.255.255.0","storageMacAddress":"06:ad:58:00:00:08","resourceName":"NfsSecondaryStorageResource","contextMap":{},"wait":0}}] given the type class [Lcom.cloud.agent.api.Command;
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:64)
       at com.google.gson.JsonDeserializationVisitor.invokeCustomDeserializer(JsonDeserializationVisitor.java:92)
       at com.google.gson.JsonDeserializationVisitor.visitUsingCustomHandler(JsonDeserializationVisitor.java:80)
       at com.google.gson.ObjectNavigator.accept(ObjectNavigator.java:101)
       at com.google.gson.JsonDeserializationContextDefault.fromJsonArray(JsonDeserializationContextDefault.java:67)
       at com.google.gson.JsonDeserializationContextDefault.deserialize(JsonDeserializationContextDefault.java:52)
       at com.google.gson.Gson.fromJson(Gson.java:551)
       at com.google.gson.Gson.fromJson(Gson.java:498)
       at com.cloud.agent.transport.Request.getCommands(Request.java:235)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1196)
       at com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1349)
       at com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:659)
       at com.cloud.utils.nio.Task.run(Task.java:83)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
       at java.lang.Thread.run(Unknown Source) Caused by: com.cloud.utils.exception.CloudRuntimeException: can't find StartupSecondaryStorageCommand
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:77)
       at com.cloud.agent.transport.ArrayTypeAdaptor.deserialize(ArrayTypeAdaptor.java:37)
       at com.google.gson.JsonDeserializerExceptionWrapper.deserialize(JsonDeserializerExceptionWrapper.java:51)
       ... 15 more
WARN  [apache.cloudstack.alerts] (CapacityChecker:)  alertType:: 4 // dataCenterId:: 1 // podId:: null // clusterId:: null // message:: System Alert: Number of unallocated virtual network public IPs is low in availability zone MCCDZone