You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users-cn@cloudstack.apache.org by Wayne Wei <wa...@gmail.com> on 2013/04/09 06:42:26 UTC
CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
(Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
[{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
.guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
}
2013-04-09 10:30:27,018 WARN
[network.router.VirtualNetworkApplianceManagerImpl]
(Job-Executor-1:job-1345) Unable to apply dhcp ent
ry on disconnected router r-789-VM
2013-04-09 10:30:27,021 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(Job-Executor-1:job-1345) Unable to apply dhcp ent
ry on disconnected router r-789-VM(789)
2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
(Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849 Schedu
ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
.254.2.246","vmName":"r-789-VM","wait":0}}] }
2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
(AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
[{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
-51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
rk.type":"Basic","router.name
":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
},{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
router.name
":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
08.169.39","zone.network.type":"Basic","router.name":"r-789-VM","router.ip":
ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
convert to json: [{"StartAnswer":{"
vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
u003dcs1cloud.internal dns1\u003d10.208.20.103
dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
:"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
:{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
Release 3.0 Mon Feb 6 15:10:04 PST
2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","
Re: Re:_CS_3.0.2_VR_状态一直starting中，不能提供DHCP服务
Posted by tanthalas <ta...@hotmail.com>.
赞！能发现bug！你那边是多大的环境下出现这样的问题？
或许你可以向社区提这个bug出来。
2013-04-09
刘宇超 Richard Liu
发件人： wayne.weiy
发送时间： 2013-04-09 23:21:30
收件人： users-cn@cloudstack.apache.org
抄送： users-cn
主题： Re:_CS_3.0.2_VR_状态一直starting中，不能提供DHCP服务
看了一下午代码，是bug，vr服务是正常的，就是状态不对，重启vr所在host的agent恢复了，主要是回传调用生成的json数据过大导致问题
Thanks
在 2013-4-9，23:03，tanthalas <ta...@hotmail.com> 写道：
>
> 新建VM的同时，应该可以让VR自动创建。
> 如果没有创建，肯定log有写原因。
> 根据经验来看，可能二级存储会有点小问题。总之先看了log再说。
>
>
> 2013-04-09
> 刘宇超 Richard Liu
>
>
>
>
> 发件人： Wayne Wei
> 发送时间： 2013-04-09 15:36:58
> 收件人： users-cn
> 抄送：
> 主题： Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>
> 重新删除了VR，现在VR一直显示Destroyed状态，新创建VM也无法激活，系统自动创建VR？不知道是否遇到过
> 2013/4/9 tanthalas <ta...@hotmail.com>
>>
>> VR不正常当然不能提供应有的服务，先检查VR为什么不能运行。
>> Unable to convert to json
>> 这个报错是个疑点，先看看主机的KVM或agent是否有问题。或者破坏掉VR，让系统自动重建。
>>
>> 2013-04-09
>> 刘宇超 Richard Liu
>>
>>
>> 发件人： Wayne Wei
>> 发送时间： 2013-04-09 12:42:55
>> 收件人： cloudstack-users-cn
>> 抄送：
>> 主题： CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>>
>> VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
>> 2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
>> (Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
>> : { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
>> [{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
>>
>> ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
>> .guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
>> }
>> 2013-04-09 10:30:27,018 WARN
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-1:job-1345) Unable to apply dhcp ent
>> ry on disconnected router r-789-VM
>> 2013-04-09 10:30:27,021 DEBUG
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-1:job-1345) Unable to apply dhcp ent
>> ry on disconnected router r-789-VM(789)
>> 2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
>> (Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849
>> Schedu
>> ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
>> [{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
>> .254.2.246","vmName":"r-789-VM","wait":0}}] }
>> 2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
>> (AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
>> 90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
>> [{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
>>
>> ,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
>>
>> name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
>>
>> -51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
>> rk.type":"Basic","router.name
>>
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
>>
>> 00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
>> ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
>> router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
>>
>> },{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
>>
>> 10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
>> router.name
>>
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
>>
>> 169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
>> 08.169.39","zone.network.type":"Basic","router.name
>> ":"r-789-VM","router.ip":
>> ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
>> convert to json: [{"StartAnswer":{"
>>
>> vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
>> ":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
>> type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
>> th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
>> eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
>> u003dcs1cloud.internal dns1\u003d10.208.20.103
>>
>> dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
>>
>> ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
>>
>> 357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
>>
>> a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
>>
>> 55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
>>
>> :"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
>>
>> Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
>>
>> ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
>>
>> :{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
>> Release 3.0 Mon Feb 6 15:10:04 PST
>> 2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","
>>
Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
Posted by "wayne.weiy" <wa...@gmail.com>.
看了一下午代码，是bug，vr服务是正常的，就是状态不对，重启vr所在host的agent恢复了，主要是回传调用生成的json数据过大导致问题
Thanks
在 2013-4-9，23:03，tanthalas <ta...@hotmail.com> 写道：
>
> 新建VM的同时，应该可以让VR自动创建。
> 如果没有创建，肯定log有写原因。
> 根据经验来看，可能二级存储会有点小问题。总之先看了log再说。
>
>
> 2013-04-09
> 刘宇超 Richard Liu
>
>
>
>
> 发件人： Wayne Wei
> 发送时间： 2013-04-09 15:36:58
> 收件人： users-cn
> 抄送：
> 主题： Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>
> 重新删除了VR，现在VR一直显示Destroyed状态，新创建VM也无法激活，系统自动创建VR？不知道是否遇到过
> 2013/4/9 tanthalas <ta...@hotmail.com>
>>
>> VR不正常当然不能提供应有的服务，先检查VR为什么不能运行。
>> Unable to convert to json
>> 这个报错是个疑点，先看看主机的KVM或agent是否有问题。或者破坏掉VR，让系统自动重建。
>>
>> 2013-04-09
>> 刘宇超 Richard Liu
>>
>>
>> 发件人： Wayne Wei
>> 发送时间： 2013-04-09 12:42:55
>> 收件人： cloudstack-users-cn
>> 抄送：
>> 主题： CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>>
>> VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
>> 2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
>> (Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
>> : { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
>> [{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
>>
>> ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
>> .guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
>> }
>> 2013-04-09 10:30:27,018 WARN
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-1:job-1345) Unable to apply dhcp ent
>> ry on disconnected router r-789-VM
>> 2013-04-09 10:30:27,021 DEBUG
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-1:job-1345) Unable to apply dhcp ent
>> ry on disconnected router r-789-VM(789)
>> 2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
>> (Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849
>> Schedu
>> ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
>> [{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
>> .254.2.246","vmName":"r-789-VM","wait":0}}] }
>> 2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
>> (AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
>> 90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
>> [{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
>>
>> ,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
>>
>> name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
>>
>> -51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
>> rk.type":"Basic","router.name
>>
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
>>
>> 00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
>> ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
>> router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
>>
>> },{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
>>
>> 10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
>> router.name
>>
>> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
>>
>> 169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
>> 08.169.39","zone.network.type":"Basic","router.name
>> ":"r-789-VM","router.ip":
>> ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
>> convert to json: [{"StartAnswer":{"
>>
>> vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
>> ":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
>> type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
>> th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
>> eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
>> u003dcs1cloud.internal dns1\u003d10.208.20.103
>>
>> dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
>>
>> ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
>>
>> 357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
>>
>> a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
>>
>> 55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
>>
>> :"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
>>
>> Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
>>
>> ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
>>
>> :{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
>> Release 3.0 Mon Feb 6 15:10:04 PST
>> 2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","
>>
Re: Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
Posted by tanthalas <ta...@hotmail.com>.
新建VM的同时，应该可以让VR自动创建。
如果没有创建，肯定log有写原因。
根据经验来看，可能二级存储会有点小问题。总之先看了log再说。
2013-04-09
刘宇超 Richard Liu
发件人： Wayne Wei
发送时间： 2013-04-09 15:36:58
收件人： users-cn
抄送：
主题： Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
重新删除了VR，现在VR一直显示Destroyed状态，新创建VM也无法激活，系统自动创建VR？不知道是否遇到过
2013/4/9 tanthalas <ta...@hotmail.com>
>
> VR不正常当然不能提供应有的服务，先检查VR为什么不能运行。
> Unable to convert to json
> 这个报错是个疑点，先看看主机的KVM或agent是否有问题。或者破坏掉VR，让系统自动重建。
>
> 2013-04-09
> 刘宇超 Richard Liu
>
>
> 发件人： Wayne Wei
> 发送时间： 2013-04-09 12:42:55
> 收件人： cloudstack-users-cn
> 抄送：
> 主题： CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>
> VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
> 2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
> (Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
> : { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
> [{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
>
> ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
> .guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
> }
> 2013-04-09 10:30:27,018 WARN
> [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-1:job-1345) Unable to apply dhcp ent
> ry on disconnected router r-789-VM
> 2013-04-09 10:30:27,021 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-1:job-1345) Unable to apply dhcp ent
> ry on disconnected router r-789-VM(789)
> 2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
> (Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849
> Schedu
> ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
> .254.2.246","vmName":"r-789-VM","wait":0}}] }
> 2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
> (AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
> 90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
> [{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
>
> ,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
>
> name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
>
> -51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
> rk.type":"Basic","router.name
>
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
>
> 00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
> ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
> router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
>
> },{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
>
> 10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
> router.name
>
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
>
> 169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
> 08.169.39","zone.network.type":"Basic","router.name
> ":"r-789-VM","router.ip":
> ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
> convert to json: [{"StartAnswer":{"
>
> vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
> ":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
> type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
> th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
> eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
> u003dcs1cloud.internal dns1\u003d10.208.20.103
>
> dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
>
> ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
>
> 357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
>
> a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
>
> 55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
>
> :"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
>
> Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
>
> ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
>
> :{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 3.0 Mon Feb 6 15:10:04 PST
> 2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","
>
Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
Posted by Wayne Wei <wa...@gmail.com>.
重新删除了VR，现在VR一直显示Destroyed状态，新创建VM也无法激活，系统自动创建VR？不知道是否遇到过
2013/4/9 tanthalas <ta...@hotmail.com>
>
> VR不正常当然不能提供应有的服务，先检查VR为什么不能运行。
> Unable to convert to json
> 这个报错是个疑点，先看看主机的KVM或agent是否有问题。或者破坏掉VR，让系统自动重建。
>
> 2013-04-09
> 刘宇超 Richard Liu
>
>
> 发件人： Wayne Wei
> 发送时间： 2013-04-09 12:42:55
> 收件人： cloudstack-users-cn
> 抄送：
> 主题： CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
>
> VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
> 2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
> (Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
> : { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
> [{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
>
> ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
> .guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
> }
> 2013-04-09 10:30:27,018 WARN
> [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-1:job-1345) Unable to apply dhcp ent
> ry on disconnected router r-789-VM
> 2013-04-09 10:30:27,021 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-1:job-1345) Unable to apply dhcp ent
> ry on disconnected router r-789-VM(789)
> 2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
> (Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849
> Schedu
> ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
> .254.2.246","vmName":"r-789-VM","wait":0}}] }
> 2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
> (AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
> 90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
> [{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
>
> ,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
>
> name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
>
> -51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
> rk.type":"Basic","router.name
>
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
>
> 00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
> ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
> router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
>
> },{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
>
> 10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
> router.name
>
> ":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
>
> 169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
> 08.169.39","zone.network.type":"Basic","router.name
> ":"r-789-VM","router.ip":
> ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
> convert to json: [{"StartAnswer":{"
>
> vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
> ":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
> type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
> th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
> eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
> u003dcs1cloud.internal dns1\u003d10.208.20.103
>
> dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
>
> ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
>
> 357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
>
> a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
>
> 55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
>
> :"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
>
> Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
>
> ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
>
> :{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 3.0 Mon Feb 6 15:10:04 PST
> 2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","
>
Re: CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
Posted by tanthalas <ta...@hotmail.com>.
VR不正常当然不能提供应有的服务，先检查VR为什么不能运行。
Unable to convert to json
这个报错是个疑点，先看看主机的KVM或agent是否有问题。或者破坏掉VR，让系统自动重建。
2013-04-09
刘宇超 Richard Liu
发件人： Wayne Wei
发送时间： 2013-04-09 12:42:55
收件人： cloudstack-users-cn
抄送：
主题： CS 3.0.2 VR 状态一直starting中，不能提供DHCP服务
VR所在host异常crash后，VR启动后一直处于starting状态，不能提供DHCP服务：
2013-04-09 10:30:27,016 WARN [agent.manager.AgentAttache]
(Job-Executor-1:job-1345) Seq 11-317390850: Timed out on Seq 11-317390850
: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
[{"routing.DhcpEntryCommand":{"vmMac":"06:9a:70:00:00:4f","vmIpAdd
ress":"10.208.169.179","vmName":"test12112321312","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router
.guest.ip":"10.208.169.39","zone.network.type":"Basic","router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}}]
}
2013-04-09 10:30:27,018 WARN
[network.router.VirtualNetworkApplianceManagerImpl]
(Job-Executor-1:job-1345) Unable to apply dhcp ent
ry on disconnected router r-789-VM
2013-04-09 10:30:27,021 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(Job-Executor-1:job-1345) Unable to apply dhcp ent
ry on disconnected router r-789-VM(789)
2013-04-09 10:48:32,488 DEBUG [agent.transport.Request]
(Job-Executor-3:job-1347) Seq 11-317390852: Waiting for Seq 317390849 Schedu
ling: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"privateRouterIpAddress":"169
.254.2.246","vmName":"r-789-VM","wait":0}}] }
2013-04-09 10:53:32,886 WARN [agent.manager.AgentAttache]
(AgentManager-Handler-66:null) Seq 11-317390849: Timed out on Seq 11-3173
90849: { Cmd , MgmtId: 964249106316, via: 11, Ver: v1, Flags: 10100111,
[{"check.CheckSshCommand":{"ip":"169.254.2.246","port":3922
,"interval":6,"retries":100,"name":"r-789-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.2.246","router.
name":"r-789-VM"},"wait":0}},{},{"routing.DhcpEntryCommand":{"vmMac":"06:60:aa:00:00:58","vmIpAddress":"10.208.169.188","vmName":"vm
-51-1-4-10","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.netwo
rk.type":"Basic","router.name
":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:6c:14:00:
00:59","vmIpAddress":"10.208.169.189","vmName":"vm-52-1-4-10-1","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDet
ails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
router.name":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}
},{"routing.DhcpEntryCommand":{"vmMac":"06:6f:80:00:00:63","vmIpAddress":"10.208.169.199","vmName":"vm-51-2-4-4-2","defaultRouter":"
10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.208.169.39","zone.network.type":"Basic","
router.name
":"r-789-VM","router.ip":"169.254.2.246"},"wait":0}},{"routing.DhcpEntryCommand":{"vmMac":"06:08:50:00:00:61","vmIpAddress":"10.208.
169.197","vmName":"vm-51-3-4-4-3","defaultRouter":"10.208.1.1","defaultDns":"10.208.169.39","accessDetails":{"router.guest.ip":"10.2
08.169.39","zone.network.type":"Basic","router.name":"r-789-VM","router.ip":
ERROR [agent.transport.Request] (AgentManager-Handler-41:null) Unable to
convert to json: [{"StartAnswer":{"
vm":{"id":789,"name":"r-789-VM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os
":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" template\u003ddomP
type\u003ddhcpsrvr name\u003dr-789-VM eth0ip\u003d10.208.169.39 e
th0mask\u003d255.255.0.0 gateway\u003d10.10.10.1 eth1ip\u003d169.254.2.8
eth1mask\u003d255.255.0.0 dhcprange\u003d10.208.0.1 domain\
u003dcs1cloud.internal dns1\u003d10.208.20.103
dns2\u003d10.208.101.82","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"v
ncPassword":"4a44616708f844dc","params":{},"disks":[{"id":1059,"name":"ROOT-789","mountPoint":"/var/lib/libvirt/images/","path":"c47
357ad-f1e2-4a22-bc31-87ad7c7bc6de","size":143360,"type":"ROOT","storagePoolType":"Filesystem","storagePoolUuid":"2745df5e-a354-42fd-
a34b-7146689170e8","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":true,"ip":"10.208.169.39","netmask":"255.2
55.0.0","gateway":"10.208.1.1","mac":"06:17:c4:00:00:6e","dns1":"10.208.20.103","dns2":"10.208.101.82","broadcastType":"Vlan","type"
:"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":1,"networkRate
Mbps":-1,"defaultNic":false,"ip":"169.254.2.8","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:08","broadcastT
ype":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"contextMap":{},"wait":0}},{"check.CheckSshAnswer"
:{"result":true,"contextMap":{},"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
Release 3.0 Mon Feb 6 15:10:04 PST
2012","scriptsVersion":"42ec62e621062be2d729c6b26c6e42b6","