You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Marty J. Sullivan" <ma...@cornell.edu> on 2015/07/14 21:03:07 UTC

libvirtd target crash on host migration

Hello,

I am testing migration of VM’s between hosts. I have two hosts set up, agent.properties on both hosts has guest.cpu.mode=host-model

VM’s run fine on either host. I can start up an instance on either with shared storage and they are happy. However, when I attempt to migrate a host, I get the following exception in cloudstack:

org.libvirt.LibvirtException: End of file while reading data: Input/output error

When I look at the target host, libvirtd has crashed. The source host is fine. It doesn’t matter which host is the source, the target for migration libvirtd will crash.

Any suggestions?

Re: libvirtd target crash on host migration

Posted by "Marty J. Sullivan" <ma...@cornell.edu>.
Here is the relevant info from libvirtd.log:






2015-07-14 18:54:18.378+0000: 7714: info : libvirt version: 0.10.2, 
package: 46.el6_6.6 (CentOS BuildSystem <http://bugs.centos.org>, 
2015-04-29-10:28:01, c6b8.bsys.dev.centos.org)
2015-07-14 18:54:18.378+0000: 7714: warning : virSecurityManagerNew:148 : 
Configured security driver "none" disables default policy to create 
confined guests
2015-07-14 18:56:48.818+0000: 7707: warning : qemuSetupCgroup:381 : Could 
not autoset a RSS limit for domain i-2-12-VM
2015-07-14 18:56:48.873+0000: 7707: warning : qemuDomainObjTaint:1459 : 
Domain id=1 name='i-2-12-VM' uuid=18a19566-84f4-42ef-843b-88b9c591e7c7 is 
tainted: high-privileges
2015-07-15 00:24:29.102+0000: 7705: warning : qemuSetupCgroup:381 : Could 
not autoset a RSS limit for domain i-2-9-VM
Caught Segmentation violation dumping internal log buffer:




    ====== start of log =====



ESX returned DECLINED
2015-07-15 00:24:28.826+00007704: debug : do_open:1281 : nwfilter driver 2 
remote returned DECLINED
2015-07-15 00:24:28.826+00007704: debug : do_open:1281 : nwfilter driver 3 
nwfilter returned SUCCESS
2015-07-15 00:24:28.826+00007704: debug : virNetMessageEncodePayload:377 : 
Encode length as 28
2015-07-15 00:24:28.826+00007704: debug : 
virNetServerClientSendMessageLocked:1122 : msg=0x107cc20 proc=1 len=28 
offset=0
2015-07-15 00:24:28.826+00007704: debug : 
virNetServerClientSendMessageLocked:1130 : RPC_SERVER_CLIENT_MSG_TX_QUEUE: 
client=0x107b9b0 len=28 prog=536903814 vers=1 proc=1 type=1 status=0 
serial=1
2015-07-15 00:24:28.826+00007704: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107cab0 
tx=0x107cc20
2015-07-15 00:24:28.826+00007704: debug : 
virNetServerClientCalculateHandleMode:183 : mode=3
2015-07-15 00:24:28.826+00007704: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=3
2015-07-15 00:24:28.826+00007704: debug : virEventPollInterruptLocked:701 
: Interrupting
2015-07-15 00:24:28.826+00007704: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x10830b0
2015-07-15 00:24:28.826+00007704: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x107b9b0
2015-07-15 00:24:28.826+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=1 events=1
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.826+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=5 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.826+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.826+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.826+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.826+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=687 events=2
2015-07-15 00:24:28.826+00007703: debug : virNetMessageFree:73 : 
msg=0x107cc20 nfds=0 cb=(nil)
2015-07-15 00:24:28.826+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107cab0 
tx=(nil)
2015-07-15 00:24:28.826+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.826+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.826+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.826+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.826+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=1 d=0
2015-07-15 00:24:28.826+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.826+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.826+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=687 events=1
2015-07-15 00:24:28.828+00007703: debug : virNetMessageDecodeLength:152 : 
Got length, now need 32 total (28 more)
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107cab0 
tx=(nil)
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientDispatchRead:878 : RPC_SERVER_CLIENT_MSG_RX: 
client=0x107b9b0 len=32 prog=536903814 vers=1 proc=60 type=0 status=0 
serial=2
2015-07-15 00:24:28.828+00007703: debug : virKeepAliveCheckMessage:384 : 
ka=0x10780e0, client=0x107b9b0, msg=0x107cab0
2015-07-15 00:24:28.828+00007703: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x107b9b0
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerDispatchNewMessage:218 : server=0x107a450 client=0x107b9b0 
message=0x107cab0
2015-07-15 00:24:28.828+00007703: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x10830b0
2015-07-15 00:24:28.828+00007703: debug : virNetMessageNew:45 : 
msg=0x107c9d0 tracked=1
2015-07-15 00:24:28.828+00007707: debug : virNetServerHandleJob:189 : 
server=0x107a450 client=0x107b9b0 message=0x107cab0 prog=0x10830b0
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107c9d0 
tx=(nil)
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.828+00007707: debug : virNetServerProgramDispatch:284 
: prog=536903814 ver=1 type=0 status=0 serial=2 proc=60
2015-07-15 00:24:28.828+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007707: debug : 
remoteDispatchSupportsFeatureHelper:13350 : server=0x107a450 
client=0x107b9b0 msg=0x107cab0 rerr=0x7fdfb6fb5b80 args=0x7fdf98061ef0 
ret=0x7fdf98061e80
2015-07-15 00:24:28.828+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007707: debug : virDrvSupportsFeature:1505 : 
conn=0x7fdfac0123a0, feature=6
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : virNetMessageEncodePayload:377 : 
Encode length as 32
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : 
virNetServerClientSendMessageLocked:1122 : msg=0x107cab0 proc=60 len=32 
offset=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : 
virNetServerClientSendMessageLocked:1130 : RPC_SERVER_CLIENT_MSG_TX_QUEUE: 
client=0x107b9b0 len=32 prog=536903814 vers=1 proc=60 type=1 status=0 
serial=2
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107c9d0 
tx=0x107cab0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : 
virNetServerClientCalculateHandleMode:183 : mode=3
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.828+00007707: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=3
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.828+00007707: debug : virEventPollInterruptLocked:701 
: Interrupting
2015-07-15 00:24:28.828+00007707: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x10830b0
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.828+00007707: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x107b9b0
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=1 events=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=5 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.828+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=687 events=2
2015-07-15 00:24:28.828+00007703: debug : virNetMessageFree:73 : 
msg=0x107cab0 nfds=0 cb=(nil)
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107c9d0 
tx=(nil)
2015-07-15 00:24:28.828+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.828+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.828+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=1 d=0
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.828+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.828+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.958+00007703: debug : virEventPollRunOnce:625 : Poll 
got 1 event(s)
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchTimeouts:410 
: Dispatch 3
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:455 
: Dispatch 13
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=0 w=1
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=1 w=2
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=2 w=3
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=3 w=4
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=4 w=5
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=5 w=6
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=6 w=7
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=7 w=8
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=8 w=9
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=9 w=11
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=10 w=15
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=11 w=686
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:469 
: i=12 w=687
2015-07-15 00:24:28.958+00007703: debug : virEventPollDispatchHandles:483 
: EVENT_POLL_DISPATCH_HANDLE: watch=687 events=1
2015-07-15 00:24:28.958+00007703: debug : virNetMessageDecodeLength:152 : 
Got length, now need 4728 total (4724 more)
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x107c9d0 
tx=(nil)
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.958+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.958+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerClientDispatchRead:878 : RPC_SERVER_CLIENT_MSG_RX: 
client=0x107b9b0 len=4728 prog=536903814 vers=1 proc=214 type=0 status=0 
serial=3
2015-07-15 00:24:28.958+00007703: debug : virKeepAliveCheckMessage:384 : 
ka=0x10780e0, client=0x107b9b0, msg=0x107c9d0
2015-07-15 00:24:28.958+00007703: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x107b9b0
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerDispatchNewMessage:218 : server=0x107a450 client=0x107b9b0 
message=0x107c9d0
2015-07-15 00:24:28.958+00007703: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x10830b0
2015-07-15 00:24:28.958+00007703: debug : virNetMessageNew:45 : 
msg=0x1077650 tracked=1
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerClientCalculateHandleMode:152 : tls=(nil) hs=-1, rx=0x1077650 
tx=(nil)
2015-07-15 00:24:28.958+00007703: debug : 
virNetServerClientCalculateHandleMode:183 : mode=1
2015-07-15 00:24:28.958+00007703: debug : virEventPollUpdateHandle:146 : 
EVENT_POLL_UPDATE_HANDLE: watch=687 events=1
2015-07-15 00:24:28.958+00007705: debug : virNetServerHandleJob:189 : 
server=0x107a450 client=0x107b9b0 message=0x107c9d0 prog=0x10830b0
2015-07-15 00:24:28.958+00007703: debug : virEventPollInterruptLocked:697 
: Skip interrupt, 1 -950515616
2015-07-15 00:24:28.958+00007705: debug : virNetServerProgramDispatch:284 
: prog=536903814 ver=1 type=0 status=0 serial=3 proc=214
2015-07-15 00:24:28.958+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.958+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.958+00007703: debug : virEventRunDefaultImpl:244 : 
running default event implementation
2015-07-15 00:24:28.958+00007703: debug : virEventPollCleanupTimeouts:501 
: Cleanup 3
2015-07-15 00:24:28.958+00007703: debug : virEventPollCleanupHandles:549 : 
Cleanup 13
2015-07-15 00:24:28.958+00007705: debug : 
remoteDispatchDomainMigratePrepare3Helper:3694 : server=0x107a450 
client=0x107b9b0 msg=0x107c9d0 rerr=0x7fdfb83b7b80 args=0x7fdf940ce700 
ret=0x7fdf940ce6e0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=0 w=1, f=7 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=1 w=2, f=9 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=2 w=3, f=12 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=3 w=4, f=13 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=4 w=5, f=14 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=5 w=6, f=15 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=6 w=7, f=6 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=7 w=8, f=16 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=8 w=9, f=18 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=9 w=11, f=20 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=10 w=15, f=25 e=25 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=11 w=686, f=23 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollMakePollFDs:378 : 
Prepare n=12 w=687, f=27 e=1 d=0
2015-07-15 00:24:28.958+00007703: debug : virEventPollCalculateTimeout:320 
: Calculate expiry of 3 timers
2015-07-15 00:24:28.958+00007703: debug : virEventPollCalculateTimeout:346 
: Timeout at 0 due in -1 ms
2015-07-15 00:24:28.958+00007705: debug : virDomainMigratePrepare3:6140 : 
dconn=0x7fdfac0123a0, cookiein=0x7fdf940ce7e0, cookieinlen=248, 
cookieout=0x7fdfb83b7ae0, cookieoutlen=0x7fdfb83b7aec, 
uri_in=tcp:128.253.3.17, uri_out=0x7fdf94044250, flags=1, dname=i-2-9-VM, 
bandwidth=1000, dom_xml=<domain type='kvm'>
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <description>CentOS 7</description>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <cputune>
    <shares>10000</shares>
  </cputune>
  <os>
    <type arch='x86_64' machine='rhel6.6.0'>hvm</type>
    <boot dev='cdrom'/>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode='host-model' match='exact'>
    <model fallback='allow'>Nehalem</model>
    <vendor>Intel</vendor>
    <topology sockets='1' cores='4' threads='1'/>
    <feature policy='require' name='invpcid'/>
    <feature policy='require' name='erms'/>
    <feature policy='require' name='bmi2'/>
    <feature policy='require' name='smep'/>
    <feature policy='require' name='avx2'/>
    <feature policy='require' name='bmi1'/>
    <feature policy='require' name='fsgsbase'/>
    <feature policy='require' name='abm'/>
    <feature policy='require' name='rdtscp'/>
    <feature policy='require' name='pdpe1gb'/>
    <feature policy='require' name='rdrand'/>
    <feature policy='require' name='f16c'/>
    <feature policy='require' name='avx'/>
    <feature policy='require' name='osxsave'/>
    <feature policy='require' name='xsave'/>
    <feature policy='require' name='tsc-deadline'/>
    <feature policy='require' name='movbe'/>
    <feature policy='require' name='x2apic'/>
    <feature policy='require' name='dca'/>
    <feature policy='require' name='pcid'/>
    <feature policy='require' name='pdcm'/>
    <feature policy='require' name='xtpr'/>
    <feature policy='require' name='fma'/>
    <feature policy='require' name='tm2'/>
    <feature policy='require' name='est'/>
    <feature policy='require' name='smx'/>
    <feature policy='require' name='vmx'/>
    <feature policy='require' name='ds_cpl'/>
    <feature policy='require' name='monitor'/>
    <feature policy='require' name='dtes64'/>
    <feature policy='require' name='pclmuldq'/>
    <feature policy='require' name='pbe'/>
    <feature policy='require' name='tm'/>
    <feature policy='require' name='ht'/>
    <feature policy='require' name='ss'/>
    <feature policy='require' name='acpi'/>
    <feature policy='require' name='ds'/>
    <feature policy='require' name='vme'/>
  </cpu>
  <clock offset='utc'>
    <timer name='kvmclock'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2' cache='none'/>
      <source 
file='/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b
25d39b6e7'/>
      <target dev='hda' bus='ide'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw' cache='none'/>
      <target dev='hdc' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='1' target='0' unit='0'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2' cache='none'/>
      <source 
file='/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b
3f797fd76'/>
      <target dev='vdb' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' 
function='0x0'/>
    </disk>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' 
function='0x1'/>
    </controller>
    <interface type='bridge'>
      <mac address='06:fc:1e:00:00:55'/>
      <source bridge='cloudbr0'/>
      <model type='e1000'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' 
function='0x0'/>
    </interface>
    <serial type='pty'>
      <target port='0'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <input type='tablet' bus='usb'/>
    <input type='mouse' bus='ps2'/>
    <graphics type='vnc' port='-1' autoport='yes' listen='128.253.3.17'>
      <listen type='address' address='128.253.3.17'/>
    </graphics>
    <video>
      <model type='cirrus' vram='9216' heads='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' 
function='0x0'/>
    </video>
    <memballoon model='none'/>
  </devices>
</domain>


2015-07-15 00:24:28.958+00007703: debug : virEventPollRunOnce:614 : 
EVENT_POLL_RUN: nhandles=13 timeout=-1
2015-07-15 00:24:28.958+00007705: debug : qemuMigrationPrepareDirect:1645 
: driver=0x7fdfac0f87a0, dconn=0x7fdfac0123a0, cookiein=<qemu-migration>
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <hostname>kvm001.eas.cornell.edu</hostname>
  <hostuuid>00000000-0000-0000-0000-0cc47a4bd76c</hostuuid>
  <feature name='lockstate'/>
</qemu-migration>
, cookieinlen=248, cookieout=0x7fdfb83b7ae0, cookieoutlen=0x7fdfb83b7aec, 
uri_in=tcp:128.253.3.17, uri_out=0x7fdf94044250, dname=i-2-9-VM, 
dom_xml=<domain type='kvm'>
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <description>CentOS 7</description>
  <memory unit='KiB'>4194304</memory>
  <currentMemory unit='KiB'>4194304</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <cputune>
    <shares>10000</shares>
  </cputune>
  <os>
    <type arch='x86_64' machine='rhel6.6.0'>hvm</type>
    <boot dev='cdrom'/>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode='host-model' match='exact'>
    <model fallback='allow'>Nehalem</model>
    <vendor>Intel</vendor>
    <topology sockets='1' cores='4' threads='1'/>
    <feature policy='require' name='invpcid'/>
    <feature policy='require' name='erms'/>
    <feature policy='require' name='bmi2'/>
    <feature policy='require' name='smep'/>
    <feature policy='require' name='avx2'/>
    <feature policy='require' name='bmi1'/>
    <feature policy='require' name='fsgsbase'/>
    <feature policy='require' name='abm'/>
    <feature policy='require' name='rdtscp'/>
    <feature policy='require' name='pdpe1gb'/>
    <feature policy='require' name='rdrand'/>
    <feature policy='require' name='f16c'/>
    <feature policy='require' name='avx'/>
    <feature policy='require' name='osxsave'/>
    <feature policy='require' name='xsave'/>
    <feature policy='require' name='tsc-deadline'/>
    <feature policy='require' name='movbe'/>
    <feature policy='require' name='x2apic'/>
    <feature policy='require' name='dca'/>
    <feature policy='require' name='pcid'/>
    <feature policy='require' name='pdcm'/>
    <feature policy='require' name='xtpr'/>
    <feature policy='require' name='fma'/>
    <feature policy='require' name='tm2'/>
    <feature policy='require' name='est'/>
    <feature policy='require' name='smx'/>
    <feature policy='require' name='vmx'/>
    <feature policy='require' name='ds_cpl'/>
    <feature policy='require' name='monitor'/>
    <feature policy='require' name='dtes64'/>
    <feature policy='require' name='pclmuldq'/>
    <feature policy='require' name='pbe'/>
    <feature policy='require' name='tm'/>
    <feature policy='require' name='ht'/>
    <feature policy='require' name='ss'/>
    <feature policy='require' name='acpi'/>
    <feature policy='require' name='ds'/>
    <feature policy='require' name='vme'/>
  </cpu>
  <clock offset='utc'>
    <timer name='kvmclock'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2' cache='none'/>
      <source 
file='/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b
25d39b6e7'/>
      <target dev='hda' bus='ide'/>
      <address type='drive' controller='0' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='raw' cache='none'/>
      <target dev='hdc' bus='ide'/>
      <readonly/>
      <address type='drive' controller='0' bus='1' target='0' unit='0'/>
    </disk>
    <disk type='file' device='disk'>
      <driver name='qemu' type='qcow2' cache='none'/>
      <source 
file='/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b
3f797fd76'/>
      <target dev='vdb' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' 
function='0x0'/>
    </disk>
    <controller type='ide' index='0'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' 
function='0x1'/>
    </controller>
    <interface type='bridge'>
      <mac address='06:fc:1e:00:00:55'/>
      <source bridge='cloudbr0'/>
      <model type='e1000'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' 
function='0x0'/>
    </interface>
    <serial type='pty'>
      <target port='0'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
    </console>
    <input type='tablet' bus='usb'/>
    <input type='mouse' bus='ps2'/>
    <graphics type='vnc' port='-1' autoport='yes' listen='128.253.3.17'>
      <listen type='address' address='128.253.3.17'/>
    </graphics>
    <video>
      <model type='cirrus' vram='9216' heads='1'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' 
function='0x0'/>
    </video>
    <memballoon model='none'/>
  </devices>
</domain>


2015-07-15 00:24:28.959+00007705: debug : virFileClose:72 : Closed fd 30
2015-07-15 00:24:28.959+00007705: debug : qemuMigrationPrepareDirect:1745 
: Generated uri_out=tcp:128.253.3.17:49152
2015-07-15 00:24:28.959+00007705: debug : qemuDomainDefFormatBuf:1363 : 
Removing default USB controller from domain 'i-2-9-VM' for migration 
compatibility
2015-07-15 00:24:28.959+00007705: debug : virHookCall:281 : Calling hook 
opstr=migrate subopstr=begin extra=-
2015-07-15 00:24:28.959+00007705: debug : virCommandRunAsync:2229 : About 
to run LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin /etc/libvirt/hooks/qemu 
i-2-9-VM migrate begin -
2015-07-15 00:24:28.964+00007705: debug : virFileClose:72 : Closed fd 33
2015-07-15 00:24:28.964+00007705: debug : virFileClose:72 : Closed fd 35
2015-07-15 00:24:28.964+00007705: debug : virCommandRunAsync:2250 : 
Command result 0, with PID 16107
2015-07-15 00:24:28.964+00007705: debug : virFileClose:72 : Closed fd 30
2015-07-15 00:24:28.964+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.001+00007705: debug : virCommandRun:2045 : Result 
status 0, stdout: '<?xml version="1.0" ?><domain type="kvm">
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <description>CentOS 7</description>
  <memory unit="KiB">4194304</memory>
  <currentMemory unit="KiB">4194304</currentMemory>
  <vcpu placement="static">4</vcpu>
  <cputune>
    <shares>10000</shares>
  </cputune>
  <os>
    <type arch="x86_64" machine="rhel6.6.0">hvm</type>
    <boot dev="cdrom"/>
    <boot dev="hd"/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode="host-model">
    <model fallback="allow"/>
    <topology cores="4" sockets="1" threads="1"/>
  </cpu>
  <clock offset="utc">
    <timer name="kvmclock"/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk device="disk" type="file">
      <driver cache="none" name="qemu" type="qcow2"/>
      <source 
file="/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b
25d39b6e7"/>
      <target bus="ide" dev="hda"/>
      <address bus="0" controller="0" target="0" type="drive" unit="0"/>
    </disk>
    <disk device="cdrom" type="file">
      <driver cache="none" name="qemu" type="raw"/>
      <target bus="ide" dev="hdc"/>
      <readonly/>
      <address bus="1" controller="0" target="0" type="drive" unit="0"/>
    </disk>
    <disk device="disk" type="file">
      <driver cache="none" name="qemu" type="qcow2"/>
      <source 
file="/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b
3f797fd76"/>
      <target bus="virtio" dev="vdb"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" 
type="pci"/>
    </disk>
    <controller index="0" type="ide">
      <address bus="0x00" domain="0x0000" function="0x1" slot="0x01" 
type="pci"/>
    </controller>
    <interface type="bridge">
      <mac address="06:fc:1e:00:00:55"/>
      <source bridge="cloudbr0"/>
      <model type="e1000"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" 
type="pci"/>
    </interface>
    <serial type="pty">
      <target port="0"/>
    </serial>
    <console type="pty">
      <target port="0" type="serial"/>
    </console>
    <input bus="usb" type="tablet"/>
    <input bus="ps2" type="mouse"/>
    <graphics autoport="yes" listen="128.253.3.17" port="-1" type="vnc">
      <listen address="128.253.3.17" type="address"/>
    </graphics>
    <video>
      <model heads="1" type="cirrus" vram="9216"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" 
type="pci"/>
    </video>
    <memballoon model="none"/>
  </devices>
</domain>
' stderr: ''
2015-07-15 00:24:29.001+00007705: debug : virFileClose:72 : Closed fd 34
2015-07-15 00:24:29.001+00007705: debug : virFileClose:72 : Closed fd 32
2015-07-15 00:24:29.001+00007705: debug : qemuMigrationPrepareAny:1410 : 
Using hook-filtered domain XML: <?xml version="1.0" ?><domain type="kvm">
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <description>CentOS 7</description>
  <memory unit="KiB">4194304</memory>
  <currentMemory unit="KiB">4194304</currentMemory>
  <vcpu placement="static">4</vcpu>
  <cputune>
    <shares>10000</shares>
  </cputune>
  <os>
    <type arch="x86_64" machine="rhel6.6.0">hvm</type>
    <boot dev="cdrom"/>
    <boot dev="hd"/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <pae/>
  </features>
  <cpu mode="host-model">
    <model fallback="allow"/>
    <topology cores="4" sockets="1" threads="1"/>
  </cpu>
  <clock offset="utc">
    <timer name="kvmclock"/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/libexec/qemu-kvm</emulator>
    <disk device="disk" type="file">
      <driver cache="none" name="qemu" type="qcow2"/>
      <source 
file="/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b
25d39b6e7"/>
      <target bus="ide" dev="hda"/>
      <address bus="0" controller="0" target="0" type="drive" unit="0"/>
    </disk>
    <disk device="cdrom" type="file">
      <driver cache="none" name="qemu" type="raw"/>
      <target bus="ide" dev="hdc"/>
      <readonly/>
      <address bus="1" controller="0" target="0" type="drive" unit="0"/>
    </disk>
    <disk device="disk" type="file">
      <driver cache="none" name="qemu" type="qcow2"/>
      <source 
file="/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b
3f797fd76"/>
      <target bus="virtio" dev="vdb"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" 
type="pci"/>
    </disk>
    <controller index="0" type="ide">
      <address bus="0x00" domain="0x0000" function="0x1" slot="0x01" 
type="pci"/>
    </controller>
    <interface type="bridge">
      <mac address="06:fc:1e:00:00:55"/>
      <source bridge="cloudbr0"/>
      <model type="e1000"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" 
type="pci"/>
    </interface>
    <serial type="pty">
      <target port="0"/>
    </serial>
    <console type="pty">
      <target port="0" type="serial"/>
    </console>
    <input bus="usb" type="tablet"/>
    <input bus="ps2" type="mouse"/>
    <graphics autoport="yes" listen="128.253.3.17" port="-1" type="vnc">
      <listen address="128.253.3.17" type="address"/>
    </graphics>
    <video>
      <model heads="1" type="cirrus" vram="9216"/>
      <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" 
type="pci"/>
    </video>
    <memballoon model="none"/>
  </devices>
</domain>


2015-07-15 00:24:29.001+00007705: debug : cpuUpdate:408 : 
guest=0x7fdf940ce540, host=0x7fdf94064880
2015-07-15 00:24:29.004+00007705: debug : qemuDomainDefFormatBuf:1363 : 
Removing default USB controller from domain 'i-2-9-VM' for migration 
compatibility
2015-07-15 00:24:29.005+00007705: debug : cpuUpdate:408 : 
guest=0x7fdf940e2540, host=0x7fdf94064880
2015-07-15 00:24:29.007+00007705: debug : qemuDomainDefFormatBuf:1363 : 
Removing default USB controller from domain 'i-2-9-VM' for migration 
compatibility
2015-07-15 00:24:29.008+00007705: debug : qemuCapsCacheLookup:2194 : 
Returning caps 0x7fdfac143f40 for /usr/libexec/qemu-kvm
2015-07-15 00:24:29.008+00007705: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x7fdfac143f40
2015-07-15 00:24:29.008+00007705: debug : virObjectNew:110 : OBJECT_NEW: 
obj=0x7fdf940e2170 classname=qemuCaps
2015-07-15 00:24:29.008+00007705: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x7fdfac143f40
2015-07-15 00:24:29.008+00007705: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x7fdf940e2170
2015-07-15 00:24:29.008+00007705: debug : virObjectUnref:137 : 
OBJECT_DISPOSE: obj=0x7fdf940e2170
2015-07-15 00:24:29.008+00007705: debug : virObjectNew:110 : OBJECT_NEW: 
obj=0x7fdf940e2700 classname=virDomainObj
2015-07-15 00:24:29.008+00007705: debug : virDomainObjNew:1847 : 
obj=0x7fdf940e2700
2015-07-15 00:24:29.008+00007705: debug : qemuMigrationEatCookie:758 : 
cookielen=248 cookie='<qemu-migration>
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <hostname>kvm001.eas.cornell.edu</hostname>
  <hostuuid>00000000-0000-0000-0000-0cc47a4bd76c</hostuuid>
  <feature name='lockstate'/>
</qemu-migration>
'
2015-07-15 00:24:29.008+00007705: debug : 
qemuMigrationCookieXMLParseStr:690 : xml=<qemu-migration>
  <name>i-2-9-VM</name>
  <uuid>38276a01-3677-428e-b5d0-41e116d3a536</uuid>
  <hostname>kvm001.eas.cornell.edu</hostname>
  <hostuuid>00000000-0000-0000-0000-0cc47a4bd76c</hostuuid>
  <feature name='lockstate'/>
</qemu-migration>


2015-07-15 00:24:29.008+00007705: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x7fdf940e2700
2015-07-15 00:24:29.008+00007705: debug : 
qemuDomainObjBeginJobInternal:852 : Starting async job: migration in
2015-07-15 00:24:29.008+00007705: debug : qemuDomainObjSetJobPhase:727 : 
Setting 'migration in' phase to 'prepare'
2015-07-15 00:24:29.008+00007705: debug : qemuProcessStart:3800 : 
Beginning VM startup process
2015-07-15 00:24:29.008+00007705: debug : qemuProcessStart:3812 : Setting 
current domain def as transient
2015-07-15 00:24:29.008+00007705: debug : virHookCall:281 : Calling hook 
opstr=prepare subopstr=begin extra=-
2015-07-15 00:24:29.008+00007705: debug : virCommandRunAsync:2229 : About 
to run LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin /etc/libvirt/hooks/qemu 
i-2-9-VM prepare begin -
2015-07-15 00:24:29.009+00007705: debug : virFileClose:72 : Closed fd 33
2015-07-15 00:24:29.009+00007705: debug : virFileClose:72 : Closed fd 35
2015-07-15 00:24:29.009+00007705: debug : virCommandRunAsync:2250 : 
Command result 0, with PID 16108
2015-07-15 00:24:29.009+00007705: debug : virFileClose:72 : Closed fd 30
2015-07-15 00:24:29.009+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.032+00007705: debug : virCommandRun:2045 : Result 
status 0, stdout: '' stderr: ''
2015-07-15 00:24:29.032+00007705: debug : virFileClose:72 : Closed fd 32
2015-07-15 00:24:29.032+00007705: debug : virFileClose:72 : Closed fd 34
2015-07-15 00:24:29.032+00007705: debug : qemuProcessStart:3838 : 
Preparing host devices
2015-07-15 00:24:29.032+00007705: debug : qemuProcessStart:3842 : 
Preparing chr devices
2015-07-15 00:24:29.032+00007705: debug : qemuProcessStart:3851 : 
Generating domain security label (if required)
2015-07-15 00:24:29.035+00007705: debug : qemuProcessStart:3860 : Ensuring 
no historical cgroup is lying around
2015-07-15 00:24:29.035+00007705: debug : virCgroupNew:617 : New group 
/libvirt/qemu/i-2-9-VM
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 0:cpu at /cgroup/cpu in /virt
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 1:cpuacct at /cgroup/cpuacct in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 2:cpuset at /cgroup/cpuset in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 3:memory at /cgroup/memory in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 4:devices at /cgroup/devices in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 5:freezer at /cgroup/freezer in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 6:blkio at /cgroup/blkio in 
2015-07-15 00:24:29.035+00007705: debug : virCgroupMakeGroup:535 : Make 
group /libvirt/qemu/i-2-9-VM
2015-07-15 00:24:29.035+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpuacct/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpuset/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/memory/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/devices/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/freezer/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/blkio/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.036+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.036+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.040+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/cpuacct/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.040+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/cpuacct/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.049+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/cpuset/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.049+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/cpuset/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.055+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/memory/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.056+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/memory/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.064+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/devices/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.064+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/devices/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.071+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/freezer/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.072+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/freezer/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.079+00007705: debug : virCgroupRemove:772 : Removing 
cgroup /cgroup/blkio/libvirt/qemu/i-2-9-VM/ and all child cgroups
2015-07-15 00:24:29.080+00007705: debug : virCgroupRemoveRecursively:727 : 
Removing cgroup /cgroup/blkio/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.092+00007705: debug : virFileClose:72 : Closed fd 30
2015-07-15 00:24:29.094+00007705: debug : qemuProcessStart:3909 : Creating 
domain log file
2015-07-15 00:24:29.094+00007705: debug : qemuProcessStart:3914 : Checking 
for KVM availability
2015-07-15 00:24:29.094+00007705: debug : qemuProcessStart:3924 : 
Determining emulator version
2015-07-15 00:24:29.094+00007705: debug : qemuCapsCacheLookup:2194 : 
Returning caps 0x7fdfac143f40 for /usr/libexec/qemu-kvm
2015-07-15 00:24:29.094+00007705: debug : virObjectRef:168 : OBJECT_REF: 
obj=0x7fdfac143f40
2015-07-15 00:24:29.094+00007705: debug : virObjectNew:110 : OBJECT_NEW: 
obj=0x7fdf940caed0 classname=qemuCaps
2015-07-15 00:24:29.094+00007705: debug : virObjectUnref:135 : 
OBJECT_UNREF: obj=0x7fdfac143f40
2015-07-15 00:24:29.094+00007705: debug : qemuDomainCheckDiskPresence:2030 
: Checking for disk presence
2015-07-15 00:24:29.094+00007705: debug : virStorageFileGetMetadata:1006 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b3
f797fd76 format=12 uid=0 gid=0 probe=0
2015-07-15 00:24:29.094+00007705: debug : 
virStorageFileGetMetadataRecurse:938 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b3
f797fd76 format=12 uid=0 gid=0 probe=0
2015-07-15 00:24:29.097+00007705: debug : 
virStorageFileGetMetadataInternal:686 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/93573258-7888-4d1a-8557-39b3
f797fd76, fd=31, format=12
2015-07-15 00:24:29.098+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.098+00007705: debug : virStorageFileGetMetadata:1006 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b2
5d39b6e7 format=12 uid=0 gid=0 probe=0
2015-07-15 00:24:29.098+00007705: debug : 
virStorageFileGetMetadataRecurse:938 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b2
5d39b6e7 format=12 uid=0 gid=0 probe=0
2015-07-15 00:24:29.098+00007705: debug : 
virStorageFileGetMetadataInternal:686 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/17fb3b77-2b48-4849-965a-35b2
5d39b6e7, fd=31, format=12
2015-07-15 00:24:29.100+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.100+00007705: debug : 
virStorageFileGetMetadataRecurse:938 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/9c931eef-9674-47d0-928c-38f9
c00d67ae format=1 uid=0 gid=0 probe=0
2015-07-15 00:24:29.100+00007705: debug : 
virStorageFileGetMetadataInternal:686 : 
path=/mnt/fe8b019d-2be3-3090-bbd5-3d53c5e38ffb/9c931eef-9674-47d0-928c-38f9
c00d67ae, fd=31, format=1
2015-07-15 00:24:29.100+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.100+00007705: debug : qemuProcessStart:3957 : Setting 
up domain cgroup (if required)
2015-07-15 00:24:29.100+00007705: debug : virCgroupNew:617 : New group 
/libvirt/qemu/i-2-9-VM
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 0:cpu at /cgroup/cpu in /virt
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 1:cpuacct at /cgroup/cpuacct in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 2:cpuset at /cgroup/cpuset in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 3:memory at /cgroup/memory in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 4:devices at /cgroup/devices in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 5:freezer at /cgroup/freezer in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupDetect:273 : Detected 
mount/mapping 6:blkio at /cgroup/blkio in 
2015-07-15 00:24:29.100+00007705: debug : virCgroupMakeGroup:535 : Make 
group /libvirt/qemu/i-2-9-VM
2015-07-15 00:24:29.100+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.101+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpuacct/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.101+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/cpuset/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.101+00007705: debug : virCgroupCpuSetInherit:469 : 
Setting up inheritance /libvirt/qemu -> /libvirt/qemu/i-2-9-VM
2015-07-15 00:24:29.101+00007705: debug : virCgroupGetValueStr:361 : Get 
value /cgroup/cpuset/libvirt/qemu/cpuset.cpus
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupCpuSetInherit:482 : 
Inherit cpuset.cpus = 0-47
2015-07-15 00:24:29.102+00007705: debug : virCgroupSetValueStr:331 : Set 
value '/cgroup/cpuset/libvirt/qemu/i-2-9-VM/cpuset.cpus' to '0-47'
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupGetValueStr:361 : Get 
value /cgroup/cpuset/libvirt/qemu/cpuset.mems
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupCpuSetInherit:482 : 
Inherit cpuset.mems = 0-1
2015-07-15 00:24:29.102+00007705: debug : virCgroupSetValueStr:331 : Set 
value '/cgroup/cpuset/libvirt/qemu/i-2-9-VM/cpuset.mems' to '0-1'
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/memory/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.102+00007705: debug : virCgroupGetValueStr:361 : Get 
value /cgroup/memory/libvirt/qemu/i-2-9-VM/memory.use_hierarchy
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : 
virCgroupSetMemoryUseHierarchy:517 : Setting up 
/libvirt/qemu/i-2-9-VM/memory.use_hierarchy
2015-07-15 00:24:29.102+00007705: debug : virCgroupSetValueStr:331 : Set 
value '/cgroup/memory/libvirt/qemu/i-2-9-VM/memory.use_hierarchy' to '1'
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/devices/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.102+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/freezer/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.102+00007705: debug : virCgroupMakeGroup:560 : Make 
controller /cgroup/blkio/libvirt/qemu/i-2-9-VM/
2015-07-15 00:24:29.102+00007705: warning : qemuSetupCgroup:381 : Could 
not autoset a RSS limit for domain i-2-9-VM
2015-07-15 00:24:29.102+00007705: debug : virCgroupSetValueStr:331 : Set 
value '/cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/cpu.shares' to '10000'
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : virCgroupGetValueStr:361 : Get 
value /cgroup/cpu/virt/libvirt/qemu/i-2-9-VM/cpu.shares
2015-07-15 00:24:29.102+00007705: debug : virFileClose:72 : Closed fd 31
2015-07-15 00:24:29.102+00007705: debug : qemuProcessStart:3966 : 
Preparing monitor state
2015-07-15 00:24:29.103+00007705: debug : qemuProcessStart:4002 : 
Assigning domain PCI addresses
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1027 : 
Remembering PCI addr 0:0:4.0
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.1 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.2 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.3 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.4 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.5 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.6 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:4.7 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1027 : 
Remembering PCI addr 0:0:3.0
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.1 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.2 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.3 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.4 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.5 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.6 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:3.7 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1027 : 
Remembering PCI addr 0:0:2.0
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.1 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.2 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.3 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.4 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.5 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.6 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1053 : 
Remembering PCI addr 0:0:2.7 (multifunction=off for function 0)
2015-07-15 00:24:29.103+00007705: debug : qemuCollectPCIAddress:1027 : 
Remembering PCI addr 0:0:1.1
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.0
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.1
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.2
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.3
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.4
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.5
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.6
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:0.7
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.0
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.2
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.3
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.4
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.5
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.6
2015-07-15 00:24:29.103+00007705: debug : 
qemuDomainPCIAddressReserveAddr:1186 : Reserving PCI addr 0:0:1.7
2015-07-15 00:24:29.103+00007705: debug : qemuProcessStart:4007 : Building 
emulator command line
2015-07-15 00:24:29.103+00007705: debug : qemuBuildCommandLine:5240 : 
conn=0x7fdfac0123a0 driver=0x7fdfac0f87a0 def=0x7fdf940db630 
mon=0x7fdf940cdfd0 json=1 caps=0x7fdf940caed0 migrateFrom=tcp:[::]:49152 
migrateFD=-1 snapshot=(nil) vmop=5
2015-07-15 00:24:29.103+00007705: debug : cpuGuestData:260 : 
host=0x7fdf94064880, guest=0x7fdf940e1e60, data=0x7fdfb83b6df0, 
msg=0x7fdfb83b6de0




     ====== end of log =====









On 7/14/15, 3:03 PM, "Marty J. Sullivan" <ma...@cornell.edu> 
wrote:

>Hello,
>
>I am testing migration of VM’s between hosts. I have two hosts set up, 
>agent.properties on both hosts has guest.cpu.mode=host-model
>
>VM’s run fine on either host. I can start up an instance on either with 
>shared storage and they are happy. However, when I attempt to migrate a 
>host, I get the following exception in cloudstack:
>
>org.libvirt.LibvirtException: End of file while reading data: 
>Input/output error
>
>When I look at the target host, libvirtd has crashed. The source host is 
>fine. It doesn’t matter which host is the source, the target for 
>migration libvirtd will crash.
>
>Any suggestions?