You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by coudstacks <cl...@163.com> on 2012/10/12 08:12:27 UTC

vm attached with ceph-rbd disk error when start

hi,wido den hollander.
 i have followed your step , define secret-file, define ceph-pool.  all  works fine  up to now.
my environment qemu 1.2.50(qemu-system-x86_64 --version),libvirt 0.10.2. both  know rbd. 
 virt-manager  know rbd pool,and i can select rbd-volumns from rbd-pool. but error when start VM.
----xpSP3.xml  rbd  configure---------
<disk type='network' device='disk'>
      <driver name='qemu' type='raw' cache='writethrough' io='native'/>
      <auth username='admin'>
        <secret type='ceph' uuid='7a91dc24-b072-43c4-98fb-4b2415322b0f'/>
      </auth>
      <source protocol='rbd' name='cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2'>
        <host name='192.168.10.4' port='6789'/>
      </source>
      <target dev='vda' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </disk>
----xpSP3.log---------
2012-10-12 13:00:46.352+0000: starting up
LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin HOME=/root USER=root LOGNAME=root QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name xpSP3 -S -M rhel6.2.0 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -uuid b45bd66a-6700-4905-c5f4-4c799413d7b7 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/xpSP3.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=localtime,driftfix=slew -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/xpSP3.img,if=none,id=drive-ide0-0-0,format=raw,cache=none -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-v
 irtio-disk0,id=virtio-disk0 -netdev tap,fd=18,id=hostnet0 -device e1000,netdev=hostnet0,id=net0,mac=52:54:00:2a:8c:48,bus=pci.0,addr=0x3 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -vnc 0.0.0.0:0 -vga std -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
Domain id=1 is tainted: high-privileges
2012-10-12 13:00:46.361+0000: 6406: debug : virFileClose:72 : Closed fd 17
2012-10-12 13:00:46.361+0000: 6406: debug : virFileClose:72 : Closed fd 23
2012-10-12 13:00:46.362+0000: 6406: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.363+0000: 6408: debug : virCommandHook:2058 : Run hook 0x7f4a17ee2030 0x7f4a1d554370
2012-10-12 13:00:46.363+0000: 6408: debug : qemuProcessHook:2589 : Obtaining domain lock
2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockProcessStart:164 : plugin=0x7f4a10017da0 dom=0x7f4a1004ae00 paused=1 fd=0x7f4a1d553998
2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:123 : plugin=0x7f4a10017da0 dom=0x7f4a1004ae00 withResources=1
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerPluginGetDriver:280 : plugin=0x7f4a10017da0
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerNew:304 : driver=0x3712e9cb20 type=0 nparams=4 params=0x7f4a1d553830 flags=0
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:104 :   key=uuid type=uuid value=b45bd66a-6700-4905-c5f4-4c799413d7b7
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:100 :   key=name type=string value=xpSP3
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:88 :   key=id type=uint value=1
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:88 :   key=pid type=uint value=6408
2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:135 : Adding leases
2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:140 : Adding disks
2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerAddDisk:86 : Add disk /var/lib/libvirt/images/xpSP3.img
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerAddResource:333 : lock=0x7f4a10049770 type=0 name=/var/lib/libvirt/images/xpSP3.img nparams=0 params=(nil) flags=0
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerAcquire:350 : lock=0x7f4a10049770 state='(null)' flags=3 fd=0x7f4a1d553998
2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerFree:387 : lock=0x7f4a10049770
2012-10-12 13:00:46.365+0000: 6408: debug : qemuProcessHook:2614 : Moving process to cgroup
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupNew:617 : New group /libvirt/qemu/xpSP3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 0:cpu at /cgroup/cpu in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 1:cpuacct at /cgroup/cpuacct in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 2:cpuset at /cgroup/cpuset in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 3:memory at /cgroup/memory in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 4:devices at /cgroup/devices in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 5:freezer at /cgroup/freezer in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 6:blkio at /cgroup/blkio in 
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:535 : Make group /libvirt/qemu/xpSP3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpu/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuacct/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuset/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/memory/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/devices/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/freezer/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/blkio/libvirt/qemu/xpSP3/
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpu/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuacct/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuset/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/memory/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/devices/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/freezer/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/blkio/libvirt/qemu/xpSP3/tasks' to '6408'
2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessInitCpuAffinity:1848 : Setting CPU affinity
2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessInitCpuAffinity:1883 : Set CPU affinity with specified cpuset
2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessHook:2626 : Setting up security labelling
2012-10-12 13:00:46.366+0000: 6408: debug : virGetUserIDByName:2539 : User record for user '0' does not exist
2012-10-12 13:00:46.366+0000: 6408: debug : virGetGroupIDByName:2621 : Group record for group '0' does not exist
2012-10-12 13:00:46.366+0000: 6408: debug : virSecurityDACSetProcessLabel:861 : Dropping privileges of DEF to 0:0
2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessHook:2633 : Hook complete ret=0
2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2060 : Done hook 0
2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2074 : Notifying parent for handshake start on 20
2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2098 : Waiting on parent for handshake complete on 21
2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 20
2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 21
2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2119 : Hook is done 0
char device redirected to /dev/pts/4
qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory
2012-10-12 13:00:46.767+0000: shutting down
2012-10-12 13:11:33.133+0000: starting up
LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin HOME=/root USER=root LOGNAME=root QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name xpSP3 -S -M rhel6.2.0 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -uuid b45bd66a-6700-4905-c5f4-4c799413d7b7 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/xpSP3.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=localtime,driftfix=slew -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/xpSP3.img,if=none,id=drive-ide0-0-0,format=raw,cache=none -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-v
 irtio-disk0,id=virtio-disk0 -netdev tap,fd=19,id=hostnet0 -device e1000,netdev=hostnet0,id=net0,mac=52:54:00:2a:8c:48,bus=pci.0,addr=0x3 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -vnc 0.0.0.0:0 -vga std -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
Domain id=1 is tainted: high-privileges
2012-10-12 13:11:33.144+0000: 7815: debug : virFileClose:72 : Closed fd 18
2012-10-12 13:11:33.145+0000: 7815: debug : virFileClose:72 : Closed fd 24
2012-10-12 13:11:33.145+0000: 7815: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.146+0000: 7818: debug : virCommandHook:2058 : Run hook 0x7faa10a62030 0x7faa160d4370
2012-10-12 13:11:33.146+0000: 7818: debug : qemuProcessHook:2589 : Obtaining domain lock
2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockProcessStart:164 : plugin=0x7faa080020a0 dom=0x7faa0804af40 paused=1 fd=0x7faa160d3998
2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:123 : plugin=0x7faa080020a0 dom=0x7faa0804af40 withResources=1
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerPluginGetDriver:280 : plugin=0x7faa080020a0
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerNew:304 : driver=0x3712e9cb20 type=0 nparams=4 params=0x7faa160d3830 flags=0
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:104 :   key=uuid type=uuid value=b45bd66a-6700-4905-c5f4-4c799413d7b7
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:100 :   key=name type=string value=xpSP3
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:88 :   key=id type=uint value=1
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:88 :   key=pid type=uint value=7818
2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:135 : Adding leases
2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:140 : Adding disks
2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerAddDisk:86 : Add disk /var/lib/libvirt/images/xpSP3.img
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerAddResource:333 : lock=0x7faa08060820 type=0 name=/var/lib/libvirt/images/xpSP3.img nparams=0 params=(nil) flags=0
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerAcquire:350 : lock=0x7faa08060820 state='(null)' flags=3 fd=0x7faa160d3998
2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerFree:387 : lock=0x7faa08060820
2012-10-12 13:11:33.146+0000: 7818: debug : qemuProcessHook:2614 : Moving process to cgroup
2012-10-12 13:11:33.146+0000: 7818: debug : virCgroupNew:617 : New group /libvirt/qemu/xpSP3
2012-10-12 13:11:33.151+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 0:cpu at /cgroup/cpu in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 1:cpuacct at /cgroup/cpuacct in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 2:cpuset at /cgroup/cpuset in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 3:memory at /cgroup/memory in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 4:devices at /cgroup/devices in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 5:freezer at /cgroup/freezer in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 6:blkio at /cgroup/blkio in 
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:535 : Make group /libvirt/qemu/xpSP3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpu/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuacct/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuset/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/memory/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/devices/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/freezer/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/blkio/libvirt/qemu/xpSP3/
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpu/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuacct/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuset/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/memory/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/devices/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/freezer/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/blkio/libvirt/qemu/xpSP3/tasks' to '7818'
2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessInitCpuAffinity:1848 : Setting CPU affinity
2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessInitCpuAffinity:1883 : Set CPU affinity with specified cpuset
2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessHook:2626 : Setting up security labelling
2012-10-12 13:11:33.157+0000: 7818: debug : virGetUserIDByName:2539 : User record for user '0' does not exist
2012-10-12 13:11:33.157+0000: 7818: debug : virGetGroupIDByName:2621 : Group record for group '0' does not exist
2012-10-12 13:11:33.157+0000: 7818: debug : virSecurityDACSetProcessLabel:861 : Dropping privileges of DEF to 0:0
2012-10-12 13:11:33.157+0000: 7818: debug : qemuProcessHook:2633 : Hook complete ret=0
2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2060 : Done hook 0
2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2074 : Notifying parent for handshake start on 21
2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2098 : Waiting on parent for handshake complete on 22
2012-10-12 13:11:33.157+0000: 7818: debug : virFileClose:72 : Closed fd 21
2012-10-12 13:11:33.157+0000: 7818: debug : virFileClose:72 : Closed fd 22
2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2119 : Hook is done 0
char device redirected to /dev/pts/4
qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory
2012-10-12 13:11:33.557+0000: shutting down
-----------------libvirtd.log-----------
2012-10-12 13:25:28.267+0000: 9023: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
2012-10-12 13:25:29.264+0000: 9025: error : virConnectNumOfInterfaces:11014 : this function is not supported by the connection driver: virConnectNumOfInterfaces
2012-10-12 13:25:29.266+0000: 9023: error : virConnectNumOfDefinedInterfaces:11098 : this function is not supported by the connection driver: virConnectNumOfDefinedInterfaces
2012-10-12 13:25:29.267+0000: 9022: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
2012-10-12 13:25:30.264+0000: 9025: error : virConnectNumOfInterfaces:11014 : this function is not supported by the connection driver: virConnectNumOfInterfaces
2012-10-12 13:25:30.267+0000: 9023: error : virConnectNumOfDefinedInterfaces:11098 : this function is not supported by the connection driver: virConnectNumOfDefinedInterfaces
2012-10-12 13:25:30.269+0000: 9022: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
2012-10-12 13:25:30.523+0000: 9021: warning : qemuDomainObjTaint:1364 : Domain id=1 name='xpSP3' uuid=b45bd66a-6700-4905-c5f4-4c799413d7b7 is tainted: high-privileges
2012-10-12 13:25:30.943+0000: 9021: error : qemuMonitorOpenUnix:293 : failed to connect to monitor socket: No such process
2012-10-12 13:25:30.943+0000: 9021: info : qemuConnectMonitor:1247 : Failed to connect monitor for xpSP3
2012-10-12 13:25:30.943+0000: 9021: error : qemuProcessWaitForMonitor:1634 : internal error process exited while connecting to monitor: char device redirected to /dev/pts/4
qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory

Re: vm attached with ceph-rbd disk error when start

Posted by Wido den Hollander <wi...@widodh.nl>.
Hi,

Although this not directly CloudStack what you are seeing here, I'd 
recommend you to try this:

qemu-img convert -f raw -O qcow2 
rbd:cloud/testrbd:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789 
/tmp/rbd.qcow2

Does that work? That should give you a qcow2 file in /tmp

Something seems odd with your Ceph configuration, but I can't pinpoint 
what exactly.

Wido

On 10/12/2012 08:12 AM, coudstacks wrote:
> hi,wido den hollander.
>   i have followed your step , define secret-file, define ceph-pool.  all  works fine  up to now.
> my environment qemu 1.2.50(qemu-system-x86_64 --version),libvirt 0.10.2. both  know rbd.
>   virt-manager  know rbd pool,and i can select rbd-volumns from rbd-pool. but error when start VM.
> ----xpSP3.xml  rbd  configure---------
> <disk type='network' device='disk'>
>        <driver name='qemu' type='raw' cache='writethrough' io='native'/>
>        <auth username='admin'>
>          <secret type='ceph' uuid='7a91dc24-b072-43c4-98fb-4b2415322b0f'/>
>        </auth>
>        <source protocol='rbd' name='cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2'>
>          <host name='192.168.10.4' port='6789'/>
>        </source>
>        <target dev='vda' bus='virtio'/>
>        <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
>      </disk>
> ----xpSP3.log---------
> 2012-10-12 13:00:46.352+0000: starting up
> LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin HOME=/root USER=root LOGNAME=root QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name xpSP3 -S -M rhel6.2.0 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -uuid b45bd66a-6700-4905-c5f4-4c799413d7b7 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/xpSP3.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=localtime,driftfix=slew -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/xpSP3.img,if=none,id=drive-ide0-0-0,format=raw,cache=none -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,dri
 ve=drive-
v
>   irtio-disk0,id=virtio-disk0 -netdev tap,fd=18,id=hostnet0 -device e1000,netdev=hostnet0,id=net0,mac=52:54:00:2a:8c:48,bus=pci.0,addr=0x3 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -vnc 0.0.0.0:0 -vga std -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
> Domain id=1 is tainted: high-privileges
> 2012-10-12 13:00:46.361+0000: 6406: debug : virFileClose:72 : Closed fd 17
> 2012-10-12 13:00:46.361+0000: 6406: debug : virFileClose:72 : Closed fd 23
> 2012-10-12 13:00:46.362+0000: 6406: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.363+0000: 6408: debug : virCommandHook:2058 : Run hook 0x7f4a17ee2030 0x7f4a1d554370
> 2012-10-12 13:00:46.363+0000: 6408: debug : qemuProcessHook:2589 : Obtaining domain lock
> 2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockProcessStart:164 : plugin=0x7f4a10017da0 dom=0x7f4a1004ae00 paused=1 fd=0x7f4a1d553998
> 2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:123 : plugin=0x7f4a10017da0 dom=0x7f4a1004ae00 withResources=1
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerPluginGetDriver:280 : plugin=0x7f4a10017da0
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerNew:304 : driver=0x3712e9cb20 type=0 nparams=4 params=0x7f4a1d553830 flags=0
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:104 :   key=uuid type=uuid value=b45bd66a-6700-4905-c5f4-4c799413d7b7
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:100 :   key=name type=string value=xpSP3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:88 :   key=id type=uint value=1
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerLogParams:88 :   key=pid type=uint value=6408
> 2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:135 : Adding leases
> 2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerNew:140 : Adding disks
> 2012-10-12 13:00:46.365+0000: 6408: debug : virDomainLockManagerAddDisk:86 : Add disk /var/lib/libvirt/images/xpSP3.img
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerAddResource:333 : lock=0x7f4a10049770 type=0 name=/var/lib/libvirt/images/xpSP3.img nparams=0 params=(nil) flags=0
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerAcquire:350 : lock=0x7f4a10049770 state='(null)' flags=3 fd=0x7f4a1d553998
> 2012-10-12 13:00:46.365+0000: 6408: debug : virLockManagerFree:387 : lock=0x7f4a10049770
> 2012-10-12 13:00:46.365+0000: 6408: debug : qemuProcessHook:2614 : Moving process to cgroup
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupNew:617 : New group /libvirt/qemu/xpSP3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 0:cpu at /cgroup/cpu in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 1:cpuacct at /cgroup/cpuacct in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 2:cpuset at /cgroup/cpuset in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 3:memory at /cgroup/memory in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 4:devices at /cgroup/devices in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 5:freezer at /cgroup/freezer in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupDetect:273 : Detected mount/mapping 6:blkio at /cgroup/blkio in
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:535 : Make group /libvirt/qemu/xpSP3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpu/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuacct/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuset/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/memory/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/devices/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/freezer/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupMakeGroup:560 : Make controller /cgroup/blkio/libvirt/qemu/xpSP3/
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpu/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuacct/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuset/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/memory/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/devices/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/freezer/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.365+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.365+0000: 6408: debug : virCgroupSetValueStr:331 : Set value '/cgroup/blkio/libvirt/qemu/xpSP3/tasks' to '6408'
> 2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessInitCpuAffinity:1848 : Setting CPU affinity
> 2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessInitCpuAffinity:1883 : Set CPU affinity with specified cpuset
> 2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessHook:2626 : Setting up security labelling
> 2012-10-12 13:00:46.366+0000: 6408: debug : virGetUserIDByName:2539 : User record for user '0' does not exist
> 2012-10-12 13:00:46.366+0000: 6408: debug : virGetGroupIDByName:2621 : Group record for group '0' does not exist
> 2012-10-12 13:00:46.366+0000: 6408: debug : virSecurityDACSetProcessLabel:861 : Dropping privileges of DEF to 0:0
> 2012-10-12 13:00:46.366+0000: 6408: debug : qemuProcessHook:2633 : Hook complete ret=0
> 2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2060 : Done hook 0
> 2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2074 : Notifying parent for handshake start on 20
> 2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2098 : Waiting on parent for handshake complete on 21
> 2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 20
> 2012-10-12 13:00:46.366+0000: 6408: debug : virFileClose:72 : Closed fd 21
> 2012-10-12 13:00:46.366+0000: 6408: debug : virCommandHook:2119 : Hook is done 0
> char device redirected to /dev/pts/4
> qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory
> 2012-10-12 13:00:46.767+0000: shutting down
> 2012-10-12 13:11:33.133+0000: starting up
> LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin HOME=/root USER=root LOGNAME=root QEMU_AUDIO_DRV=none /usr/libexec/qemu-kvm -name xpSP3 -S -M rhel6.2.0 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 -uuid b45bd66a-6700-4905-c5f4-4c799413d7b7 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/xpSP3.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=readline -rtc base=localtime,driftfix=slew -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -drive file=/var/lib/libvirt/images/xpSP3.img,if=none,id=drive-ide0-0-0,format=raw,cache=none -device ide-drive,bus=ide.0,unit=0,drive=drive-ide0-0-0,id=ide0-0-0,bootindex=1 -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,dri
 ve=drive-
v
>   irtio-disk0,id=virtio-disk0 -netdev tap,fd=19,id=hostnet0 -device e1000,netdev=hostnet0,id=net0,mac=52:54:00:2a:8c:48,bus=pci.0,addr=0x3 -chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 -device usb-tablet,id=input0 -vnc 0.0.0.0:0 -vga std -device intel-hda,id=sound0,bus=pci.0,addr=0x4 -device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5
> Domain id=1 is tainted: high-privileges
> 2012-10-12 13:11:33.144+0000: 7815: debug : virFileClose:72 : Closed fd 18
> 2012-10-12 13:11:33.145+0000: 7815: debug : virFileClose:72 : Closed fd 24
> 2012-10-12 13:11:33.145+0000: 7815: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.146+0000: 7818: debug : virCommandHook:2058 : Run hook 0x7faa10a62030 0x7faa160d4370
> 2012-10-12 13:11:33.146+0000: 7818: debug : qemuProcessHook:2589 : Obtaining domain lock
> 2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockProcessStart:164 : plugin=0x7faa080020a0 dom=0x7faa0804af40 paused=1 fd=0x7faa160d3998
> 2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:123 : plugin=0x7faa080020a0 dom=0x7faa0804af40 withResources=1
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerPluginGetDriver:280 : plugin=0x7faa080020a0
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerNew:304 : driver=0x3712e9cb20 type=0 nparams=4 params=0x7faa160d3830 flags=0
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:104 :   key=uuid type=uuid value=b45bd66a-6700-4905-c5f4-4c799413d7b7
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:100 :   key=name type=string value=xpSP3
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:88 :   key=id type=uint value=1
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerLogParams:88 :   key=pid type=uint value=7818
> 2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:135 : Adding leases
> 2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerNew:140 : Adding disks
> 2012-10-12 13:11:33.146+0000: 7818: debug : virDomainLockManagerAddDisk:86 : Add disk /var/lib/libvirt/images/xpSP3.img
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerAddResource:333 : lock=0x7faa08060820 type=0 name=/var/lib/libvirt/images/xpSP3.img nparams=0 params=(nil) flags=0
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerAcquire:350 : lock=0x7faa08060820 state='(null)' flags=3 fd=0x7faa160d3998
> 2012-10-12 13:11:33.146+0000: 7818: debug : virLockManagerFree:387 : lock=0x7faa08060820
> 2012-10-12 13:11:33.146+0000: 7818: debug : qemuProcessHook:2614 : Moving process to cgroup
> 2012-10-12 13:11:33.146+0000: 7818: debug : virCgroupNew:617 : New group /libvirt/qemu/xpSP3
> 2012-10-12 13:11:33.151+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 0:cpu at /cgroup/cpu in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 1:cpuacct at /cgroup/cpuacct in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 2:cpuset at /cgroup/cpuset in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 3:memory at /cgroup/memory in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 4:devices at /cgroup/devices in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 5:freezer at /cgroup/freezer in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupDetect:273 : Detected mount/mapping 6:blkio at /cgroup/blkio in
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:535 : Make group /libvirt/qemu/xpSP3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpu/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuacct/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/cpuset/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/memory/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/devices/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/freezer/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupMakeGroup:560 : Make controller /cgroup/blkio/libvirt/qemu/xpSP3/
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpu/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuacct/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/cpuset/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/memory/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/devices/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/freezer/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : virCgroupSetValueStr:331 : Set value '/cgroup/blkio/libvirt/qemu/xpSP3/tasks' to '7818'
> 2012-10-12 13:11:33.156+0000: 7818: debug : virFileClose:72 : Closed fd 3
> 2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessInitCpuAffinity:1848 : Setting CPU affinity
> 2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessInitCpuAffinity:1883 : Set CPU affinity with specified cpuset
> 2012-10-12 13:11:33.156+0000: 7818: debug : qemuProcessHook:2626 : Setting up security labelling
> 2012-10-12 13:11:33.157+0000: 7818: debug : virGetUserIDByName:2539 : User record for user '0' does not exist
> 2012-10-12 13:11:33.157+0000: 7818: debug : virGetGroupIDByName:2621 : Group record for group '0' does not exist
> 2012-10-12 13:11:33.157+0000: 7818: debug : virSecurityDACSetProcessLabel:861 : Dropping privileges of DEF to 0:0
> 2012-10-12 13:11:33.157+0000: 7818: debug : qemuProcessHook:2633 : Hook complete ret=0
> 2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2060 : Done hook 0
> 2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2074 : Notifying parent for handshake start on 21
> 2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2098 : Waiting on parent for handshake complete on 22
> 2012-10-12 13:11:33.157+0000: 7818: debug : virFileClose:72 : Closed fd 21
> 2012-10-12 13:11:33.157+0000: 7818: debug : virFileClose:72 : Closed fd 22
> 2012-10-12 13:11:33.157+0000: 7818: debug : virCommandHook:2119 : Hook is done 0
> char device redirected to /dev/pts/4
> qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory
> 2012-10-12 13:11:33.557+0000: shutting down
> -----------------libvirtd.log-----------
> 2012-10-12 13:25:28.267+0000: 9023: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
> 2012-10-12 13:25:29.264+0000: 9025: error : virConnectNumOfInterfaces:11014 : this function is not supported by the connection driver: virConnectNumOfInterfaces
> 2012-10-12 13:25:29.266+0000: 9023: error : virConnectNumOfDefinedInterfaces:11098 : this function is not supported by the connection driver: virConnectNumOfDefinedInterfaces
> 2012-10-12 13:25:29.267+0000: 9022: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
> 2012-10-12 13:25:30.264+0000: 9025: error : virConnectNumOfInterfaces:11014 : this function is not supported by the connection driver: virConnectNumOfInterfaces
> 2012-10-12 13:25:30.267+0000: 9023: error : virConnectNumOfDefinedInterfaces:11098 : this function is not supported by the connection driver: virConnectNumOfDefinedInterfaces
> 2012-10-12 13:25:30.269+0000: 9022: error : virNodeNumOfDevices:13984 : this function is not supported by the connection driver: virNodeNumOfDevices
> 2012-10-12 13:25:30.523+0000: 9021: warning : qemuDomainObjTaint:1364 : Domain id=1 name='xpSP3' uuid=b45bd66a-6700-4905-c5f4-4c799413d7b7 is tainted: high-privileges
> 2012-10-12 13:25:30.943+0000: 9021: error : qemuMonitorOpenUnix:293 : failed to connect to monitor socket: No such process
> 2012-10-12 13:25:30.943+0000: 9021: info : qemuConnectMonitor:1247 : Failed to connect monitor for xpSP3
> 2012-10-12 13:25:30.943+0000: 9021: error : qemuProcessWaitForMonitor:1634 : internal error process exited while connecting to monitor: char device redirected to /dev/pts/4
> qemu-kvm: -drive file=rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789,if=none,id=drive-virtio-disk0,format=raw,cache=writethrough,aio=native: could not open disk image rbd:cloud/testrbd:debug_rbd=20:debug_monc=20:debug_auth=20:log_to_stderr=2:id=admin:key=AQCp1GFQMMOrCxAAEb4jxgUF9BuSBkQIigFi/Q==:auth_supported=cephx\;none:mon_host=192.168.10.4\:6789: No such file or directory
>