Migrating Data volume on live VM

[Makrand <ma...@gmail.com>]

Hello,

1) I am having difficulty in migrating data volume from live windows 2008r2
vm on ACS 4.4.2. The hyper-visor is XENserver 6.2. I am trying to migrate a
data volume from LUN7 (Present on our nexenta storage) to LUN16 (Present on
Hitachi Storag).

I've done mutiple attempts and I got exception like below log snippet. For
this particular move, the job ID is 12461.


2016-07-23 10:02:04,943 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> (Work-Job-Executor-22:ctx-e5d69085 job-12461/job-12462 ctx-2f553894) copy
> failed
> com.cloud.utils.exception.CloudRuntimeException: Failed to migrate volume
> org.apache.cloudstack.storage.volume.VolumeObject@d319b25 to storage pool
> org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@33c0a0e7
> at
> org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.migrateVolumeToPool(AncientDataMotionStrategy.java:387)
> at
> org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(AncientDataMotionStrate
> gy.java:427)
> at
> org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:68)
> at
> org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:73)
> at
> org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVolume(VolumeServiceImpl.java:1070)
> at
> com.cloud.storage.VolumeApiServiceImpl.liveMigrateVolume(VolumeApiServiceImpl.java:1660)
> at
> com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:1646)
> at
> com.cloud.storage.VolumeApiServiceImpl.orchestrateMigrateVolume(VolumeApiServiceImpl.java:2496)


Here is complete log snippet on pastebin for during volume migration
activity for that period.

http://pastebin.com/raw/0RpHMQ4Y

2) Please note, during initial testing when similar VMs under this account
didn't had any data, I've tested migration of root as well as data volumes
on live VM without any issues (between LUN present on Nexenta to Hitachi.
although there was one packet loss while I was moving volume......something
I've tested by running continuous pings to google.com from CMD while
migration in progress). That time the VM disks didn't had any data off
course, unlike now they have data.

3) This looks similar to my condition. Only its been reported for ACS4,3
https://issues.apache.org/jira/browse/CLOUDSTACK-8949

4) This is little off-topic, but for purpose testing, I've attached a
separate LUN18 and tried to move same data disk there. It failed this time,
but when I did xe vid list, I found there are multiple vhd files. Please
note, I just tried to move one volume of 250GB and all these entries
appeared. Is this normal with XENserver?

xe vdi-list sr-name-label=GCX-HITB-LUN18
params=name-label,name-description,physical-utilisation,virtual-size
name-label ( RW) : i-22-803-VM-DATA
name-description ( RW):
virtual-size ( RO): 268435456000
physical-utilisation ( RO): 8388608


name-label ( RW) : base copy
name-description ( RW):
virtual-size ( RO): 268435456000
physical-utilisation ( RO): 8388608


name-label ( RW) : i-22-803-VM-DATA
name-description ( RW):
virtual-size ( RO): 268435456000
physical-utilisation ( RO): 268968132608


name-label ( RW) : i-22-803-VM-DATA
name-description ( RW):
virtual-size ( RO): 268435456000
physical-utilisation ( RO): 268968132608



Best,
Makrand